[2024-07-24 04:29:07.530639] Starting SPDK v24.01.1-pre git sha1 dbef7efac / DPDK 23.11.0 initialization... [2024-07-24 04:29:07.530892] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid553975 ] Set seed to 1721788147524228 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 04:29:07.642394] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 04:29:07.681938] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 04:29:07.681987] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 553975' to capture a snapshot of events at runtime. [2024-07-24 04:29:07.681999] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid553975 for offline analysis/debug. [2024-07-24 04:29:07.682027] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 04:29:11 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/24-04:29:14 ... thread 0: (1000000,1000000) ops and (338955.8,338955.8) ops/second in (2.950237,2.950237) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.96 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 350.2 2.52 2.27 12 0.210 0 0 0.0 0.0 L1 4/0 251.73 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 246.8 246.5 1.02 0.98 1 1.021 255K 261 0.0 0.0 L2 3/2 188.86 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 10/0 867.41 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/6 97.00 GB 0.0 0.4 0.4 0.1 1.3 1.2 0.5 1.5 102.9 308.6 4.29 3.98 14 0.306 447K 361 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.3 1.2 0.4 1.5 102.9 308.6 4.29 3.98 14 0.306 447K 361 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 249.5 249.3 1.77 1.70 2 0.884 447K 361 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 350.2 2.52 2.27 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 423.13 MB/s write, 0.43 GB read, 141.09 MB/s read, 4.3 seconds Interval compaction: 1.29 GB write, 448.09 MB/s write, 0.43 GB read, 149.41 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 143238 Average: 1.9445 StdDev: 17.08 Min: 0 Median: 1.2565 Max: 3339 Percentiles: P50: 1.26 P75: 1.70 P99: 5.27 P99.9: 10.90 P99.99: 33.51 ------------------------------------------------------ [ 0, 1 ] 50785 35.455% 35.455% ####### ( 1, 2 ] 81216 56.700% 92.155% ########### ( 2, 3 ] 5982 4.176% 96.331% # ( 3, 4 ] 2705 1.888% 98.220% ( 4, 6 ] 1764 1.232% 99.451% ( 6, 10 ] 621 0.434% 99.885% ( 10, 15 ] 132 0.092% 99.977% ( 15, 22 ] 13 0.009% 99.986% ( 22, 34 ] 8 0.006% 99.992% ( 51, 76 ] 1 0.001% 99.992% ( 110, 170 ] 7 0.005% 99.997% ( 170, 250 ] 3 0.002% 99.999% ( 250, 380 ] 3 0.002% 100.001% ( 380, 580 ] 1 0.001% 100.002% ( 580, 870 ] 3 0.002% 100.004% ( 870, 1300 ] 2 0.001% 100.006% ( 1300, 1900 ] 2 0.001% 100.007% ( 2900, 4400 ] 3 0.002% 100.009% ** Level 1 read latency histogram (micros): Count: 25 Average: 395.7600 StdDev: 695.32 Min: 1 Median: 2.7500 Max: 2882 Percentiles: P50: 2.75 P75: 530.00 P99: 2650.00 P99.9: 2875.00 P99.99: 2882.00 ------------------------------------------------------ [ 0, 1 ] 4 16.000% 16.000% ### ( 1, 2 ] 7 28.000% 44.000% ###### ( 2, 3 ] 2 8.000% 52.000% ## ( 4, 6 ] 1 4.000% 56.000% # ( 110, 170 ] 1 4.000% 60.000% # ( 170, 250 ] 2 8.000% 68.000% ## ( 250, 380 ] 1 4.000% 72.000% # ( 380, 580 ] 1 4.000% 76.000% # ( 580, 870 ] 2 8.000% 84.000% ## ( 870, 1300 ] 1 4.000% 88.000% # ( 1300, 1900 ] 2 8.000% 96.000% ## ( 1900, 2900 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 40452 Average: 2.1261 StdDev: 6.16 Min: 0 Median: 1.4476 Max: 1107 Percentiles: P50: 1.45 P75: 1.84 P99: 5.86 P99.9: 11.05 P99.99: 33.73 ------------------------------------------------------ [ 0, 1 ] 8655 21.396% 21.396% #### ( 1, 2 ] 25853 63.910% 85.306% ############# ( 2, 3 ] 2917 7.211% 92.517% # ( 3, 4 ] 1565 3.869% 96.386% # ( 4, 6 ] 1139 2.816% 99.202% # ( 6, 10 ] 276 0.682% 99.884% ( 10, 15 ] 36 0.089% 99.973% ( 15, 22 ] 6 0.015% 99.988% ( 22, 34 ] 2 0.005% 99.993% ( 170, 250 ] 1 0.002% 99.995% ( 250, 380 ] 2 0.005% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 1394.5778 StdDev: 1090.15 Min: 246 Median: 1246.2500 Max: 4939 Percentiles: P50: 1246.25 P75: 1886.36 P99: 4939.00 P99.9: 4939.00 P99.99: 4939.00 ------------------------------------------------------ ( 170, 250 ] 2 4.444% 4.444% # ( 250, 380 ] 5 11.111% 15.556% ## ( 380, 580 ] 8 17.778% 33.333% #### ( 580, 870 ] 4 8.889% 42.222% ## ( 870, 1300 ] 4 8.889% 51.111% ## ( 1300, 1900 ] 11 24.444% 75.556% ##### ( 1900, 2900 ] 6 13.333% 88.889% ### ( 2900, 4400 ] 4 8.889% 97.778% ## ( 4400, 6600 ] 1 2.222% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1768.3333 StdDev: 1215.24 Min: 447 Median: 1264.1667 Max: 4871 Percentiles: P50: 1264.17 P75: 2400.00 P99: 4871.00 P99.9: 4871.00 P99.99: 4871.00 ------------------------------------------------------ ( 380, 580 ] 3 10.000% 10.000% ## ( 580, 870 ] 1 3.333% 13.333% # ( 870, 1300 ] 12 40.000% 53.333% ######## ( 1300, 1900 ] 5 16.667% 70.000% ### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 314.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.430 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 14.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-04:29:17 ... thread 0: (1000000,2000000) ops and (331202.5,335034.3) ops/second in (3.019301,5.969538) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.35 GB 37.8 0.6 0.0 0.6 2.3 1.8 0.0 1.3 76.9 324.7 7.37 6.76 27 0.273 575K 602 0.0 0.0 L1 1/1 2.23 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 246.8 246.5 1.02 0.98 1 1.021 255K 261 0.0 0.0 L2 2/1 79.37 MB 0.8 0.2 0.1 0.1 0.2 0.1 0.4 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 19/10 1.03 GB 0.2 0.2 0.2 0.0 0.2 0.2 0.3 1.0 227.6 227.6 0.82 0.75 1 0.822 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 133.7 133.7 1.26 0.87 1 1.259 170K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/21 97.92 GB 0.0 1.3 0.7 0.6 3.1 2.5 0.9 1.7 121.5 284.3 11.22 10.08 31 0.362 1384K 963 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.1 2.5 0.8 1.7 121.5 284.3 11.22 10.08 31 0.362 1384K 963 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 227.6 227.4 5.99 5.42 6 0.998 1384K 963 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.4 5.23 4.66 25 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.11 GB write, 519.01 MB/s write, 1.33 GB read, 221.87 MB/s read, 11.2 seconds Interval compaction: 3.11 GB write, 534.14 MB/s write, 1.33 GB read, 228.34 MB/s read, 11.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 418069 Average: 2.1889 StdDev: 15.17 Min: 0 Median: 1.4519 Max: 3613 Percentiles: P50: 1.45 P75: 1.85 P99: 5.72 P99.9: 9.95 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 91847 21.969% 21.969% #### ( 1, 2 ] 259344 62.034% 84.003% ############ ( 2, 3 ] 35492 8.490% 92.493% ## ( 3, 4 ] 16665 3.986% 96.479% # ( 4, 6 ] 12233 2.926% 99.405% # ( 6, 10 ] 2096 0.501% 99.906% ( 10, 15 ] 353 0.084% 99.991% ( 15, 22 ] 28 0.007% 99.997% ( 22, 34 ] 10 0.002% 100.000% ( 34, 51 ] 1 0.000% 100.000% ( 51, 76 ] 3 0.001% 100.001% ( 110, 170 ] 10 0.002% 100.003% ( 170, 250 ] 9 0.002% 100.005% ( 250, 380 ] 9 0.002% 100.007% ( 380, 580 ] 4 0.001% 100.008% ( 580, 870 ] 7 0.002% 100.010% ( 870, 1300 ] 4 0.001% 100.011% ( 1300, 1900 ] 3 0.001% 100.012% ( 1900, 2900 ] 2 0.000% 100.012% ( 2900, 4400 ] 6 0.001% 100.014% ** Level 1 read latency histogram (micros): Count: 26 Average: 380.6154 StdDev: 686.01 Min: 1 Median: 2.5000 Max: 2882 Percentiles: P50: 2.50 P75: 480.00 P99: 2640.00 P99.9: 2874.00 P99.99: 2882.00 ------------------------------------------------------ [ 0, 1 ] 4 15.385% 15.385% ### ( 1, 2 ] 8 30.769% 46.154% ###### ( 2, 3 ] 2 7.692% 53.846% ## ( 4, 6 ] 1 3.846% 57.692% # ( 110, 170 ] 1 3.846% 61.538% # ( 170, 250 ] 2 7.692% 69.231% ## ( 250, 380 ] 1 3.846% 73.077% # ( 380, 580 ] 1 3.846% 76.923% # ( 580, 870 ] 2 7.692% 84.615% ## ( 870, 1300 ] 1 3.846% 88.462% # ( 1300, 1900 ] 2 7.692% 96.154% ## ( 1900, 2900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 47861 Average: 2.1371 StdDev: 5.68 Min: 0 Median: 1.4647 Max: 1107 Percentiles: P50: 1.46 P75: 1.85 P99: 5.83 P99.9: 10.97 P99.99: 29.28 ------------------------------------------------------ [ 0, 1 ] 9552 19.958% 19.958% #### ( 1, 2 ] 30943 64.652% 84.610% ############# ( 2, 3 ] 3847 8.038% 92.647% ## ( 3, 4 ] 1801 3.763% 96.410% # ( 4, 6 ] 1358 2.837% 99.248% # ( 6, 10 ] 304 0.635% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 212063 Average: 3.2931 StdDev: 29.70 Min: 1 Median: 1.6163 Max: 4939 Percentiles: P50: 1.62 P75: 2.14 P99: 9.19 P99.9: 159.36 P99.99: 434.79 ------------------------------------------------------ [ 0, 1 ] 27522 12.978% 12.978% ### ( 1, 2 ] 127397 60.075% 73.053% ############ ( 2, 3 ] 30462 14.365% 87.418% ### ( 3, 4 ] 11251 5.305% 92.723% # ( 4, 6 ] 10212 4.816% 97.539% # ( 6, 10 ] 3883 1.831% 99.370% ( 10, 15 ] 638 0.301% 99.671% ( 15, 22 ] 127 0.060% 99.731% ( 22, 34 ] 35 0.017% 99.747% ( 34, 51 ] 6 0.003% 99.750% ( 51, 76 ] 3 0.001% 99.751% ( 76, 110 ] 130 0.061% 99.813% ( 110, 170 ] 226 0.107% 99.919% ( 170, 250 ] 75 0.035% 99.955% ( 250, 380 ] 61 0.029% 99.983% ( 380, 580 ] 54 0.025% 100.009% ( 580, 870 ] 22 0.010% 100.019% ( 870, 1300 ] 11 0.005% 100.025% ( 1300, 1900 ] 14 0.007% 100.031% ( 1900, 2900 ] 6 0.003% 100.034% ( 2900, 4400 ] 4 0.002% 100.036% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 4 read latency histogram (micros): Count: 320 Average: 170.0437 StdDev: 634.75 Min: 1 Median: 1.9694 Max: 4871 Percentiles: P50: 1.97 P75: 5.85 P99: 3950.00 P99.9: 4871.00 P99.99: 4871.00 ------------------------------------------------------ [ 0, 1 ] 65 20.312% 20.312% #### ( 1, 2 ] 98 30.625% 50.938% ###### ( 2, 3 ] 48 15.000% 65.938% ### ( 3, 4 ] 17 5.312% 71.250% # ( 4, 6 ] 13 4.062% 75.312% # ( 6, 10 ] 33 10.312% 85.625% ## ( 10, 15 ] 10 3.125% 88.750% # ( 15, 22 ] 4 1.250% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 12 3.750% 95.625% # ( 1300, 1900 ] 5 1.562% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 320.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.824 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.394 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/24-04:29:20 ... thread 0: (1000000,3000000) ops and (331982.4,334010.8) ops/second in (3.012208,8.981746) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.60 GB 132.2 1.7 0.0 1.7 4.4 2.8 0.0 1.6 116.4 310.2 14.61 13.57 45 0.325 1727K 1912 0.0 0.0 L1 3/0 241.58 MB 24.2 1.0 1.0 0.0 1.0 1.0 0.2 1.0 234.9 234.3 4.30 4.15 2 2.149 1025K 2355 0.0 0.0 L2 3/3 386.25 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 21/1 1005.37 MB 0.9 1.3 0.4 0.9 1.3 0.4 0.3 3.4 227.4 227.0 5.82 5.25 4 1.455 1344K 2108 0.0 0.0 L4 174/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 133.7 133.7 1.26 0.87 1 1.259 170K 0 0.0 0.0 L5 1048/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/8 98.90 GB 0.0 4.3 1.7 2.6 7.1 4.4 1.9 2.5 164.2 270.0 26.74 24.57 53 0.504 4459K 6475 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.7 2.6 7.1 4.4 1.8 2.5 164.2 270.0 26.74 24.57 53 0.504 4459K 6475 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.7 2.6 4.3 1.6 0.0 0.0 235.3 234.9 18.66 17.39 14 1.333 4459K 6475 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.0 8.08 7.18 39 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.05 GB write, 788.38 MB/s write, 4.29 GB read, 479.54 MB/s read, 26.7 seconds Interval compaction: 7.05 GB write, 803.66 MB/s write, 4.29 GB read, 488.83 MB/s read, 26.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 750123 Average: 2.2388 StdDev: 13.21 Min: 0 Median: 1.4915 Max: 3819 Percentiles: P50: 1.49 P75: 1.89 P99: 5.78 P99.9: 9.88 P99.99: 14.46 ------------------------------------------------------ [ 0, 1 ] 142794 19.036% 19.036% #### ( 1, 2 ] 472546 62.996% 82.032% ############# ( 2, 3 ] 70388 9.384% 91.415% ## ( 3, 4 ] 34035 4.537% 95.953% # ( 4, 6 ] 25659 3.421% 99.373% # ( 6, 10 ] 4071 0.543% 99.916% ( 10, 15 ] 623 0.083% 99.999% ( 15, 22 ] 66 0.009% 100.008% ( 22, 34 ] 13 0.002% 100.010% ( 34, 51 ] 4 0.001% 100.010% ( 51, 76 ] 7 0.001% 100.011% ( 110, 170 ] 14 0.002% 100.013% ( 170, 250 ] 18 0.002% 100.015% ( 250, 380 ] 16 0.002% 100.017% ( 380, 580 ] 7 0.001% 100.018% ( 580, 870 ] 14 0.002% 100.020% ( 870, 1300 ] 7 0.001% 100.021% ( 1300, 1900 ] 4 0.001% 100.022% ( 1900, 2900 ] 4 0.001% 100.022% ( 2900, 4400 ] 7 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 162818 Average: 2.9830 StdDev: 18.73 Min: 1 Median: 1.6795 Max: 3938 Percentiles: P50: 1.68 P75: 2.38 P99: 8.50 P99.9: 20.11 P99.99: 152.41 ------------------------------------------------------ [ 0, 1 ] 14663 9.006% 9.006% ## ( 1, 2 ] 98232 60.332% 69.338% ############ ( 2, 3 ] 24202 14.864% 84.203% ### ( 3, 4 ] 11590 7.118% 91.321% # ( 4, 6 ] 10921 6.707% 98.028% # ( 6, 10 ] 2535 1.557% 99.585% ( 10, 15 ] 449 0.276% 99.861% ( 15, 22 ] 88 0.054% 99.915% ( 22, 34 ] 3 0.002% 99.917% ( 34, 51 ] 5 0.003% 99.920% ( 51, 76 ] 3 0.002% 99.922% ( 76, 110 ] 58 0.036% 99.958% ( 110, 170 ] 76 0.047% 100.004% ( 170, 250 ] 37 0.023% 100.027% ( 250, 380 ] 27 0.017% 100.044% ( 380, 580 ] 22 0.014% 100.057% ( 580, 870 ] 14 0.009% 100.066% ( 870, 1300 ] 7 0.004% 100.070% ( 1300, 1900 ] 3 0.002% 100.072% ( 1900, 2900 ] 1 0.001% 100.072% ( 2900, 4400 ] 1 0.001% 100.073% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239562 Average: 3.7343 StdDev: 32.46 Min: 1 Median: 1.6185 Max: 4939 Percentiles: P50: 1.62 P75: 2.15 P99: 9.57 P99.9: 271.26 P99.99: 647.43 ------------------------------------------------------ [ 0, 1 ] 30828 12.868% 12.868% ### ( 1, 2 ] 143814 60.032% 72.901% ############ ( 2, 3 ] 34084 14.228% 87.128% ### ( 3, 4 ] 13011 5.431% 92.559% # ( 4, 6 ] 11506 4.803% 97.362% # ( 6, 10 ] 4390 1.833% 99.195% ( 10, 15 ] 723 0.302% 99.497% ( 15, 22 ] 148 0.062% 99.558% ( 22, 34 ] 38 0.016% 99.574% ( 34, 51 ] 7 0.003% 99.577% ( 51, 76 ] 3 0.001% 99.578% ( 76, 110 ] 257 0.107% 99.686% ( 110, 170 ] 339 0.142% 99.827% ( 170, 250 ] 154 0.064% 99.891% ( 250, 380 ] 125 0.052% 99.944% ( 380, 580 ] 95 0.040% 99.983% ( 580, 870 ] 69 0.029% 100.012% ( 870, 1300 ] 20 0.008% 100.020% ( 1300, 1900 ] 15 0.006% 100.027% ( 1900, 2900 ] 7 0.003% 100.030% ( 2900, 4400 ] 4 0.002% 100.031% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 4 read latency histogram (micros): Count: 320 Average: 170.0437 StdDev: 634.75 Min: 1 Median: 1.9694 Max: 4871 Percentiles: P50: 1.97 P75: 5.85 P99: 3950.00 P99.9: 4871.00 P99.99: 4871.00 ------------------------------------------------------ [ 0, 1 ] 65 20.312% 20.312% #### ( 1, 2 ] 98 30.625% 50.938% ###### ( 2, 3 ] 48 15.000% 65.938% ### ( 3, 4 ] 17 5.312% 71.250% # ( 4, 6 ] 13 4.062% 75.312% # ( 6, 10 ] 33 10.312% 85.625% ## ( 10, 15 ] 10 3.125% 88.750% # ( 15, 22 ] 4 1.250% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 12 3.750% 95.625% # ( 1300, 1900 ] 5 1.562% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 572.5000 StdDev: 718.43 Min: 85 Median: 158.0000 Max: 2222 Percentiles: P50: 158.00 P75: 580.00 P99: 2222.00 P99.9: 2222.00 P99.99: 2222.00 ------------------------------------------------------ ( 76, 110 ] 6 30.000% 30.000% ###### ( 110, 170 ] 5 25.000% 55.000% ##### ( 170, 250 ] 1 5.000% 60.000% # ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.225 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.401 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-04:29:23 ... thread 0: (1000000,4000000) ops and (335505.5,334383.2) ops/second in (2.980577,11.962323) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.52 GB 18.9 2.5 0.0 2.5 6.2 3.7 0.0 1.7 125.4 308.7 20.60 19.19 61 0.338 2622K 2961 0.0 0.0 L1 3/3 241.58 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 234.9 234.3 4.30 4.15 2 2.149 1025K 2355 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 21/0 875.43 MB 0.9 1.8 0.8 1.0 1.8 0.8 0.3 2.4 229.3 228.9 8.02 7.34 5 1.603 1867K 3143 0.0 0.0 L4 174/0 9.47 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 133.7 133.7 1.26 0.87 1 1.259 170K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/14 99.82 GB 0.0 5.7 2.0 3.6 9.3 5.7 3.1 2.5 165.8 273.7 34.92 32.28 70 0.499 5877K 8559 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.0 3.6 9.3 5.7 3.0 2.5 165.8 273.7 34.92 32.28 70 0.499 5877K 8559 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.0 3.6 5.6 2.0 0.0 0.0 239.2 238.8 24.20 22.74 18 1.344 5877K 8559 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.6 10.72 9.54 52 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.34 GB write, 787.55 MB/s write, 5.65 GB read, 476.87 MB/s read, 34.9 seconds Interval compaction: 9.34 GB write, 799.01 MB/s write, 5.65 GB read, 483.81 MB/s read, 34.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 987102 Average: 2.2034 StdDev: 12.64 Min: 0 Median: 1.4622 Max: 3819 Percentiles: P50: 1.46 P75: 1.86 P99: 5.73 P99.9: 10.33 P99.99: 29.97 ------------------------------------------------------ [ 0, 1 ] 206322 20.902% 20.902% #### ( 1, 2 ] 621470 62.959% 83.861% ############# ( 2, 3 ] 84534 8.564% 92.425% ## ( 3, 4 ] 39738 4.026% 96.450% # ( 4, 6 ] 29072 2.945% 99.396% # ( 6, 10 ] 4923 0.499% 99.894% ( 10, 15 ] 845 0.086% 99.980% ( 15, 22 ] 88 0.009% 99.989% ( 22, 34 ] 17 0.002% 99.991% ( 34, 51 ] 6 0.001% 99.991% ( 51, 76 ] 10 0.001% 99.992% ( 76, 110 ] 50 0.005% 99.997% ( 110, 170 ] 92 0.009% 100.007% ( 170, 250 ] 36 0.004% 100.010% ( 250, 380 ] 32 0.003% 100.013% ( 380, 580 ] 12 0.001% 100.015% ( 580, 870 ] 23 0.002% 100.017% ( 870, 1300 ] 11 0.001% 100.018% ( 1300, 1900 ] 5 0.001% 100.019% ( 1900, 2900 ] 4 0.000% 100.019% ( 2900, 4400 ] 8 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 222466 Average: 2.7578 StdDev: 16.04 Min: 1 Median: 1.6292 Max: 3938 Percentiles: P50: 1.63 P75: 2.13 P99: 7.93 P99.9: 15.78 P99.99: 147.70 ------------------------------------------------------ [ 0, 1 ] 23278 10.464% 10.464% ## ( 1, 2 ] 139798 62.840% 73.304% ############# ( 2, 3 ] 29614 13.312% 86.615% ### ( 3, 4 ] 13783 6.196% 92.811% # ( 4, 6 ] 12372 5.561% 98.372% # ( 6, 10 ] 2892 1.300% 99.672% ( 10, 15 ] 496 0.223% 99.895% ( 15, 22 ] 94 0.042% 99.938% ( 22, 34 ] 3 0.001% 99.939% ( 34, 51 ] 5 0.002% 99.941% ( 51, 76 ] 3 0.001% 99.942% ( 76, 110 ] 58 0.026% 99.969% ( 110, 170 ] 76 0.034% 100.003% ( 170, 250 ] 37 0.017% 100.019% ( 250, 380 ] 27 0.012% 100.031% ( 380, 580 ] 22 0.010% 100.041% ( 580, 870 ] 14 0.006% 100.048% ( 870, 1300 ] 7 0.003% 100.051% ( 1300, 1900 ] 3 0.001% 100.052% ( 1900, 2900 ] 1 0.000% 100.053% ( 2900, 4400 ] 1 0.000% 100.053% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239607 Average: 3.7605 StdDev: 32.76 Min: 0 Median: 1.6185 Max: 4939 Percentiles: P50: 1.62 P75: 2.15 P99: 9.59 P99.9: 278.84 P99.99: 654.73 ------------------------------------------------------ [ 0, 1 ] 30844 12.873% 12.873% ### ( 1, 2 ] 143823 60.025% 72.897% ############ ( 2, 3 ] 34084 14.225% 87.122% ### ( 3, 4 ] 13012 5.431% 92.553% # ( 4, 6 ] 11506 4.802% 97.355% # ( 6, 10 ] 4392 1.833% 99.188% ( 10, 15 ] 723 0.302% 99.490% ( 15, 22 ] 149 0.062% 99.552% ( 22, 34 ] 38 0.016% 99.568% ( 34, 51 ] 7 0.003% 99.571% ( 51, 76 ] 3 0.001% 99.572% ( 76, 110 ] 257 0.107% 99.679% ( 110, 170 ] 339 0.141% 99.821% ( 170, 250 ] 162 0.068% 99.888% ( 250, 380 ] 128 0.053% 99.942% ( 380, 580 ] 98 0.041% 99.982% ( 580, 870 ] 70 0.029% 100.012% ( 870, 1300 ] 20 0.008% 100.020% ( 1300, 1900 ] 16 0.007% 100.027% ( 1900, 2900 ] 7 0.003% 100.030% ( 2900, 4400 ] 4 0.002% 100.031% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 4 read latency histogram (micros): Count: 320 Average: 170.0437 StdDev: 634.75 Min: 1 Median: 1.9694 Max: 4871 Percentiles: P50: 1.97 P75: 5.85 P99: 3950.00 P99.9: 4871.00 P99.99: 4871.00 ------------------------------------------------------ [ 0, 1 ] 65 20.312% 20.312% #### ( 1, 2 ] 98 30.625% 50.938% ###### ( 2, 3 ] 48 15.000% 65.938% ### ( 3, 4 ] 17 5.312% 71.250% # ( 4, 6 ] 13 4.062% 75.312% # ( 6, 10 ] 33 10.312% 85.625% ## ( 10, 15 ] 10 3.125% 88.750% # ( 15, 22 ] 4 1.250% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 12 3.750% 95.625% # ( 1300, 1900 ] 5 1.562% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 728.2833 StdDev: 875.04 Min: 85 Median: 227.1429 Max: 3876 Percentiles: P50: 227.14 P75: 1192.50 P99: 3500.00 P99.9: 3876.00 P99.99: 3876.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 19 31.667% 41.667% ###### ( 170, 250 ] 7 11.667% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 5 8.333% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 4 6.667% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 9 15.000% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.629 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/24-04:29:27 ... thread 0: (1000000,5000000) ops and (275406.9,320650.2) ops/second in (3.630991,15.593314) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.50 GB 94.4 3.4 0.0 3.4 8.1 4.7 0.0 1.7 129.9 309.2 26.68 24.93 78 0.342 3518K 3894 0.0 0.0 L1 3/3 241.58 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 234.9 234.3 4.30 4.15 2 2.149 1025K 2355 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 21/0 875.43 MB 0.9 1.8 0.8 1.0 1.8 0.8 0.3 2.4 229.3 228.9 8.02 7.34 5 1.603 1867K 3143 0.0 0.0 L4 174/0 9.47 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 133.7 133.7 1.26 0.87 1 1.259 170K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/18 100.80 GB 0.0 6.5 2.0 4.5 11.2 6.7 3.1 2.4 162.7 279.3 41.00 38.02 87 0.471 6773K 9492 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.0 4.5 11.2 6.7 3.0 2.4 162.7 279.3 41.00 38.02 87 0.471 6773K 9492 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.0 4.5 6.5 2.0 0.0 0.0 243.1 242.7 27.44 25.94 21 1.307 6773K 9492 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.3 13.55 12.08 66 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.6 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.18 GB write, 726.00 MB/s write, 6.51 GB read, 423.00 MB/s read, 41.0 seconds Interval compaction: 11.18 GB write, 734.10 MB/s write, 6.51 GB read, 427.72 MB/s read, 41.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 17, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1477100 Average: 2.1845 StdDev: 11.36 Min: 0 Median: 1.4674 Max: 3819 Percentiles: P50: 1.47 P75: 1.85 P99: 5.69 P99.9: 9.91 P99.99: 15.27 ------------------------------------------------------ [ 0, 1 ] 291929 19.764% 19.764% #### ( 1, 2 ] 955467 64.685% 84.449% ############# ( 2, 3 ] 124584 8.434% 92.883% ## ( 3, 4 ] 57059 3.863% 96.746% # ( 4, 6 ] 39313 2.661% 99.408% # ( 6, 10 ] 7439 0.504% 99.911% ( 10, 15 ] 1158 0.078% 99.990% ( 15, 22 ] 110 0.007% 99.997% ( 22, 34 ] 23 0.002% 99.999% ( 34, 51 ] 9 0.001% 99.999% ( 51, 76 ] 10 0.001% 100.000% ( 76, 110 ] 69 0.005% 100.005% ( 110, 170 ] 113 0.008% 100.012% ( 170, 250 ] 52 0.004% 100.016% ( 250, 380 ] 42 0.003% 100.019% ( 380, 580 ] 20 0.001% 100.020% ( 580, 870 ] 30 0.002% 100.022% ( 870, 1300 ] 13 0.001% 100.023% ( 1300, 1900 ] 9 0.001% 100.024% ( 1900, 2900 ] 4 0.000% 100.024% ( 2900, 4400 ] 9 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 222466 Average: 2.7578 StdDev: 16.04 Min: 1 Median: 1.6292 Max: 3938 Percentiles: P50: 1.63 P75: 2.13 P99: 7.93 P99.9: 15.78 P99.99: 147.70 ------------------------------------------------------ [ 0, 1 ] 23278 10.464% 10.464% ## ( 1, 2 ] 139798 62.840% 73.304% ############# ( 2, 3 ] 29614 13.312% 86.615% ### ( 3, 4 ] 13783 6.196% 92.811% # ( 4, 6 ] 12372 5.561% 98.372% # ( 6, 10 ] 2892 1.300% 99.672% ( 10, 15 ] 496 0.223% 99.895% ( 15, 22 ] 94 0.042% 99.938% ( 22, 34 ] 3 0.001% 99.939% ( 34, 51 ] 5 0.002% 99.941% ( 51, 76 ] 3 0.001% 99.942% ( 76, 110 ] 58 0.026% 99.969% ( 110, 170 ] 76 0.034% 100.003% ( 170, 250 ] 37 0.017% 100.019% ( 250, 380 ] 27 0.012% 100.031% ( 380, 580 ] 22 0.010% 100.041% ( 580, 870 ] 14 0.006% 100.048% ( 870, 1300 ] 7 0.003% 100.051% ( 1300, 1900 ] 3 0.001% 100.052% ( 1900, 2900 ] 1 0.000% 100.053% ( 2900, 4400 ] 1 0.000% 100.053% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 239607 Average: 3.7605 StdDev: 32.76 Min: 0 Median: 1.6185 Max: 4939 Percentiles: P50: 1.62 P75: 2.15 P99: 9.59 P99.9: 278.84 P99.99: 654.73 ------------------------------------------------------ [ 0, 1 ] 30844 12.873% 12.873% ### ( 1, 2 ] 143823 60.025% 72.897% ############ ( 2, 3 ] 34084 14.225% 87.122% ### ( 3, 4 ] 13012 5.431% 92.553% # ( 4, 6 ] 11506 4.802% 97.355% # ( 6, 10 ] 4392 1.833% 99.188% ( 10, 15 ] 723 0.302% 99.490% ( 15, 22 ] 149 0.062% 99.552% ( 22, 34 ] 38 0.016% 99.568% ( 34, 51 ] 7 0.003% 99.571% ( 51, 76 ] 3 0.001% 99.572% ( 76, 110 ] 257 0.107% 99.679% ( 110, 170 ] 339 0.141% 99.821% ( 170, 250 ] 162 0.068% 99.888% ( 250, 380 ] 128 0.053% 99.942% ( 380, 580 ] 98 0.041% 99.982% ( 580, 870 ] 70 0.029% 100.012% ( 870, 1300 ] 20 0.008% 100.020% ( 1300, 1900 ] 16 0.007% 100.027% ( 1900, 2900 ] 7 0.003% 100.030% ( 2900, 4400 ] 4 0.002% 100.031% ( 4400, 6600 ] 1 0.000% 100.032% ** Level 4 read latency histogram (micros): Count: 320 Average: 170.0437 StdDev: 634.75 Min: 1 Median: 1.9694 Max: 4871 Percentiles: P50: 1.97 P75: 5.85 P99: 3950.00 P99.9: 4871.00 P99.99: 4871.00 ------------------------------------------------------ [ 0, 1 ] 65 20.312% 20.312% #### ( 1, 2 ] 98 30.625% 50.938% ###### ( 2, 3 ] 48 15.000% 65.938% ### ( 3, 4 ] 17 5.312% 71.250% # ( 4, 6 ] 13 4.062% 75.312% # ( 6, 10 ] 33 10.312% 85.625% ## ( 10, 15 ] 10 3.125% 88.750% # ( 15, 22 ] 4 1.250% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 12 3.750% 95.625% # ( 1300, 1900 ] 5 1.562% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 728.2833 StdDev: 875.04 Min: 85 Median: 227.1429 Max: 3876 Percentiles: P50: 227.14 P75: 1192.50 P99: 3500.00 P99.9: 3876.00 P99.99: 3876.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 19 31.667% 41.667% ###### ( 170, 250 ] 7 11.667% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 5 8.333% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 4 6.667% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 9 15.000% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 15.8 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 312.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.668 H:M:S, 16.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 271.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.039 H:M:S, 28.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-04:29:35 ... thread 0: (1000000,6000000) ops and (132985.1,259594.7) ops/second in (7.519637,23.112951) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 2.15 GB 194.9 5.2 0.0 5.2 10.8 5.7 0.0 1.9 146.1 306.0 36.21 34.04 99 0.366 5372K 7339 0.0 0.0 L1 20/0 1.70 GB 173.9 3.6 3.3 0.2 3.5 3.3 0.2 1.1 230.1 227.9 15.83 15.20 3 5.276 3698K 34K 0.0 0.0 L2 8/6 861.71 MB 2.6 0.2 0.1 0.1 0.2 0.1 1.8 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 21/6 875.43 MB 0.5 1.8 0.8 1.0 1.8 0.8 0.3 2.4 229.3 228.9 8.02 7.34 5 1.603 1867K 3143 0.0 0.0 L4 174/0 9.47 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 133.7 133.7 1.26 0.87 1 1.259 170K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/16 101.75 GB 0.0 10.9 4.4 6.5 16.5 10.0 4.0 2.9 179.3 272.0 62.06 58.18 109 0.569 11M 44K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.9 4.4 6.5 16.5 10.0 3.8 2.9 179.3 272.0 62.06 58.18 109 0.569 11M 44K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.9 4.4 6.5 10.8 4.3 0.0 0.0 243.9 242.9 45.62 43.54 27 1.690 11M 44K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.7 16.43 14.64 82 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.3 total, 23.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.48 GB write, 724.81 MB/s write, 10.87 GB read, 477.89 MB/s read, 62.1 seconds Interval compaction: 16.48 GB write, 730.27 MB/s write, 10.87 GB read, 481.49 MB/s read, 62.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 17, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2262267 Average: 2.1925 StdDev: 11.33 Min: 0 Median: 1.4535 Max: 3819 Percentiles: P50: 1.45 P75: 1.84 P99: 5.73 P99.9: 11.07 P99.99: 108.03 ------------------------------------------------------ [ 0, 1 ] 460667 20.363% 20.363% #### ( 1, 2 ] 1478459 65.353% 85.716% ############# ( 2, 3 ] 176061 7.783% 93.499% ## ( 3, 4 ] 79648 3.521% 97.019% # ( 4, 6 ] 51828 2.291% 99.310% ( 6, 10 ] 12958 0.573% 99.883% ( 10, 15 ] 1795 0.079% 99.962% ( 15, 22 ] 299 0.013% 99.976% ( 22, 34 ] 34 0.002% 99.977% ( 34, 51 ] 10 0.000% 99.978% ( 51, 76 ] 18 0.001% 99.978% ( 76, 110 ] 280 0.012% 99.991% ( 110, 170 ] 363 0.016% 100.007% ( 170, 250 ] 137 0.006% 100.013% ( 250, 380 ] 103 0.005% 100.017% ( 380, 580 ] 70 0.003% 100.020% ( 580, 870 ] 52 0.002% 100.023% ( 870, 1300 ] 15 0.001% 100.023% ( 1300, 1900 ] 10 0.000% 100.024% ( 1900, 2900 ] 9 0.000% 100.024% ( 2900, 4400 ] 12 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 285408 Average: 2.9459 StdDev: 19.29 Min: 1 Median: 1.5935 Max: 3938 Percentiles: P50: 1.59 P75: 1.99 P99: 8.27 P99.9: 121.11 P99.99: 345.07 ------------------------------------------------------ [ 0, 1 ] 35229 12.343% 12.343% ## ( 1, 2 ] 181073 63.444% 75.787% ############# ( 2, 3 ] 34430 12.063% 87.850% ## ( 3, 4 ] 15799 5.536% 93.386% # ( 4, 6 ] 13813 4.840% 98.226% # ( 6, 10 ] 3894 1.364% 99.590% ( 10, 15 ] 607 0.213% 99.803% ( 15, 22 ] 115 0.040% 99.843% ( 22, 34 ] 3 0.001% 99.844% ( 34, 51 ] 6 0.002% 99.846% ( 51, 76 ] 3 0.001% 99.847% ( 76, 110 ] 123 0.043% 99.890% ( 110, 170 ] 149 0.052% 99.943% ( 170, 250 ] 85 0.030% 99.972% ( 250, 380 ] 69 0.024% 99.996% ( 380, 580 ] 66 0.023% 100.020% ( 580, 870 ] 36 0.013% 100.032% ( 870, 1300 ] 20 0.007% 100.039% ( 1300, 1900 ] 6 0.002% 100.041% ( 1900, 2900 ] 1 0.000% 100.042% ( 2900, 4400 ] 1 0.000% 100.042% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 242940 Average: 4.2775 StdDev: 38.03 Min: 0 Median: 1.6241 Max: 4939 Percentiles: P50: 1.62 P75: 2.18 P99: 9.88 P99.9: 393.74 P99.99: 754.78 ------------------------------------------------------ [ 0, 1 ] 30954 12.741% 12.741% ### ( 1, 2 ] 145044 59.704% 72.445% ############ ( 2, 3 ] 34710 14.287% 86.733% ### ( 3, 4 ] 13373 5.505% 92.237% # ( 4, 6 ] 11960 4.923% 97.160% # ( 6, 10 ] 4609 1.897% 99.057% ( 10, 15 ] 759 0.312% 99.370% ( 15, 22 ] 160 0.066% 99.436% ( 22, 34 ] 40 0.016% 99.452% ( 34, 51 ] 7 0.003% 99.455% ( 51, 76 ] 3 0.001% 99.456% ( 76, 110 ] 258 0.106% 99.562% ( 110, 170 ] 379 0.156% 99.718% ( 170, 250 ] 233 0.096% 99.814% ( 250, 380 ] 198 0.082% 99.896% ( 380, 580 ] 161 0.066% 99.962% ( 580, 870 ] 114 0.047% 100.009% ( 870, 1300 ] 32 0.013% 100.022% ( 1300, 1900 ] 19 0.008% 100.030% ( 1900, 2900 ] 7 0.003% 100.033% ( 2900, 4400 ] 6 0.002% 100.035% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 4 read latency histogram (micros): Count: 320 Average: 170.0437 StdDev: 634.75 Min: 1 Median: 1.9694 Max: 4871 Percentiles: P50: 1.97 P75: 5.85 P99: 3950.00 P99.9: 4871.00 P99.99: 4871.00 ------------------------------------------------------ [ 0, 1 ] 65 20.312% 20.312% #### ( 1, 2 ] 98 30.625% 50.938% ###### ( 2, 3 ] 48 15.000% 65.938% ### ( 3, 4 ] 17 5.312% 71.250% # ( 4, 6 ] 13 4.062% 75.312% # ( 6, 10 ] 33 10.312% 85.625% ## ( 10, 15 ] 10 3.125% 88.750% # ( 15, 22 ] 4 1.250% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 3 0.938% 91.562% ( 580, 870 ] 1 0.312% 91.875% ( 870, 1300 ] 12 3.750% 95.625% # ( 1300, 1900 ] 5 1.562% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 728.2833 StdDev: 875.04 Min: 85 Median: 227.1429 Max: 3876 Percentiles: P50: 227.14 P75: 1192.50 P99: 3500.00 P99.9: 3876.00 P99.99: 3876.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 19 31.667% 41.667% ###### ( 170, 250 ] 7 11.667% 53.333% ## ( 250, 380 ] 3 5.000% 58.333% # ( 380, 580 ] 5 8.333% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 4 6.667% 76.667% # ( 1300, 1900 ] 4 6.667% 83.333% # ( 1900, 2900 ] 9 15.000% 98.333% ### ( 2900, 4400 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 23.3 total, 7.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 253.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.554 H:M:S, 32.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.886 H:M:S, 65.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/07/24-04:29:38 ... thread 0: (1000000,7000000) ops and (289355.7,263465.9) ops/second in (3.455954,26.568905) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 3.07 GB 12.6 5.7 0.0 5.7 12.2 6.6 0.0 1.9 140.3 303.2 41.31 38.43 114 0.362 5884K 7799 0.0 0.0 L1 20/20 1.70 GB 0.0 3.6 3.3 0.2 3.5 3.3 0.2 1.1 230.1 227.9 15.83 15.20 3 5.276 3698K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.8 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 24/0 959.21 MB 1.0 3.3 1.6 1.7 3.2 1.6 0.3 2.0 215.6 214.9 15.46 13.97 12 1.288 3385K 12K 0.0 0.0 L4 181/0 9.54 GB 1.0 0.9 0.8 0.0 0.9 0.8 0.8 1.0 160.4 160.2 5.49 4.19 14 0.392 893K 1243 0.0 0.0 L5 1064/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/34 102.66 GB 0.0 13.5 5.9 7.6 20.0 12.4 4.7 3.0 175.6 260.4 78.83 72.52 144 0.547 14M 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 5.9 7.6 20.0 12.4 4.6 3.0 175.6 260.4 78.83 72.52 144 0.547 14M 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 5.9 7.6 13.5 5.8 0.0 0.0 233.3 232.4 59.32 55.44 49 1.211 14M 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 345.3 19.52 17.07 95 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.7 total, 26.6 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.04 GB write, 767.45 MB/s write, 13.52 GB read, 517.50 MB/s read, 78.8 seconds Interval compaction: 20.04 GB write, 772.48 MB/s write, 13.52 GB read, 520.89 MB/s read, 78.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 22, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2511286 Average: 2.2600 StdDev: 12.42 Min: 0 Median: 1.4713 Max: 4016 Percentiles: P50: 1.47 P75: 1.86 P99: 5.83 P99.9: 12.17 P99.99: 137.68 ------------------------------------------------------ [ 0, 1 ] 487086 19.396% 19.396% #### ( 1, 2 ] 1630553 64.929% 84.325% ############# ( 2, 3 ] 209080 8.326% 92.650% ## ( 3, 4 ] 96697 3.850% 96.501% # ( 4, 6 ] 68475 2.727% 99.228% # ( 6, 10 ] 15898 0.633% 99.861% ( 10, 15 ] 2275 0.091% 99.951% ( 15, 22 ] 341 0.014% 99.965% ( 22, 34 ] 34 0.001% 99.966% ( 34, 51 ] 12 0.000% 99.967% ( 51, 76 ] 18 0.001% 99.967% ( 76, 110 ] 351 0.014% 99.981% ( 110, 170 ] 468 0.019% 100.000% ( 170, 250 ] 204 0.008% 100.008% ( 250, 380 ] 137 0.005% 100.014% ( 380, 580 ] 102 0.004% 100.018% ( 580, 870 ] 70 0.003% 100.021% ( 870, 1300 ] 25 0.001% 100.022% ( 1300, 1900 ] 11 0.000% 100.022% ( 1900, 2900 ] 10 0.000% 100.022% ( 2900, 4400 ] 16 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 502247 Average: 3.2634 StdDev: 31.54 Min: 1 Median: 1.6731 Max: 6638 Percentiles: P50: 1.67 P75: 2.36 P99: 8.67 P99.9: 94.00 P99.99: 240.41 ------------------------------------------------------ [ 0, 1 ] 45635 9.086% 9.086% ## ( 1, 2 ] 305296 60.786% 69.872% ############ ( 2, 3 ] 72035 14.343% 84.215% ### ( 3, 4 ] 34813 6.931% 91.146% # ( 4, 6 ] 33946 6.759% 97.905% # ( 6, 10 ] 8242 1.641% 99.546% ( 10, 15 ] 1483 0.295% 99.841% ( 15, 22 ] 190 0.038% 99.879% ( 22, 34 ] 10 0.002% 99.881% ( 34, 51 ] 6 0.001% 99.882% ( 51, 76 ] 3 0.001% 99.883% ( 76, 110 ] 162 0.032% 99.915% ( 110, 170 ] 242 0.048% 99.963% ( 170, 250 ] 152 0.030% 99.994% ( 250, 380 ] 111 0.022% 100.016% ( 380, 580 ] 102 0.020% 100.036% ( 580, 870 ] 67 0.013% 100.049% ( 870, 1300 ] 33 0.007% 100.056% ( 1300, 1900 ] 15 0.003% 100.059% ( 1900, 2900 ] 15 0.003% 100.062% ( 2900, 4400 ] 12 0.002% 100.064% ( 4400, 6600 ] 1 0.000% 100.065% ( 6600, 9900 ] 1 0.000% 100.065% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 570413 Average: 3.7227 StdDev: 34.13 Min: 0 Median: 1.7569 Max: 4939 Percentiles: P50: 1.76 P75: 2.66 P99: 9.11 P99.9: 124.13 P99.99: 230.14 ------------------------------------------------------ [ 0, 1 ] 42685 7.483% 7.483% # ( 1, 2 ] 320400 56.170% 63.653% ########### ( 2, 3 ] 98769 17.315% 80.968% ### ( 3, 4 ] 47046 8.248% 89.216% ## ( 4, 6 ] 47283 8.289% 97.505% ## ( 6, 10 ] 10949 1.919% 99.425% ( 10, 15 ] 2006 0.352% 99.776% ( 15, 22 ] 277 0.049% 99.825% ( 22, 34 ] 46 0.008% 99.833% ( 34, 51 ] 10 0.002% 99.835% ( 51, 76 ] 6 0.001% 99.836% ( 76, 110 ] 270 0.047% 99.883% ( 110, 170 ] 406 0.071% 99.954% ( 170, 250 ] 270 0.047% 100.002% ( 250, 380 ] 219 0.038% 100.040% ( 380, 580 ] 194 0.034% 100.074% ( 580, 870 ] 127 0.022% 100.096% ( 870, 1300 ] 43 0.008% 100.104% ( 1300, 1900 ] 22 0.004% 100.108% ( 1900, 2900 ] 22 0.004% 100.112% ( 2900, 4400 ] 18 0.003% 100.115% ( 4400, 6600 ] 1 0.000% 100.115% ** Level 4 read latency histogram (micros): Count: 9954 Average: 43.2873 StdDev: 192.16 Min: 1 Median: 1.9806 Max: 4871 Percentiles: P50: 1.98 P75: 3.47 P99: 823.82 P99.9: 2908.63 P99.99: 4871.00 ------------------------------------------------------ [ 0, 1 ] 477 4.792% 4.792% # ( 1, 2 ] 4589 46.102% 50.894% ######### ( 2, 3 ] 1913 19.218% 70.113% #### ( 3, 4 ] 1043 10.478% 80.591% ## ( 4, 6 ] 734 7.374% 87.965% # ( 6, 10 ] 217 2.180% 90.145% ( 10, 15 ] 74 0.743% 90.888% ( 15, 22 ] 13 0.131% 91.019% ( 76, 110 ] 51 0.512% 91.531% ( 110, 170 ] 148 1.487% 93.018% ( 170, 250 ] 140 1.406% 94.424% ( 250, 380 ] 152 1.527% 95.951% ( 380, 580 ] 195 1.959% 97.910% ( 580, 870 ] 129 1.296% 99.206% ( 870, 1300 ] 51 0.512% 99.719% ( 1300, 1900 ] 11 0.111% 99.829% ( 1900, 2900 ] 7 0.070% 99.900% ( 2900, 4400 ] 8 0.080% 99.980% ( 4400, 6600 ] 2 0.020% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 769.3400 StdDev: 964.35 Min: 75 Median: 241.1111 Max: 3933 Percentiles: P50: 241.11 P75: 1115.71 P99: 3933.00 P99.9: 3933.00 P99.99: 3933.00 ------------------------------------------------------ ( 51, 76 ] 1 1.000% 1.000% ( 76, 110 ] 14 14.000% 15.000% ### ( 110, 170 ] 27 27.000% 42.000% ##### ( 170, 250 ] 9 9.000% 51.000% ## ( 250, 380 ] 7 7.000% 58.000% # ( 380, 580 ] 6 6.000% 64.000% # ( 580, 870 ] 7 7.000% 71.000% # ( 870, 1300 ] 7 7.000% 78.000% # ( 1300, 1900 ] 5 5.000% 83.000% # ( 1900, 2900 ] 12 12.000% 95.000% ## ( 2900, 4400 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 26.7 total, 3.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 257.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.054 H:M:S, 30.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.501 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-04:29:42 ... thread 0: (1000000,8000000) ops and (260410.2,263080.0) ops/second in (3.840096,30.409001) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.05 GB 144.8 6.8 0.0 6.8 14.3 7.6 0.0 1.9 143.3 303.3 48.37 45.11 132 0.366 7035K 9020 0.0 0.0 L1 20/20 1.70 GB 0.0 3.6 3.3 0.2 3.5 3.3 0.2 1.1 230.1 227.9 15.83 15.20 3 5.276 3698K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.8 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 24/0 959.21 MB 1.0 3.3 1.6 1.7 3.2 1.6 0.3 2.0 215.6 214.9 15.46 13.97 12 1.288 3385K 12K 0.0 0.0 L4 181/0 9.54 GB 1.0 0.9 0.8 0.0 0.9 0.8 0.8 1.0 160.4 160.2 5.49 4.19 14 0.392 893K 1243 0.0 0.0 L5 1064/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/30 103.65 GB 0.0 14.6 5.9 8.8 22.1 13.4 4.7 2.9 174.3 263.9 85.89 79.19 162 0.530 15M 56K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 5.9 8.8 22.1 13.4 4.6 2.9 174.3 263.9 85.89 79.19 162 0.530 15M 56K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 5.9 8.8 14.6 5.8 0.0 0.0 235.7 234.8 63.52 59.57 53 1.199 15M 56K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 346.5 22.36 19.62 109 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.6 total, 30.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.13 GB write, 741.08 MB/s write, 14.62 GB read, 489.60 MB/s read, 85.9 seconds Interval compaction: 22.13 GB write, 745.32 MB/s write, 14.62 GB read, 492.41 MB/s read, 85.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 27, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2953760 Average: 2.2519 StdDev: 12.07 Min: 0 Median: 1.4710 Max: 4016 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 11.92 P99.99: 130.84 ------------------------------------------------------ [ 0, 1 ] 567071 19.198% 19.198% #### ( 1, 2 ] 1931522 65.392% 84.590% ############# ( 2, 3 ] 243718 8.251% 92.841% ## ( 3, 4 ] 111270 3.767% 96.608% # ( 4, 6 ] 77094 2.610% 99.218% # ( 6, 10 ] 19118 0.647% 99.866% ( 10, 15 ] 2638 0.089% 99.955% ( 15, 22 ] 383 0.013% 99.968% ( 22, 34 ] 38 0.001% 99.969% ( 34, 51 ] 15 0.001% 99.970% ( 51, 76 ] 20 0.001% 99.970% ( 76, 110 ] 397 0.013% 99.984% ( 110, 170 ] 520 0.018% 100.001% ( 170, 250 ] 235 0.008% 100.009% ( 250, 380 ] 159 0.005% 100.015% ( 380, 580 ] 122 0.004% 100.019% ( 580, 870 ] 80 0.003% 100.022% ( 870, 1300 ] 30 0.001% 100.023% ( 1300, 1900 ] 13 0.000% 100.023% ( 1900, 2900 ] 13 0.000% 100.024% ( 2900, 4400 ] 16 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 533810 Average: 3.2103 StdDev: 30.66 Min: 1 Median: 1.6584 Max: 6638 Percentiles: P50: 1.66 P75: 2.29 P99: 8.64 P99.9: 95.22 P99.99: 243.14 ------------------------------------------------------ [ 0, 1 ] 51733 9.691% 9.691% ## ( 1, 2 ] 326809 61.222% 70.913% ############ ( 2, 3 ] 74068 13.875% 84.789% ### ( 3, 4 ] 35611 6.671% 91.460% # ( 4, 6 ] 34514 6.466% 97.925% # ( 6, 10 ] 8684 1.627% 99.552% ( 10, 15 ] 1530 0.287% 99.839% ( 15, 22 ] 190 0.036% 99.874% ( 22, 34 ] 10 0.002% 99.876% ( 34, 51 ] 6 0.001% 99.877% ( 51, 76 ] 7 0.001% 99.879% ( 76, 110 ] 202 0.038% 99.916% ( 110, 170 ] 250 0.047% 99.963% ( 170, 250 ] 156 0.029% 99.993% ( 250, 380 ] 113 0.021% 100.014% ( 380, 580 ] 107 0.020% 100.034% ( 580, 870 ] 68 0.013% 100.046% ( 870, 1300 ] 33 0.006% 100.053% ( 1300, 1900 ] 15 0.003% 100.055% ( 1900, 2900 ] 15 0.003% 100.058% ( 2900, 4400 ] 12 0.002% 100.061% ( 4400, 6600 ] 1 0.000% 100.061% ( 6600, 9900 ] 1 0.000% 100.061% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 570413 Average: 3.7227 StdDev: 34.13 Min: 0 Median: 1.7569 Max: 4939 Percentiles: P50: 1.76 P75: 2.66 P99: 9.11 P99.9: 124.13 P99.99: 230.14 ------------------------------------------------------ [ 0, 1 ] 42685 7.483% 7.483% # ( 1, 2 ] 320400 56.170% 63.653% ########### ( 2, 3 ] 98769 17.315% 80.968% ### ( 3, 4 ] 47046 8.248% 89.216% ## ( 4, 6 ] 47283 8.289% 97.505% ## ( 6, 10 ] 10949 1.919% 99.425% ( 10, 15 ] 2006 0.352% 99.776% ( 15, 22 ] 277 0.049% 99.825% ( 22, 34 ] 46 0.008% 99.833% ( 34, 51 ] 10 0.002% 99.835% ( 51, 76 ] 6 0.001% 99.836% ( 76, 110 ] 270 0.047% 99.883% ( 110, 170 ] 406 0.071% 99.954% ( 170, 250 ] 270 0.047% 100.002% ( 250, 380 ] 219 0.038% 100.040% ( 380, 580 ] 194 0.034% 100.074% ( 580, 870 ] 127 0.022% 100.096% ( 870, 1300 ] 43 0.008% 100.104% ( 1300, 1900 ] 22 0.004% 100.108% ( 1900, 2900 ] 22 0.004% 100.112% ( 2900, 4400 ] 18 0.003% 100.115% ( 4400, 6600 ] 1 0.000% 100.115% ** Level 4 read latency histogram (micros): Count: 9954 Average: 43.2873 StdDev: 192.16 Min: 1 Median: 1.9806 Max: 4871 Percentiles: P50: 1.98 P75: 3.47 P99: 823.82 P99.9: 2908.63 P99.99: 4871.00 ------------------------------------------------------ [ 0, 1 ] 477 4.792% 4.792% # ( 1, 2 ] 4589 46.102% 50.894% ######### ( 2, 3 ] 1913 19.218% 70.113% #### ( 3, 4 ] 1043 10.478% 80.591% ## ( 4, 6 ] 734 7.374% 87.965% # ( 6, 10 ] 217 2.180% 90.145% ( 10, 15 ] 74 0.743% 90.888% ( 15, 22 ] 13 0.131% 91.019% ( 76, 110 ] 51 0.512% 91.531% ( 110, 170 ] 148 1.487% 93.018% ( 170, 250 ] 140 1.406% 94.424% ( 250, 380 ] 152 1.527% 95.951% ( 380, 580 ] 195 1.959% 97.910% ( 580, 870 ] 129 1.296% 99.206% ( 870, 1300 ] 51 0.512% 99.719% ( 1300, 1900 ] 11 0.111% 99.829% ( 1900, 2900 ] 7 0.070% 99.900% ( 2900, 4400 ] 8 0.080% 99.980% ( 4400, 6600 ] 2 0.020% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 769.3400 StdDev: 964.35 Min: 75 Median: 241.1111 Max: 3933 Percentiles: P50: 241.11 P75: 1115.71 P99: 3933.00 P99.9: 3933.00 P99.99: 3933.00 ------------------------------------------------------ ( 51, 76 ] 1 1.000% 1.000% ( 76, 110 ] 14 14.000% 15.000% ### ( 110, 170 ] 27 27.000% 42.000% ##### ( 170, 250 ] 9 9.000% 51.000% ## ( 250, 380 ] 7 7.000% 58.000% # ( 380, 580 ] 6 6.000% 64.000% # ( 580, 870 ] 7 7.000% 71.000% # ( 870, 1300 ] 7 7.000% 78.000% # ( 1300, 1900 ] 5 5.000% 83.000% # ( 1900, 2900 ] 12 12.000% 95.000% ## ( 2900, 4400 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 30.6 total, 3.8 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 257.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.242 H:M:S, 30.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.188 H:M:S, 30.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/24-04:30:03 ... thread 0: (1000000,9000000) ops and (46812.3,173842.8) ops/second in (21.361905,51.770906) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 2.33 GB 0.0 8.7 0.0 8.7 17.1 8.5 0.0 2.0 148.9 294.3 59.64 54.68 149 0.400 9017K 18K 0.0 0.0 L1 11/11 1.28 GB 0.0 7.9 6.0 1.9 7.8 5.8 0.2 1.3 230.7 227.4 35.05 33.42 4 8.764 7847K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.7 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 22/3 1.22 GB 1.0 8.1 4.5 3.7 8.1 4.4 0.4 1.8 165.8 164.9 50.12 36.67 32 1.566 8440K 44K 0.0 0.0 L4 180/5 9.56 GB 1.0 3.6 3.5 0.1 3.6 3.5 0.9 1.0 141.3 141.0 26.11 17.07 44 0.593 3663K 1687 0.0 0.0 L5 1096/0 90.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1320/30 104.45 GB 0.0 28.5 14.0 14.4 36.8 22.3 10.5 4.3 169.8 219.4 171.68 142.57 230 0.746 29M 99K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.5 14.0 14.4 36.8 22.3 10.4 4.3 169.8 219.4 171.68 142.57 230 0.746 29M 99K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.5 14.0 14.4 28.3 13.8 0.0 0.0 200.3 199.1 145.53 120.52 107 1.360 29M 99K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 332.5 26.15 22.06 123 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 51.9 total, 51.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.78 GB write, 725.07 MB/s write, 28.47 GB read, 561.24 MB/s read, 171.7 seconds Interval compaction: 36.78 GB write, 727.51 MB/s write, 28.47 GB read, 563.13 MB/s read, 171.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 39, pending-compaction-bytes-stops: 0, total-delays: 58, total-stops: 37, interval: 95 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4211144 Average: 2.6770 StdDev: 30.49 Min: 0 Median: 1.4892 Max: 9713 Percentiles: P50: 1.49 P75: 1.88 P99: 6.90 P99.9: 98.12 P99.99: 287.11 ------------------------------------------------------ [ 0, 1 ] 784923 18.639% 18.639% #### ( 1, 2 ] 2699678 64.108% 82.747% ############# ( 2, 3 ] 371457 8.821% 91.568% ## ( 3, 4 ] 167652 3.981% 95.549% # ( 4, 6 ] 136844 3.250% 98.799% # ( 6, 10 ] 37809 0.898% 99.696% ( 10, 15 ] 6201 0.147% 99.844% ( 15, 22 ] 734 0.017% 99.861% ( 22, 34 ] 64 0.002% 99.863% ( 34, 51 ] 31 0.001% 99.863% ( 51, 76 ] 57 0.001% 99.865% ( 76, 110 ] 2285 0.054% 99.919% ( 110, 170 ] 2209 0.052% 99.972% ( 170, 250 ] 651 0.015% 99.987% ( 250, 380 ] 462 0.011% 99.998% ( 380, 580 ] 373 0.009% 100.007% ( 580, 870 ] 236 0.006% 100.012% ( 870, 1300 ] 136 0.003% 100.016% ( 1300, 1900 ] 73 0.002% 100.017% ( 1900, 2900 ] 96 0.002% 100.020% ( 2900, 4400 ] 97 0.002% 100.022% ( 4400, 6600 ] 27 0.001% 100.023% ( 6600, 9900 ] 11 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1683261 Average: 4.7637 StdDev: 71.28 Min: 1 Median: 1.7081 Max: 10214 Percentiles: P50: 1.71 P75: 2.61 P99: 9.34 P99.9: 106.41 P99.99: 341.85 ------------------------------------------------------ [ 0, 1 ] 184606 10.967% 10.967% ## ( 1, 2 ] 927847 55.122% 66.089% ########### ( 2, 3 ] 244280 14.512% 80.601% ### ( 3, 4 ] 134930 8.016% 88.617% ## ( 4, 6 ] 145849 8.665% 97.282% ## ( 6, 10 ] 34659 2.059% 99.341% ( 10, 15 ] 7464 0.443% 99.785% ( 15, 22 ] 772 0.046% 99.830% ( 22, 34 ] 52 0.003% 99.834% ( 34, 51 ] 14 0.001% 99.834% ( 51, 76 ] 189 0.011% 99.846% ( 76, 110 ] 1024 0.061% 99.906% ( 110, 170 ] 809 0.048% 99.954% ( 170, 250 ] 320 0.019% 99.974% ( 250, 380 ] 393 0.023% 99.997% ( 380, 580 ] 486 0.029% 100.026% ( 580, 870 ] 522 0.031% 100.057% ( 870, 1300 ] 406 0.024% 100.081% ( 1300, 1900 ] 200 0.012% 100.093% ( 1900, 2900 ] 209 0.012% 100.105% ( 2900, 4400 ] 235 0.014% 100.119% ( 4400, 6600 ] 69 0.004% 100.123% ( 6600, 9900 ] 18 0.001% 100.124% ( 9900, 14000 ] 1 0.000% 100.124% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1775000 Average: 5.6818 StdDev: 80.60 Min: 0 Median: 1.9077 Max: 11006 Percentiles: P50: 1.91 P75: 3.05 P99: 9.41 P99.9: 23.87 P99.99: 248.39 ------------------------------------------------------ [ 0, 1 ] 67601 3.809% 3.809% # ( 1, 2 ] 903281 50.889% 54.698% ########## ( 2, 3 ] 350944 19.771% 74.469% #### ( 3, 4 ] 193524 10.903% 85.372% ## ( 4, 6 ] 208197 11.729% 97.101% ## ( 6, 10 ] 39493 2.225% 99.326% ( 10, 15 ] 9110 0.513% 99.839% ( 15, 22 ] 1056 0.059% 99.899% ( 22, 34 ] 122 0.007% 99.906% ( 34, 51 ] 39 0.002% 99.908% ( 51, 76 ] 39 0.002% 99.910% ( 76, 110 ] 336 0.019% 99.929% ( 110, 170 ] 568 0.032% 99.961% ( 170, 250 ] 523 0.029% 99.991% ( 250, 380 ] 619 0.035% 100.025% ( 380, 580 ] 758 0.043% 100.068% ( 580, 870 ] 786 0.044% 100.112% ( 870, 1300 ] 554 0.031% 100.144% ( 1300, 1900 ] 302 0.017% 100.161% ( 1900, 2900 ] 302 0.017% 100.178% ( 2900, 4400 ] 335 0.019% 100.197% ( 4400, 6600 ] 77 0.004% 100.201% ( 6600, 9900 ] 23 0.001% 100.202% ( 9900, 14000 ] 1 0.000% 100.202% ** Level 4 read latency histogram (micros): Count: 33863 Average: 91.2191 StdDev: 418.47 Min: 1 Median: 2.1232 Max: 9899 Percentiles: P50: 2.12 P75: 3.60 P99: 2330.87 P99.9: 4639.51 P99.99: 6403.95 ------------------------------------------------------ [ 0, 1 ] 1148 3.390% 3.390% # ( 1, 2 ] 14918 44.054% 47.444% ######### ( 2, 3 ] 7026 20.748% 68.192% #### ( 3, 4 ] 3872 11.434% 79.627% ## ( 4, 6 ] 2726 8.050% 87.677% ## ( 6, 10 ] 736 2.173% 89.850% ( 10, 15 ] 259 0.765% 90.615% ( 15, 22 ] 28 0.083% 90.698% ( 22, 34 ] 8 0.024% 90.721% ( 34, 51 ] 1 0.003% 90.724% ( 76, 110 ] 75 0.221% 90.946% ( 110, 170 ] 252 0.744% 91.690% ( 170, 250 ] 285 0.842% 92.532% ( 250, 380 ] 379 1.119% 93.651% ( 380, 580 ] 541 1.598% 95.249% ( 580, 870 ] 565 1.668% 96.917% ( 870, 1300 ] 403 1.190% 98.107% ( 1300, 1900 ] 233 0.688% 98.795% ( 1900, 2900 ] 161 0.475% 99.271% ( 2900, 4400 ] 209 0.617% 99.888% ( 4400, 6600 ] 38 0.112% 100.000% ( 6600, 9900 ] 3 0.009% 100.009% ** Level 5 read latency histogram (micros): Count: 260 Average: 1542.6923 StdDev: 1671.70 Min: 75 Median: 797.5000 Max: 8672 Percentiles: P50: 797.50 P75: 2480.65 P99: 7040.00 P99.9: 8672.00 P99.99: 8672.00 ------------------------------------------------------ ( 51, 76 ] 1 0.385% 0.385% ( 76, 110 ] 15 5.769% 6.154% # ( 110, 170 ] 32 12.308% 18.462% ## ( 170, 250 ] 12 4.615% 23.077% # ( 250, 380 ] 23 8.846% 31.923% ## ( 380, 580 ] 26 10.000% 41.923% ## ( 580, 870 ] 28 10.769% 52.692% ## ( 870, 1300 ] 22 8.462% 61.154% ## ( 1300, 1900 ] 18 6.923% 68.077% # ( 1900, 2900 ] 31 11.923% 80.000% ## ( 2900, 4400 ] 32 12.308% 92.308% ## ( 4400, 6600 ] 17 6.538% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 51.9 total, 21.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 170.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.059 H:M:S, 52.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 46.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:17.817 H:M:S, 83.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/07/24-04:30:07 ... thread 0: (1000000,10000000) ops and (298309.6,181412.1) ops/second in (3.352222,55.123128) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/7 3.37 GB 138.4 9.8 0.0 9.8 19.4 9.5 0.0 2.0 149.5 294.1 67.40 61.92 167 0.404 10M 19K 0.0 0.0 L1 11/11 1.28 GB 0.0 7.9 6.0 1.9 7.8 5.8 0.2 1.3 230.7 227.4 35.05 33.42 4 8.764 7847K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.7 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 19/0 960.92 MB 1.0 8.1 4.5 3.7 8.1 4.4 0.4 1.8 165.8 164.9 50.12 36.67 32 1.566 8440K 44K 0.0 0.0 L4 178/0 9.54 GB 1.0 3.9 3.8 0.1 3.9 3.8 0.9 1.0 144.0 143.7 27.74 18.43 47 0.590 3969K 2131 0.0 0.0 L5 1100/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1321/18 105.49 GB 0.0 29.9 14.3 15.6 39.3 23.7 10.8 4.1 169.3 222.2 181.06 151.17 251 0.721 30M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.9 14.3 15.6 39.3 23.7 10.7 4.1 169.3 222.2 181.06 151.17 251 0.721 30M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.9 14.3 15.6 29.8 14.1 0.0 0.0 202.0 200.8 151.78 126.39 114 1.331 30M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 333.5 29.28 24.78 137 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.3 total, 55.1 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 39.29 GB write, 727.59 MB/s write, 29.94 GB read, 554.37 MB/s read, 181.1 seconds Interval compaction: 39.29 GB write, 729.89 MB/s write, 29.94 GB read, 556.12 MB/s read, 181.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 39, pending-compaction-bytes-stops: 0, total-delays: 58, total-stops: 47, interval: 105 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4581095 Average: 2.6555 StdDev: 29.46 Min: 0 Median: 1.4955 Max: 9713 Percentiles: P50: 1.50 P75: 1.89 P99: 6.84 P99.9: 92.21 P99.99: 257.12 ------------------------------------------------------ [ 0, 1 ] 833611 18.197% 18.197% #### ( 1, 2 ] 2940125 64.180% 82.376% ############# ( 2, 3 ] 413818 9.033% 91.409% ## ( 3, 4 ] 186508 4.071% 95.481% # ( 4, 6 ] 152569 3.330% 98.811% # ( 6, 10 ] 41203 0.899% 99.711% ( 10, 15 ] 6656 0.145% 99.856% ( 15, 22 ] 767 0.017% 99.873% ( 22, 34 ] 69 0.002% 99.874% ( 34, 51 ] 33 0.001% 99.875% ( 51, 76 ] 60 0.001% 99.876% ( 76, 110 ] 2298 0.050% 99.926% ( 110, 170 ] 2228 0.049% 99.975% ( 170, 250 ] 667 0.015% 99.989% ( 250, 380 ] 473 0.010% 100.000% ( 380, 580 ] 378 0.008% 100.008% ( 580, 870 ] 244 0.005% 100.013% ( 870, 1300 ] 143 0.003% 100.016% ( 1300, 1900 ] 78 0.002% 100.018% ( 1900, 2900 ] 99 0.002% 100.020% ( 2900, 4400 ] 99 0.002% 100.023% ( 4400, 6600 ] 27 0.001% 100.023% ( 6600, 9900 ] 11 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1781337 Average: 4.6464 StdDev: 69.34 Min: 1 Median: 1.6972 Max: 10214 Percentiles: P50: 1.70 P75: 2.56 P99: 9.29 P99.9: 107.65 P99.99: 346.14 ------------------------------------------------------ [ 0, 1 ] 195622 10.982% 10.982% ## ( 1, 2 ] 996947 55.966% 66.948% ########### ( 2, 3 ] 253914 14.254% 81.202% ### ( 3, 4 ] 138655 7.784% 88.986% ## ( 4, 6 ] 148508 8.337% 97.323% ## ( 6, 10 ] 36292 2.037% 99.360% ( 10, 15 ] 7568 0.425% 99.785% ( 15, 22 ] 779 0.044% 99.829% ( 22, 34 ] 52 0.003% 99.832% ( 34, 51 ] 14 0.001% 99.832% ( 51, 76 ] 192 0.011% 99.843% ( 76, 110 ] 1088 0.061% 99.904% ( 110, 170 ] 879 0.049% 99.954% ( 170, 250 ] 339 0.019% 99.973% ( 250, 380 ] 419 0.024% 99.996% ( 380, 580 ] 496 0.028% 100.024% ( 580, 870 ] 527 0.030% 100.054% ( 870, 1300 ] 407 0.023% 100.076% ( 1300, 1900 ] 200 0.011% 100.088% ( 1900, 2900 ] 209 0.012% 100.099% ( 2900, 4400 ] 235 0.013% 100.113% ( 4400, 6600 ] 69 0.004% 100.116% ( 6600, 9900 ] 18 0.001% 100.117% ( 9900, 14000 ] 1 0.000% 100.117% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1847476 Average: 5.5723 StdDev: 79.04 Min: 0 Median: 1.9058 Max: 11006 Percentiles: P50: 1.91 P75: 3.04 P99: 9.37 P99.9: 21.19 P99.99: 235.71 ------------------------------------------------------ [ 0, 1 ] 69084 3.739% 3.739% # ( 1, 2 ] 943493 51.069% 54.809% ########## ( 2, 3 ] 365662 19.793% 74.601% #### ( 3, 4 ] 200776 10.868% 85.469% ## ( 4, 6 ] 216010 11.692% 97.161% ## ( 6, 10 ] 40386 2.186% 99.347% ( 10, 15 ] 9272 0.502% 99.849% ( 15, 22 ] 1070 0.058% 99.907% ( 22, 34 ] 124 0.007% 99.913% ( 34, 51 ] 39 0.002% 99.916% ( 51, 76 ] 40 0.002% 99.918% ( 76, 110 ] 336 0.018% 99.936% ( 110, 170 ] 568 0.031% 99.967% ( 170, 250 ] 525 0.028% 99.995% ( 250, 380 ] 619 0.034% 100.029% ( 380, 580 ] 759 0.041% 100.070% ( 580, 870 ] 787 0.043% 100.112% ( 870, 1300 ] 554 0.030% 100.142% ( 1300, 1900 ] 302 0.016% 100.159% ( 1900, 2900 ] 302 0.016% 100.175% ( 2900, 4400 ] 336 0.018% 100.193% ( 4400, 6600 ] 77 0.004% 100.197% ( 6600, 9900 ] 23 0.001% 100.199% ( 9900, 14000 ] 1 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 36869 Average: 87.5951 StdDev: 408.28 Min: 1 Median: 2.1098 Max: 9899 Percentiles: P50: 2.11 P75: 3.56 P99: 2248.35 P99.9: 4465.48 P99.99: 6386.55 ------------------------------------------------------ [ 0, 1 ] 1254 3.401% 3.401% # ( 1, 2 ] 16336 44.308% 47.709% ######### ( 2, 3 ] 7691 20.860% 68.570% #### ( 3, 4 ] 4206 11.408% 79.978% ## ( 4, 6 ] 2949 7.999% 87.976% ## ( 6, 10 ] 809 2.194% 90.171% ( 10, 15 ] 271 0.735% 90.906% ( 15, 22 ] 29 0.079% 90.984% ( 22, 34 ] 9 0.024% 91.009% ( 34, 51 ] 1 0.003% 91.011% ( 76, 110 ] 81 0.220% 91.231% ( 110, 170 ] 273 0.740% 91.972% ( 170, 250 ] 313 0.849% 92.821% ( 250, 380 ] 401 1.088% 93.908% ( 380, 580 ] 567 1.538% 95.446% ( 580, 870 ] 593 1.608% 97.054% ( 870, 1300 ] 414 1.123% 98.177% ( 1300, 1900 ] 242 0.656% 98.834% ( 1900, 2900 ] 176 0.477% 99.311% ( 2900, 4400 ] 216 0.586% 99.897% ( 4400, 6600 ] 38 0.103% 100.000% ( 6600, 9900 ] 3 0.008% 100.008% ** Level 5 read latency histogram (micros): Count: 280 Average: 1480.7786 StdDev: 1645.10 Min: 75 Median: 750.0000 Max: 8672 Percentiles: P50: 750.00 P75: 2351.61 P99: 6820.00 P99.9: 8672.00 P99.99: 8672.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 18 6.429% 6.786% # ( 110, 170 ] 39 13.929% 20.714% ### ( 170, 250 ] 13 4.643% 25.357% # ( 250, 380 ] 25 8.929% 34.286% ## ( 380, 580 ] 27 9.643% 43.929% ## ( 580, 870 ] 29 10.357% 54.286% ## ( 870, 1300 ] 22 7.857% 62.143% ## ( 1300, 1900 ] 22 7.857% 70.000% ## ( 1900, 2900 ] 31 11.071% 81.071% ## ( 2900, 4400 ] 33 11.786% 92.857% ## ( 4400, 6600 ] 17 6.071% 98.929% # ( 6600, 9900 ] 3 1.071% 100.000% ** DB Stats ** Uptime(secs): 55.3 total, 3.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 177.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.786 H:M:S, 50.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.727 H:M:S, 21.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-04:30:10 ... thread 0: (1000000,11000000) ops and (325235.8,189010.5) ops/second in (3.074692,58.197820) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/7 4.29 GB 232.8 10.7 0.0 10.7 21.1 10.4 0.0 2.0 149.2 294.7 73.46 67.60 183 0.401 11M 20K 0.0 0.0 L1 11/11 1.28 GB 0.0 7.9 6.0 1.9 7.8 5.8 0.2 1.3 230.7 227.4 35.05 33.42 4 8.764 7847K 34K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 4.7 1.5 253.2 253.1 0.75 0.72 1 0.746 191K 100 0.0 0.0 L3 19/0 960.92 MB 1.0 8.1 4.5 3.7 8.1 4.4 0.4 1.8 165.8 164.9 50.12 36.67 32 1.566 8440K 44K 0.0 0.0 L4 178/0 9.54 GB 1.0 3.9 3.8 0.1 3.9 3.8 0.9 1.0 144.0 143.7 27.74 18.43 47 0.590 3969K 2131 0.0 0.0 L5 1100/0 90.37 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1325/18 106.41 GB 0.0 30.8 14.3 16.5 41.1 24.6 10.8 3.9 168.5 224.8 187.11 156.85 267 0.701 31M 101K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.8 14.3 16.5 41.1 24.6 10.7 3.9 168.5 224.8 187.11 156.85 267 0.701 31M 101K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.8 14.3 16.5 30.6 14.1 0.0 0.0 203.4 202.2 155.08 129.63 117 1.326 31M 101K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 334.4 32.03 27.22 150 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.4 total, 58.2 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 41.07 GB write, 720.54 MB/s write, 30.80 GB read, 540.28 MB/s read, 187.1 seconds Interval compaction: 41.07 GB write, 722.70 MB/s write, 30.80 GB read, 541.89 MB/s read, 187.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 39, pending-compaction-bytes-stops: 0, total-delays: 58, total-stops: 52, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4864523 Average: 2.6330 StdDev: 28.77 Min: 0 Median: 1.4957 Max: 9713 Percentiles: P50: 1.50 P75: 1.88 P99: 6.72 P99.9: 88.73 P99.99: 248.10 ------------------------------------------------------ [ 0, 1 ] 879564 18.081% 18.081% #### ( 1, 2 ] 3132583 64.397% 82.478% ############# ( 2, 3 ] 439583 9.037% 91.514% ## ( 3, 4 ] 197180 4.053% 95.568% # ( 4, 6 ] 159297 3.275% 98.842% # ( 6, 10 ] 42746 0.879% 99.721% ( 10, 15 ] 6885 0.142% 99.863% ( 15, 22 ] 787 0.016% 99.879% ( 22, 34 ] 74 0.002% 99.880% ( 34, 51 ] 36 0.001% 99.881% ( 51, 76 ] 63 0.001% 99.882% ( 76, 110 ] 2300 0.047% 99.930% ( 110, 170 ] 2265 0.047% 99.976% ( 170, 250 ] 691 0.014% 99.990% ( 250, 380 ] 487 0.010% 100.000% ( 380, 580 ] 392 0.008% 100.008% ( 580, 870 ] 252 0.005% 100.014% ( 870, 1300 ] 147 0.003% 100.017% ( 1300, 1900 ] 79 0.002% 100.018% ( 1900, 2900 ] 100 0.002% 100.020% ( 2900, 4400 ] 101 0.002% 100.022% ( 4400, 6600 ] 27 0.001% 100.023% ( 6600, 9900 ] 11 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1918073 Average: 4.5103 StdDev: 66.96 Min: 1 Median: 1.6829 Max: 10214 Percentiles: P50: 1.68 P75: 2.50 P99: 9.25 P99.9: 113.24 P99.99: 355.32 ------------------------------------------------------ [ 0, 1 ] 212626 11.085% 11.085% ## ( 1, 2 ] 1092994 56.984% 68.069% ########### ( 2, 3 ] 266491 13.894% 81.963% ### ( 3, 4 ] 143632 7.488% 89.451% # ( 4, 6 ] 151803 7.914% 97.366% ## ( 6, 10 ] 38635 2.014% 99.380% ( 10, 15 ] 7718 0.402% 99.782% ( 15, 22 ] 787 0.041% 99.823% ( 22, 34 ] 57 0.003% 99.826% ( 34, 51 ] 14 0.001% 99.827% ( 51, 76 ] 194 0.010% 99.837% ( 76, 110 ] 1149 0.060% 99.897% ( 110, 170 ] 1035 0.054% 99.951% ( 170, 250 ] 381 0.020% 99.971% ( 250, 380 ] 452 0.024% 99.995% ( 380, 580 ] 522 0.027% 100.022% ( 580, 870 ] 534 0.028% 100.050% ( 870, 1300 ] 410 0.021% 100.071% ( 1300, 1900 ] 200 0.010% 100.081% ( 1900, 2900 ] 209 0.011% 100.092% ( 2900, 4400 ] 236 0.012% 100.105% ( 4400, 6600 ] 69 0.004% 100.108% ( 6600, 9900 ] 18 0.001% 100.109% ( 9900, 14000 ] 1 0.000% 100.109% ** Level 2 read latency histogram (micros): Count: 47959 Average: 2.1385 StdDev: 5.67 Min: 0 Median: 1.4656 Max: 1107 Percentiles: P50: 1.47 P75: 1.85 P99: 5.83 P99.9: 10.96 P99.99: 29.22 ------------------------------------------------------ [ 0, 1 ] 9552 19.917% 19.917% #### ( 1, 2 ] 30985 64.607% 84.524% ############# ( 2, 3 ] 3889 8.109% 92.633% ## ( 3, 4 ] 1807 3.768% 96.401% # ( 4, 6 ] 1365 2.846% 99.247% # ( 6, 10 ] 305 0.636% 99.883% ( 10, 15 ] 42 0.088% 99.971% ( 15, 22 ] 8 0.017% 99.987% ( 22, 34 ] 2 0.004% 99.992% ( 170, 250 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1847476 Average: 5.5723 StdDev: 79.04 Min: 0 Median: 1.9058 Max: 11006 Percentiles: P50: 1.91 P75: 3.04 P99: 9.37 P99.9: 21.19 P99.99: 235.71 ------------------------------------------------------ [ 0, 1 ] 69084 3.739% 3.739% # ( 1, 2 ] 943493 51.069% 54.809% ########## ( 2, 3 ] 365662 19.793% 74.601% #### ( 3, 4 ] 200776 10.868% 85.469% ## ( 4, 6 ] 216010 11.692% 97.161% ## ( 6, 10 ] 40386 2.186% 99.347% ( 10, 15 ] 9272 0.502% 99.849% ( 15, 22 ] 1070 0.058% 99.907% ( 22, 34 ] 124 0.007% 99.913% ( 34, 51 ] 39 0.002% 99.916% ( 51, 76 ] 40 0.002% 99.918% ( 76, 110 ] 336 0.018% 99.936% ( 110, 170 ] 568 0.031% 99.967% ( 170, 250 ] 525 0.028% 99.995% ( 250, 380 ] 619 0.034% 100.029% ( 380, 580 ] 759 0.041% 100.070% ( 580, 870 ] 787 0.043% 100.112% ( 870, 1300 ] 554 0.030% 100.142% ( 1300, 1900 ] 302 0.016% 100.159% ( 1900, 2900 ] 302 0.016% 100.175% ( 2900, 4400 ] 336 0.018% 100.193% ( 4400, 6600 ] 77 0.004% 100.197% ( 6600, 9900 ] 23 0.001% 100.199% ( 9900, 14000 ] 1 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 36869 Average: 87.5951 StdDev: 408.28 Min: 1 Median: 2.1098 Max: 9899 Percentiles: P50: 2.11 P75: 3.56 P99: 2248.35 P99.9: 4465.48 P99.99: 6386.55 ------------------------------------------------------ [ 0, 1 ] 1254 3.401% 3.401% # ( 1, 2 ] 16336 44.308% 47.709% ######### ( 2, 3 ] 7691 20.860% 68.570% #### ( 3, 4 ] 4206 11.408% 79.978% ## ( 4, 6 ] 2949 7.999% 87.976% ## ( 6, 10 ] 809 2.194% 90.171% ( 10, 15 ] 271 0.735% 90.906% ( 15, 22 ] 29 0.079% 90.984% ( 22, 34 ] 9 0.024% 91.009% ( 34, 51 ] 1 0.003% 91.011% ( 76, 110 ] 81 0.220% 91.231% ( 110, 170 ] 273 0.740% 91.972% ( 170, 250 ] 313 0.849% 92.821% ( 250, 380 ] 401 1.088% 93.908% ( 380, 580 ] 567 1.538% 95.446% ( 580, 870 ] 593 1.608% 97.054% ( 870, 1300 ] 414 1.123% 98.177% ( 1300, 1900 ] 242 0.656% 98.834% ( 1900, 2900 ] 176 0.477% 99.311% ( 2900, 4400 ] 216 0.586% 99.897% ( 4400, 6600 ] 38 0.103% 100.000% ( 6600, 9900 ] 3 0.008% 100.008% ** Level 5 read latency histogram (micros): Count: 280 Average: 1480.7786 StdDev: 1645.10 Min: 75 Median: 750.0000 Max: 8672 Percentiles: P50: 750.00 P75: 2351.61 P99: 6820.00 P99.9: 8672.00 P99.99: 8672.00 ------------------------------------------------------ ( 51, 76 ] 1 0.357% 0.357% ( 76, 110 ] 18 6.429% 6.786% # ( 110, 170 ] 39 13.929% 20.714% ### ( 170, 250 ] 13 4.643% 25.357% # ( 250, 380 ] 25 8.929% 34.286% ## ( 380, 580 ] 27 9.643% 43.929% ## ( 580, 870 ] 29 10.357% 54.286% ## ( 870, 1300 ] 22 7.857% 62.143% ## ( 1300, 1900 ] 22 7.857% 70.000% ## ( 1900, 2900 ] 31 11.071% 81.071% ## ( 2900, 4400 ] 33 11.786% 92.857% ## ( 4400, 6600 ] 17 6.071% 98.929% # ( 6600, 9900 ] 3 1.071% 100.000% ** DB Stats ** Uptime(secs): 58.4 total, 3.1 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 185.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.255 H:M:S, 48.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.469 H:M:S, 15.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.333 micros/op 187517 ops/sec 60.101 seconds 11269999 operations; 181.7 MB/s Microseconds per write: Count: 11269999 Average: 5.3328 StdDev: 323.15 Min: 0 Median: 1.7253 Max: 402495 Percentiles: P50: 1.73 P75: 2.69 P99: 8.63 P99.9: 1088.63 P99.99: 2642.08 ------------------------------------------------------ [ 0, 1 ] 1614781 14.328% 14.328% ### ( 1, 2 ] 5542989 49.184% 63.512% ########## ( 2, 3 ] 1882178 16.701% 80.213% ### ( 3, 4 ] 1490640 13.227% 93.439% ### ( 4, 6 ] 552974 4.907% 98.346% # ( 6, 10 ] 112199 0.996% 99.341% ( 10, 15 ] 32832 0.291% 99.633% ( 15, 22 ] 8151 0.072% 99.705% ( 22, 34 ] 2163 0.019% 99.724% ( 34, 51 ] 253 0.002% 99.726% ( 51, 76 ] 28 0.000% 99.727% ( 76, 110 ] 7590 0.067% 99.794% ( 110, 170 ] 3361 0.030% 99.824% ( 170, 250 ] 323 0.003% 99.827% ( 250, 380 ] 138 0.001% 99.828% ( 380, 580 ] 27 0.000% 99.828% ( 580, 870 ] 21 0.000% 99.828% ( 870, 1300 ] 15894 0.141% 99.969% ( 1300, 1900 ] 129 0.001% 99.970% ( 1900, 2900 ] 2966 0.026% 99.997% ( 2900, 4400 ] 237 0.002% 99.999% ( 4400, 6600 ] 77 0.001% 100.000% ( 6600, 9900 ] 16 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 170000, 250000 ] 19 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 216512 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11269999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11630638968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 624 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29416536 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36814039934 rocksdb.compact.write.bytes COUNT : 36604890302 rocksdb.flush.write.bytes COUNT : 11626044462 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 66 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 237 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11532384256 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4554752 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36921409915 rocksdb.non.last.level.read.count COUNT : 8921601 rocksdb.block.checksum.compute.count COUNT : 8920419 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.367126 P95 : 3.840747 P99 : 6.994434 P100 : 402493.000000 COUNT : 11269999 SUM : 54915314 rocksdb.compaction.times.micros P50 : 947297.297297 P95 : 3267500.000000 P99 : 13202000.000000 P100 : 19226724.000000 COUNT : 119 SUM : 156992166 rocksdb.compaction.times.cpu_micros P50 : 886444.444444 P95 : 2583333.333333 P99 : 13202000.000000 P100 : 18222816.000000 COUNT : 119 SUM : 131510827 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 703.172043 P95 : 1281.029412 P99 : 5390.000000 P100 : 12678.000000 COUNT : 155 SUM : 129444 rocksdb.compaction.outfile.sync.micros P50 : 1081.355932 P95 : 106500.000000 P99 : 162266.666667 P100 : 177944.000000 COUNT : 432 SUM : 6985896 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 101.386667 P95 : 1370.000000 P99 : 4377.500000 P100 : 5366.000000 COUNT : 306 SUM : 93332 rocksdb.table.open.io.micros P50 : 1375.000000 P95 : 8085.000000 P99 : 13608.923077 P100 : 22069.000000 COUNT : 624 SUM : 1359934 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.632450 P95 : 8.159928 P99 : 11.778949 P100 : 14587.000000 COUNT : 8918481 SUM : 54032039 rocksdb.read.block.get.micros P50 : 438.208955 P95 : 3664.062500 P99 : 5909.037037 P100 : 8764.000000 COUNT : 1248 SUM : 1104942 rocksdb.write.raw.block.micros P50 : 0.512548 P95 : 0.973840 P99 : 2.846868 P100 : 13243.000000 COUNT : 11681197 SUM : 22407814 rocksdb.numfiles.in.singlecompaction P50 : 2.730769 P95 : 4.100000 P99 : 14.050000 P100 : 30.000000 COUNT : 157 SUM : 531 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559384 P95 : 1143.436730 P99 : 2376.749654 P100 : 402305.000000 COUNT : 181924 SUM : 29433266 rocksdb.sst.read.micros P50 : 1.607670 P95 : 4.993850 P99 : 8.710702 P100 : 11006.000000 COUNT : 8921657 SUM : 36091034 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11269999 SUM : 11630638968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212882.882883 P95 : 362976.190476 P99 : 511100.000000 P100 : 524140.000000 COUNT : 155 SUM : 33107957 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 407 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0