[2024-12-14 00:48:16.130735] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-14 00:48:16.130877] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1993291 ] Set seed to 1734133696127272 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 00:48:16.234761] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 00:48:16.432229] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 00:48:16.432272] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1993291' to capture a snapshot of events at runtime. [2024-12-14 00:48:16.432283] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1993291 for offline analysis/debug. [2024-12-14 00:48:16.432311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 00:48:25 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-00:48:28 ... thread 0: (1000000,1000000) ops and (336510.9,336510.9) ops/second in (2.971672,2.971672) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.98 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.1 2.50 2.26 12 0.209 0 0 0.0 0.0 L1 3/3 251.72 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 258.3 258.0 0.98 0.94 1 0.976 255K 212 0.0 0.0 L2 1/0 49.00 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 19/1 1007.27 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 204.2 204.2 0.31 0.25 1 0.305 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1187/9 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 100.4 308.3 4.24 3.88 15 0.283 432K 240 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 100.4 308.3 4.24 3.88 15 0.283 432K 240 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 245.3 245.1 1.74 1.62 3 0.579 432K 240 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.1 2.50 2.26 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 406.46 MB/s write, 0.42 GB read, 132.35 MB/s read, 4.2 seconds Interval compaction: 1.28 GB write, 439.74 MB/s write, 0.42 GB read, 143.19 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 106174 Average: 1.8949 StdDev: 15.64 Min: 1 Median: 1.2459 Max: 2696 Percentiles: P50: 1.25 P75: 1.66 P99: 3.78 P99.9: 9.80 P99.99: 323.29 ------------------------------------------------------ [ 0, 1 ] 37364 35.191% 35.191% ####### ( 1, 2 ] 63947 60.228% 95.420% ############ ( 2, 3 ] 2872 2.705% 98.125% # ( 3, 4 ] 1199 1.129% 99.254% ( 4, 6 ] 513 0.483% 99.737% ( 6, 10 ] 186 0.175% 99.912% ( 10, 15 ] 63 0.059% 99.972% ( 15, 22 ] 7 0.007% 99.978% ( 22, 34 ] 2 0.002% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 110, 170 ] 3 0.003% 99.985% ( 170, 250 ] 6 0.006% 99.991% ( 250, 380 ] 6 0.006% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ( 1300, 1900 ] 2 0.002% 100.002% ( 1900, 2900 ] 3 0.003% 100.005% ** Level 1 read latency histogram (micros): Count: 20954 Average: 1.9415 StdDev: 8.82 Min: 1 Median: 1.3271 Max: 950 Percentiles: P50: 1.33 P75: 1.72 P99: 4.35 P99.9: 9.19 P99.99: 570.46 ------------------------------------------------------ [ 0, 1 ] 6123 29.221% 29.221% ###### ( 1, 2 ] 13314 63.539% 92.760% ############# ( 2, 3 ] 980 4.677% 97.437% # ( 3, 4 ] 299 1.427% 98.864% ( 4, 6 ] 181 0.864% 99.728% ( 6, 10 ] 49 0.234% 99.962% ( 10, 15 ] 6 0.029% 99.990% ( 15, 22 ] 1 0.005% 99.995% ( 380, 580 ] 2 0.010% 100.005% ( 580, 870 ] 1 0.005% 100.010% ( 870, 1300 ] 1 0.005% 100.014% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4147 StdDev: 36.00 Min: 1 Median: 1.2291 Max: 4188 Percentiles: P50: 1.23 P75: 1.66 P99: 6.94 P99.9: 86.95 P99.99: 1125.12 ------------------------------------------------------ [ 0, 1 ] 10298 36.603% 36.603% ####### ( 1, 2 ] 16453 58.481% 95.084% ############ ( 2, 3 ] 681 2.421% 97.505% ( 3, 4 ] 250 0.889% 98.393% ( 4, 6 ] 126 0.448% 98.841% ( 6, 10 ] 190 0.675% 99.517% ( 10, 15 ] 53 0.188% 99.705% ( 15, 22 ] 7 0.025% 99.730% ( 34, 51 ] 2 0.007% 99.737% ( 51, 76 ] 42 0.149% 99.886% ( 76, 110 ] 12 0.043% 99.929% ( 110, 170 ] 1 0.004% 99.932% ( 170, 250 ] 7 0.025% 99.957% ( 250, 380 ] 6 0.021% 99.979% ( 580, 870 ] 2 0.007% 99.986% ( 870, 1300 ] 2 0.007% 99.993% ( 2900, 4400 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 8524 Average: 23.4532 StdDev: 291.87 Min: 1 Median: 2.4991 Max: 7175 Percentiles: P50: 2.50 P75: 3.32 P99: 13.82 P99.9: 5164.72 P99.99: 7175.00 ------------------------------------------------------ [ 0, 1 ] 213 2.499% 2.499% ( 1, 2 ] 2424 28.437% 30.936% ###### ( 2, 3 ] 3256 38.198% 69.134% ######## ( 3, 4 ] 1571 18.430% 87.565% #### ( 4, 6 ] 674 7.907% 95.472% ## ( 6, 10 ] 258 3.027% 98.498% # ( 10, 15 ] 56 0.657% 99.155% ( 15, 22 ] 9 0.106% 99.261% ( 22, 34 ] 2 0.023% 99.284% ( 34, 51 ] 1 0.012% 99.296% ( 51, 76 ] 1 0.012% 99.308% ( 110, 170 ] 1 0.012% 99.320% ( 170, 250 ] 4 0.047% 99.366% ( 250, 380 ] 4 0.047% 99.413% ( 380, 580 ] 4 0.047% 99.460% ( 580, 870 ] 1 0.012% 99.472% ( 870, 1300 ] 2 0.023% 99.496% ( 1300, 1900 ] 6 0.070% 99.566% ( 1900, 2900 ] 4 0.047% 99.613% ( 2900, 4400 ] 21 0.246% 99.859% ( 4400, 6600 ] 10 0.117% 99.977% ( 6600, 9900 ] 2 0.023% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 3824.5500 StdDev: 1836.07 Min: 1256 Median: 3462.5000 Max: 7799 Percentiles: P50: 3462.50 P75: 4400.00 P99: 7799.00 P99.9: 7799.00 P99.99: 7799.00 ------------------------------------------------------ ( 870, 1300 ] 1 5.000% 5.000% # ( 1300, 1900 ] 1 5.000% 10.000% # ( 1900, 2900 ] 5 25.000% 35.000% ##### ( 2900, 4400 ] 8 40.000% 75.000% ######## ( 4400, 6600 ] 3 15.000% 90.000% ### ( 6600, 9900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 305.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.395 H:M:S, 12.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.395 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-00:48:31 ... thread 0: (1000000,2000000) ops and (328489.0,332451.6) ops/second in (3.044242,6.015914) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.23 GB 0.0 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.7 327.8 7.49 6.91 28 0.268 575K 612 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.2 245.8 3.33 3.24 2 1.663 831K 1436 0.0 0.0 L2 1/0 49.00 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.5 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 15/0 773.28 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.4 1.0 220.6 220.6 0.88 0.78 2 0.438 196K 6 0.0 0.0 L4 173/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 64.1 64.2 0.87 0.54 1 0.875 56K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/13 97.98 GB 0.0 1.7 0.8 0.9 3.5 2.6 2.4 1.9 134.1 279.0 13.02 11.90 34 0.383 1773K 2082 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.8 0.9 3.5 2.6 2.4 1.9 134.1 279.0 13.02 11.90 34 0.383 1773K 2082 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.8 0.9 1.7 0.8 0.0 0.0 228.7 228.4 7.64 7.06 8 0.954 1773K 2082 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.8 5.39 4.83 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.55 GB write, 580.43 MB/s write, 1.71 GB read, 278.92 MB/s read, 13.0 seconds Interval compaction: 3.55 GB write, 603.91 MB/s write, 1.71 GB read, 290.20 MB/s read, 13.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 352119 Average: 2.1037 StdDev: 13.09 Min: 1 Median: 1.4191 Max: 3490 Percentiles: P50: 1.42 P75: 1.80 P99: 5.42 P99.9: 9.95 P99.99: 14.70 ------------------------------------------------------ [ 0, 1 ] 80181 22.771% 22.771% ##### ( 1, 2 ] 228794 64.976% 87.747% ############# ( 2, 3 ] 25782 7.322% 95.069% # ( 3, 4 ] 9242 2.625% 97.694% # ( 4, 6 ] 6460 1.835% 99.529% ( 6, 10 ] 1325 0.376% 99.905% ( 10, 15 ] 319 0.091% 99.995% ( 15, 22 ] 27 0.008% 100.003% ( 22, 34 ] 3 0.001% 100.004% ( 34, 51 ] 3 0.001% 100.005% ( 51, 76 ] 3 0.001% 100.006% ( 110, 170 ] 8 0.002% 100.008% ( 170, 250 ] 13 0.004% 100.012% ( 250, 380 ] 10 0.003% 100.014% ( 380, 580 ] 3 0.001% 100.015% ( 580, 870 ] 3 0.001% 100.016% ( 870, 1300 ] 9 0.003% 100.019% ( 1300, 1900 ] 4 0.001% 100.020% ( 1900, 2900 ] 5 0.001% 100.021% ( 2900, 4400 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 96643 Average: 2.1203 StdDev: 10.52 Min: 1 Median: 1.4433 Max: 1859 Percentiles: P50: 1.44 P75: 1.82 P99: 5.43 P99.9: 9.57 P99.99: 358.41 ------------------------------------------------------ [ 0, 1 ] 20046 20.742% 20.742% #### ( 1, 2 ] 63791 66.007% 86.749% ############# ( 2, 3 ] 7733 8.002% 94.751% ## ( 3, 4 ] 2712 2.806% 97.557% # ( 4, 6 ] 1957 2.025% 99.582% ( 6, 10 ] 344 0.356% 99.938% ( 10, 15 ] 35 0.036% 99.974% ( 15, 22 ] 9 0.009% 99.983% ( 22, 34 ] 1 0.001% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 110, 170 ] 1 0.001% 99.987% ( 250, 380 ] 4 0.004% 99.991% ( 380, 580 ] 3 0.003% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4147 StdDev: 36.00 Min: 1 Median: 1.2291 Max: 4188 Percentiles: P50: 1.23 P75: 1.66 P99: 6.94 P99.9: 86.95 P99.99: 1125.12 ------------------------------------------------------ [ 0, 1 ] 10298 36.603% 36.603% ####### ( 1, 2 ] 16453 58.481% 95.084% ############ ( 2, 3 ] 681 2.421% 97.505% ( 3, 4 ] 250 0.889% 98.393% ( 4, 6 ] 126 0.448% 98.841% ( 6, 10 ] 190 0.675% 99.517% ( 10, 15 ] 53 0.188% 99.705% ( 15, 22 ] 7 0.025% 99.730% ( 34, 51 ] 2 0.007% 99.737% ( 51, 76 ] 42 0.149% 99.886% ( 76, 110 ] 12 0.043% 99.929% ( 110, 170 ] 1 0.004% 99.932% ( 170, 250 ] 7 0.025% 99.957% ( 250, 380 ] 6 0.021% 99.979% ( 580, 870 ] 2 0.007% 99.986% ( 870, 1300 ] 2 0.007% 99.993% ( 2900, 4400 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 14843 Average: 15.2363 StdDev: 221.46 Min: 1 Median: 2.7135 Max: 7175 Percentiles: P50: 2.71 P75: 3.63 P99: 13.03 P99.9: 4196.93 P99.99: 7175.00 ------------------------------------------------------ [ 0, 1 ] 448 3.018% 3.018% # ( 1, 2 ] 3095 20.852% 23.870% #### ( 2, 3 ] 5436 36.623% 60.493% ####### ( 3, 4 ] 3401 22.913% 83.406% ##### ( 4, 6 ] 1487 10.018% 93.425% ## ( 6, 10 ] 750 5.053% 98.477% # ( 10, 15 ] 128 0.862% 99.340% ( 15, 22 ] 28 0.189% 99.528% ( 22, 34 ] 5 0.034% 99.562% ( 34, 51 ] 1 0.007% 99.569% ( 51, 76 ] 1 0.007% 99.576% ( 110, 170 ] 1 0.007% 99.582% ( 170, 250 ] 6 0.040% 99.623% ( 250, 380 ] 5 0.034% 99.656% ( 380, 580 ] 5 0.034% 99.690% ( 580, 870 ] 1 0.007% 99.697% ( 870, 1300 ] 2 0.013% 99.710% ( 1300, 1900 ] 6 0.040% 99.751% ( 1900, 2900 ] 4 0.027% 99.778% ( 2900, 4400 ] 21 0.141% 99.919% ( 4400, 6600 ] 10 0.067% 99.987% ( 6600, 9900 ] 2 0.013% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 255.6426 StdDev: 1056.15 Min: 1 Median: 2.5330 Max: 7799 Percentiles: P50: 2.53 P75: 3.50 P99: 5830.00 P99.9: 7799.00 P99.99: 7799.00 ------------------------------------------------------ [ 0, 1 ] 6 1.967% 1.967% ( 1, 2 ] 90 29.508% 31.475% ###### ( 2, 3 ] 106 34.754% 66.230% ####### ( 3, 4 ] 54 17.705% 83.934% #### ( 4, 6 ] 19 6.230% 90.164% # ( 6, 10 ] 4 1.311% 91.475% ( 10, 15 ] 4 1.311% 92.787% ( 170, 250 ] 1 0.328% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 870, 1300 ] 1 0.328% 93.770% ( 1300, 1900 ] 1 0.328% 94.098% ( 1900, 2900 ] 5 1.639% 95.738% ( 2900, 4400 ] 8 2.623% 98.361% # ( 4400, 6600 ] 3 0.984% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 768.0000 StdDev: 981.12 Min: 82 Median: 282.5000 Max: 3782 Percentiles: P50: 282.50 P75: 1085.00 P99: 3782.00 P99.9: 3782.00 P99.99: 3782.00 ------------------------------------------------------ ( 76, 110 ] 13 32.500% 32.500% ####### ( 110, 170 ] 4 10.000% 42.500% ## ( 170, 250 ] 2 5.000% 47.500% # ( 250, 380 ] 4 10.000% 57.500% ## ( 380, 580 ] 1 2.500% 60.000% # ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 5 12.500% 95.000% ### ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.3 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 314.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.825 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-00:48:34 ... thread 0: (1000000,3000000) ops and (328953.2,331277.2) ops/second in (3.039946,9.055860) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 2.15 GB 94.4 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.7 318.7 13.24 12.30 44 0.301 1407K 1475 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.2 245.8 3.33 3.24 2 1.663 831K 1436 0.0 0.0 L2 1/0 49.00 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.5 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 15/0 773.28 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.4 1.0 220.6 220.6 0.88 0.78 2 0.438 196K 6 0.0 0.0 L4 173/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 64.1 64.2 0.87 0.54 1 0.875 56K 0 0.0 0.0 L5 1048/0 86.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/13 98.90 GB 0.0 2.5 0.8 1.7 5.3 3.6 2.4 1.9 136.7 287.6 18.77 17.29 50 0.375 2604K 2945 0.0 0.0 Int 0/0 0.00 KB 0.0 2.5 0.8 1.7 5.3 3.6 2.4 1.9 136.7 287.6 18.77 17.29 50 0.375 2604K 2945 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.5 0.8 1.7 2.5 0.8 0.0 0.0 240.7 240.4 10.66 10.03 11 0.969 2604K 2945 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 349.6 8.11 7.26 39 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.27 GB write, 580.27 MB/s write, 2.51 GB read, 275.81 MB/s read, 18.8 seconds Interval compaction: 5.27 GB write, 595.87 MB/s write, 2.51 GB read, 283.22 MB/s read, 18.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 742983 Average: 2.1557 StdDev: 12.32 Min: 1 Median: 1.4744 Max: 5238 Percentiles: P50: 1.47 P75: 1.85 P99: 5.48 P99.9: 9.82 P99.99: 14.10 ------------------------------------------------------ [ 0, 1 ] 134759 18.138% 18.138% #### ( 1, 2 ] 498967 67.157% 85.295% ############# ( 2, 3 ] 68261 9.187% 94.482% ## ( 3, 4 ] 22000 2.961% 97.443% # ( 4, 6 ] 15620 2.102% 99.546% ( 6, 10 ] 2757 0.371% 99.917% ( 10, 15 ] 665 0.090% 100.006% ( 15, 22 ] 45 0.006% 100.012% ( 22, 34 ] 11 0.001% 100.014% ( 34, 51 ] 4 0.001% 100.014% ( 51, 76 ] 5 0.001% 100.015% ( 110, 170 ] 13 0.002% 100.017% ( 170, 250 ] 18 0.002% 100.019% ( 250, 380 ] 12 0.002% 100.021% ( 380, 580 ] 11 0.001% 100.022% ( 580, 870 ] 8 0.001% 100.023% ( 870, 1300 ] 12 0.002% 100.025% ( 1300, 1900 ] 5 0.001% 100.026% ( 1900, 2900 ] 7 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 100919 Average: 2.1153 StdDev: 10.29 Min: 1 Median: 1.4433 Max: 1859 Percentiles: P50: 1.44 P75: 1.82 P99: 5.42 P99.9: 9.58 P99.99: 344.51 ------------------------------------------------------ [ 0, 1 ] 20877 20.687% 20.687% #### ( 1, 2 ] 66729 66.121% 86.808% ############# ( 2, 3 ] 8065 7.992% 94.800% ## ( 3, 4 ] 2797 2.772% 97.571% # ( 4, 6 ] 2030 2.012% 99.583% ( 6, 10 ] 358 0.355% 99.938% ( 10, 15 ] 38 0.038% 99.975% ( 15, 22 ] 9 0.009% 99.984% ( 22, 34 ] 1 0.001% 99.985% ( 34, 51 ] 1 0.001% 99.986% ( 110, 170 ] 1 0.001% 99.987% ( 250, 380 ] 4 0.004% 99.991% ( 380, 580 ] 3 0.003% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28134 Average: 2.4147 StdDev: 36.00 Min: 1 Median: 1.2291 Max: 4188 Percentiles: P50: 1.23 P75: 1.66 P99: 6.94 P99.9: 86.95 P99.99: 1125.12 ------------------------------------------------------ [ 0, 1 ] 10298 36.603% 36.603% ####### ( 1, 2 ] 16453 58.481% 95.084% ############ ( 2, 3 ] 681 2.421% 97.505% ( 3, 4 ] 250 0.889% 98.393% ( 4, 6 ] 126 0.448% 98.841% ( 6, 10 ] 190 0.675% 99.517% ( 10, 15 ] 53 0.188% 99.705% ( 15, 22 ] 7 0.025% 99.730% ( 34, 51 ] 2 0.007% 99.737% ( 51, 76 ] 42 0.149% 99.886% ( 76, 110 ] 12 0.043% 99.929% ( 110, 170 ] 1 0.004% 99.932% ( 170, 250 ] 7 0.025% 99.957% ( 250, 380 ] 6 0.021% 99.979% ( 580, 870 ] 2 0.007% 99.986% ( 870, 1300 ] 2 0.007% 99.993% ( 2900, 4400 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 14843 Average: 15.2363 StdDev: 221.46 Min: 1 Median: 2.7135 Max: 7175 Percentiles: P50: 2.71 P75: 3.63 P99: 13.03 P99.9: 4196.93 P99.99: 7175.00 ------------------------------------------------------ [ 0, 1 ] 448 3.018% 3.018% # ( 1, 2 ] 3095 20.852% 23.870% #### ( 2, 3 ] 5436 36.623% 60.493% ####### ( 3, 4 ] 3401 22.913% 83.406% ##### ( 4, 6 ] 1487 10.018% 93.425% ## ( 6, 10 ] 750 5.053% 98.477% # ( 10, 15 ] 128 0.862% 99.340% ( 15, 22 ] 28 0.189% 99.528% ( 22, 34 ] 5 0.034% 99.562% ( 34, 51 ] 1 0.007% 99.569% ( 51, 76 ] 1 0.007% 99.576% ( 110, 170 ] 1 0.007% 99.582% ( 170, 250 ] 6 0.040% 99.623% ( 250, 380 ] 5 0.034% 99.656% ( 380, 580 ] 5 0.034% 99.690% ( 580, 870 ] 1 0.007% 99.697% ( 870, 1300 ] 2 0.013% 99.710% ( 1300, 1900 ] 6 0.040% 99.751% ( 1900, 2900 ] 4 0.027% 99.778% ( 2900, 4400 ] 21 0.141% 99.919% ( 4400, 6600 ] 10 0.067% 99.987% ( 6600, 9900 ] 2 0.013% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 255.6426 StdDev: 1056.15 Min: 1 Median: 2.5330 Max: 7799 Percentiles: P50: 2.53 P75: 3.50 P99: 5830.00 P99.9: 7799.00 P99.99: 7799.00 ------------------------------------------------------ [ 0, 1 ] 6 1.967% 1.967% ( 1, 2 ] 90 29.508% 31.475% ###### ( 2, 3 ] 106 34.754% 66.230% ####### ( 3, 4 ] 54 17.705% 83.934% #### ( 4, 6 ] 19 6.230% 90.164% # ( 6, 10 ] 4 1.311% 91.475% ( 10, 15 ] 4 1.311% 92.787% ( 170, 250 ] 1 0.328% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 870, 1300 ] 1 0.328% 93.770% ( 1300, 1900 ] 1 0.328% 94.098% ( 1900, 2900 ] 5 1.639% 95.738% ( 2900, 4400 ] 8 2.623% 98.361% # ( 4400, 6600 ] 3 0.984% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 768.0000 StdDev: 981.12 Min: 82 Median: 282.5000 Max: 3782 Percentiles: P50: 282.50 P75: 1085.00 P99: 3782.00 P99.9: 3782.00 P99.99: 3782.00 ------------------------------------------------------ ( 76, 110 ] 13 32.500% 32.500% ####### ( 110, 170 ] 4 10.000% 42.500% ## ( 170, 250 ] 2 5.000% 47.500% # ( 250, 380 ] 4 10.000% 57.500% ## ( 380, 580 ] 1 2.500% 60.000% # ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 2 5.000% 77.500% # ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 5 12.500% 95.000% ### ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.3 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 317.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.245 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.420 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-00:48:37 ... thread 0: (1000000,4000000) ops and (318388.7,327958.2) ops/second in (3.140815,12.196675) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.15 GB 18.9 1.9 0.0 1.9 5.6 3.7 0.0 1.5 107.2 314.7 18.21 16.89 59 0.309 1982K 2095 0.0 0.0 L1 5/5 475.21 MB 0.0 1.8 1.4 0.4 1.8 1.4 0.1 1.2 239.1 238.4 7.58 7.37 3 2.528 1841K 5643 0.0 0.0 L2 1/1 128.77 MB 0.0 0.1 0.1 0.0 0.1 0.1 1.0 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 25/2 1.01 GB 0.8 1.2 0.6 0.6 1.2 0.6 0.4 2.0 215.7 215.3 5.89 5.50 6 0.981 1289K 2367 0.0 0.0 L4 171/0 9.51 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 64.1 64.2 0.87 0.54 1 0.875 56K 0 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/21 99.82 GB 0.0 5.1 2.1 2.9 8.8 5.8 3.3 2.4 157.6 271.8 33.01 30.73 70 0.472 5283K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 2.1 2.9 8.8 5.8 3.3 2.4 157.6 271.8 33.01 30.73 70 0.472 5283K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 2.1 2.9 5.1 2.1 0.0 0.0 235.0 234.6 22.14 21.05 18 1.230 5283K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 347.6 10.87 9.68 52 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.76 GB write, 721.19 MB/s write, 5.08 GB read, 418.22 MB/s read, 33.0 seconds Interval compaction: 8.76 GB write, 735.58 MB/s write, 5.08 GB read, 426.57 MB/s read, 33.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1029940 Average: 2.3033 StdDev: 12.54 Min: 1 Median: 1.5278 Max: 5238 Percentiles: P50: 1.53 P75: 1.91 P99: 5.83 P99.9: 11.79 P99.99: 14.98 ------------------------------------------------------ [ 0, 1 ] 159360 15.473% 15.473% ### ( 1, 2 ] 673779 65.419% 80.892% ############# ( 2, 3 ] 115785 11.242% 92.134% ## ( 3, 4 ] 39615 3.846% 95.980% # ( 4, 6 ] 34077 3.309% 99.289% # ( 6, 10 ] 5775 0.561% 99.850% ( 10, 15 ] 1456 0.141% 99.991% ( 15, 22 ] 123 0.012% 100.003% ( 22, 34 ] 18 0.002% 100.005% ( 34, 51 ] 6 0.001% 100.005% ( 51, 76 ] 5 0.000% 100.006% ( 76, 110 ] 6 0.001% 100.006% ( 110, 170 ] 48 0.005% 100.011% ( 170, 250 ] 43 0.004% 100.015% ( 250, 380 ] 31 0.003% 100.018% ( 380, 580 ] 27 0.003% 100.021% ( 580, 870 ] 24 0.002% 100.023% ( 870, 1300 ] 16 0.002% 100.025% ( 1300, 1900 ] 7 0.001% 100.025% ( 1900, 2900 ] 10 0.001% 100.026% ( 2900, 4400 ] 2 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 329931 Average: 2.7319 StdDev: 13.43 Min: 1 Median: 1.6667 Max: 3038 Percentiles: P50: 1.67 P75: 2.28 P99: 7.96 P99.9: 14.80 P99.99: 235.21 ------------------------------------------------------ [ 0, 1 ] 30384 9.209% 9.209% ## ( 1, 2 ] 201849 61.179% 70.388% ############ ( 2, 3 ] 54047 16.381% 86.770% ### ( 3, 4 ] 19386 5.876% 92.645% # ( 4, 6 ] 18982 5.753% 98.399% # ( 6, 10 ] 4055 1.229% 99.628% ( 10, 15 ] 936 0.284% 99.911% ( 15, 22 ] 113 0.034% 99.946% ( 22, 34 ] 9 0.003% 99.948% ( 34, 51 ] 2 0.001% 99.949% ( 51, 76 ] 2 0.001% 99.950% ( 76, 110 ] 29 0.009% 99.958% ( 110, 170 ] 82 0.025% 99.983% ( 170, 250 ] 27 0.008% 99.992% ( 250, 380 ] 38 0.012% 100.003% ( 380, 580 ] 32 0.010% 100.013% ( 580, 870 ] 16 0.005% 100.018% ( 870, 1300 ] 11 0.003% 100.021% ( 1300, 1900 ] 6 0.002% 100.023% ( 2900, 4400 ] 1 0.000% 100.023% ** Level 2 read latency histogram (micros): Count: 40578 Average: 2.5662 StdDev: 30.91 Min: 1 Median: 1.3989 Max: 4188 Percentiles: P50: 1.40 P75: 1.82 P99: 8.55 P99.9: 72.08 P99.99: 1072.57 ------------------------------------------------------ [ 0, 1 ] 10713 26.401% 26.401% ##### ( 1, 2 ] 24005 59.158% 85.559% ############ ( 2, 3 ] 3069 7.563% 93.122% ## ( 3, 4 ] 1071 2.639% 95.761% # ( 4, 6 ] 984 2.425% 98.186% ( 6, 10 ] 518 1.277% 99.463% ( 10, 15 ] 125 0.308% 99.771% ( 15, 22 ] 13 0.032% 99.803% ( 22, 34 ] 1 0.002% 99.805% ( 34, 51 ] 3 0.007% 99.813% ( 51, 76 ] 42 0.104% 99.916% ( 76, 110 ] 12 0.030% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 7 0.017% 99.965% ( 250, 380 ] 6 0.015% 99.980% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 2 0.005% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 127178 Average: 4.7706 StdDev: 77.75 Min: 1 Median: 1.8663 Max: 7175 Percentiles: P50: 1.87 P75: 2.79 P99: 9.57 P99.9: 310.97 P99.99: 4134.44 ------------------------------------------------------ [ 0, 1 ] 4386 3.449% 3.449% # ( 1, 2 ] 68342 53.737% 57.186% ########### ( 2, 3 ] 28703 22.569% 79.755% ##### ( 3, 4 ] 11944 9.392% 89.147% ## ( 4, 6 ] 9982 7.849% 96.996% ## ( 6, 10 ] 2858 2.247% 99.243% ( 10, 15 ] 556 0.437% 99.680% ( 15, 22 ] 79 0.062% 99.742% ( 22, 34 ] 11 0.009% 99.751% ( 34, 51 ] 2 0.002% 99.752% ( 51, 76 ] 1 0.001% 99.753% ( 76, 110 ] 40 0.031% 99.785% ( 110, 170 ] 81 0.064% 99.848% ( 170, 250 ] 48 0.038% 99.886% ( 250, 380 ] 38 0.030% 99.916% ( 380, 580 ] 33 0.026% 99.942% ( 580, 870 ] 23 0.018% 99.960% ( 870, 1300 ] 8 0.006% 99.966% ( 1300, 1900 ] 8 0.006% 99.972% ( 1900, 2900 ] 5 0.004% 99.976% ( 2900, 4400 ] 21 0.017% 99.993% ( 4400, 6600 ] 10 0.008% 100.001% ( 6600, 9900 ] 2 0.002% 100.002% ** Level 4 read latency histogram (micros): Count: 305 Average: 255.6426 StdDev: 1056.15 Min: 1 Median: 2.5330 Max: 7799 Percentiles: P50: 2.53 P75: 3.50 P99: 5830.00 P99.9: 7799.00 P99.99: 7799.00 ------------------------------------------------------ [ 0, 1 ] 6 1.967% 1.967% ( 1, 2 ] 90 29.508% 31.475% ###### ( 2, 3 ] 106 34.754% 66.230% ####### ( 3, 4 ] 54 17.705% 83.934% #### ( 4, 6 ] 19 6.230% 90.164% # ( 6, 10 ] 4 1.311% 91.475% ( 10, 15 ] 4 1.311% 92.787% ( 170, 250 ] 1 0.328% 93.115% ( 250, 380 ] 1 0.328% 93.443% ( 870, 1300 ] 1 0.328% 93.770% ( 1300, 1900 ] 1 0.328% 94.098% ( 1900, 2900 ] 5 1.639% 95.738% ( 2900, 4400 ] 8 2.623% 98.361% # ( 4400, 6600 ] 3 0.984% 99.344% ( 6600, 9900 ] 2 0.656% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 829.6667 StdDev: 1028.12 Min: 82 Median: 293.3333 Max: 3881 Percentiles: P50: 293.33 P75: 1300.00 P99: 3881.00 P99.9: 3881.00 P99.99: 3881.00 ------------------------------------------------------ ( 76, 110 ] 16 26.667% 26.667% ##### ( 110, 170 ] 8 13.333% 40.000% ### ( 170, 250 ] 4 6.667% 46.667% # ( 250, 380 ] 6 10.000% 56.667% ## ( 380, 580 ] 2 3.333% 60.000% # ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 4 6.667% 81.667% # ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 316.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.694 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.449 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-00:48:40 ... thread 0: (1000000,5000000) ops and (270368.2,314557.7) ops/second in (3.698660,15.895335) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.20 GB 125.9 3.0 0.0 3.0 7.7 4.7 0.0 1.6 120.1 308.7 25.70 23.94 78 0.329 3134K 3376 0.0 0.0 L1 5/5 475.21 MB 0.0 1.8 1.4 0.4 1.8 1.4 0.1 1.2 239.1 238.4 7.58 7.37 3 2.528 1841K 5643 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.0 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 26/0 976.17 MB 1.0 1.5 0.7 0.8 1.5 0.7 0.4 2.1 215.9 215.5 7.34 6.87 7 1.049 1610K 3108 0.0 0.0 L4 171/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 124.2 124.2 2.01 1.45 5 0.402 249K 71 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/18 100.86 GB 0.0 6.7 2.4 4.2 11.4 7.2 3.3 2.4 158.9 271.2 43.09 40.06 94 0.458 6948K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.7 2.4 4.2 11.4 7.2 3.3 2.4 158.9 271.2 43.09 40.06 94 0.458 6948K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.7 2.4 4.2 6.7 2.4 0.0 0.0 235.2 234.8 29.11 27.62 27 1.078 6948K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 347.0 13.98 12.43 67 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.1 total, 15.9 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.41 GB write, 723.96 MB/s write, 6.69 GB read, 424.21 MB/s read, 43.1 seconds Interval compaction: 11.41 GB write, 735.05 MB/s write, 6.69 GB read, 430.71 MB/s read, 43.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 21, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1481003 Average: 2.3360 StdDev: 12.30 Min: 1 Median: 1.5362 Max: 5238 Percentiles: P50: 1.54 P75: 1.91 P99: 5.90 P99.9: 12.19 P99.99: 18.83 ------------------------------------------------------ [ 0, 1 ] 215399 14.544% 14.544% ### ( 1, 2 ] 979232 66.120% 80.664% ############# ( 2, 3 ] 170372 11.504% 92.167% ## ( 3, 4 ] 55898 3.774% 95.942% # ( 4, 6 ] 47754 3.224% 99.166% # ( 6, 10 ] 9905 0.669% 99.835% ( 10, 15 ] 2203 0.149% 99.984% ( 15, 22 ] 170 0.011% 99.995% ( 22, 34 ] 23 0.002% 99.997% ( 34, 51 ] 10 0.001% 99.998% ( 51, 76 ] 8 0.001% 99.998% ( 76, 110 ] 45 0.003% 100.001% ( 110, 170 ] 125 0.008% 100.010% ( 170, 250 ] 99 0.007% 100.016% ( 250, 380 ] 56 0.004% 100.020% ( 380, 580 ] 55 0.004% 100.024% ( 580, 870 ] 39 0.003% 100.026% ( 870, 1300 ] 23 0.002% 100.028% ( 1300, 1900 ] 10 0.001% 100.029% ( 1900, 2900 ] 12 0.001% 100.029% ( 2900, 4400 ] 3 0.000% 100.030% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 354909 Average: 2.7430 StdDev: 13.26 Min: 1 Median: 1.6640 Max: 3038 Percentiles: P50: 1.66 P75: 2.26 P99: 8.07 P99.9: 15.19 P99.99: 254.67 ------------------------------------------------------ [ 0, 1 ] 32328 9.109% 9.109% ## ( 1, 2 ] 218553 61.580% 70.689% ############ ( 2, 3 ] 57799 16.286% 86.974% ### ( 3, 4 ] 20371 5.740% 92.714% # ( 4, 6 ] 19974 5.628% 98.342% # ( 6, 10 ] 4523 1.274% 99.617% ( 10, 15 ] 1004 0.283% 99.899% ( 15, 22 ] 115 0.032% 99.932% ( 22, 34 ] 9 0.003% 99.934% ( 34, 51 ] 3 0.001% 99.935% ( 51, 76 ] 2 0.001% 99.936% ( 76, 110 ] 43 0.012% 99.948% ( 110, 170 ] 107 0.030% 99.978% ( 170, 250 ] 42 0.012% 99.990% ( 250, 380 ] 42 0.012% 100.002% ( 380, 580 ] 36 0.010% 100.012% ( 580, 870 ] 17 0.005% 100.017% ( 870, 1300 ] 11 0.003% 100.020% ( 1300, 1900 ] 6 0.002% 100.021% ( 2900, 4400 ] 1 0.000% 100.022% ** Level 2 read latency histogram (micros): Count: 40578 Average: 2.5662 StdDev: 30.91 Min: 1 Median: 1.3989 Max: 4188 Percentiles: P50: 1.40 P75: 1.82 P99: 8.55 P99.9: 72.08 P99.99: 1072.57 ------------------------------------------------------ [ 0, 1 ] 10713 26.401% 26.401% ##### ( 1, 2 ] 24005 59.158% 85.559% ############ ( 2, 3 ] 3069 7.563% 93.122% ## ( 3, 4 ] 1071 2.639% 95.761% # ( 4, 6 ] 984 2.425% 98.186% ( 6, 10 ] 518 1.277% 99.463% ( 10, 15 ] 125 0.308% 99.771% ( 15, 22 ] 13 0.032% 99.803% ( 22, 34 ] 1 0.002% 99.805% ( 34, 51 ] 3 0.007% 99.813% ( 51, 76 ] 42 0.104% 99.916% ( 76, 110 ] 12 0.030% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 7 0.017% 99.965% ( 250, 380 ] 6 0.015% 99.980% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 2 0.005% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 174148 Average: 4.3614 StdDev: 67.95 Min: 1 Median: 1.9085 Max: 7175 Percentiles: P50: 1.91 P75: 2.83 P99: 9.26 P99.9: 115.48 P99.99: 346.15 ------------------------------------------------------ [ 0, 1 ] 4999 2.871% 2.871% # ( 1, 2 ] 90337 51.874% 54.744% ########## ( 2, 3 ] 42753 24.550% 79.294% ##### ( 3, 4 ] 16099 9.244% 88.538% ## ( 4, 6 ] 15160 8.705% 97.244% ## ( 6, 10 ] 3753 2.155% 99.399% ( 10, 15 ] 718 0.412% 99.811% ( 15, 22 ] 92 0.053% 99.864% ( 22, 34 ] 11 0.006% 99.870% ( 34, 51 ] 3 0.002% 99.872% ( 51, 76 ] 1 0.001% 99.873% ( 76, 110 ] 40 0.023% 99.895% ( 110, 170 ] 86 0.049% 99.945% ( 170, 250 ] 49 0.028% 99.973% ( 250, 380 ] 40 0.023% 99.996% ( 380, 580 ] 36 0.021% 100.017% ( 580, 870 ] 25 0.014% 100.031% ( 870, 1300 ] 9 0.005% 100.036% ( 1300, 1900 ] 8 0.005% 100.041% ( 1900, 2900 ] 5 0.003% 100.044% ( 2900, 4400 ] 23 0.013% 100.057% ( 4400, 6600 ] 10 0.006% 100.063% ( 6600, 9900 ] 2 0.001% 100.064% ** Level 4 read latency histogram (micros): Count: 2268 Average: 108.1596 StdDev: 441.67 Min: 1 Median: 2.5102 Max: 7799 Percentiles: P50: 2.51 P75: 9.39 P99: 1818.40 P99.9: 6403.47 P99.99: 7799.00 ------------------------------------------------------ [ 0, 1 ] 55 2.425% 2.425% ( 1, 2 ] 830 36.596% 39.021% ####### ( 2, 3 ] 488 21.517% 60.538% #### ( 3, 4 ] 182 8.025% 68.563% ## ( 4, 6 ] 118 5.203% 73.765% # ( 6, 10 ] 33 1.455% 75.220% ( 10, 15 ] 16 0.705% 75.926% ( 15, 22 ] 2 0.088% 76.014% ( 51, 76 ] 10 0.441% 76.455% ( 76, 110 ] 36 1.587% 78.042% ( 110, 170 ] 142 6.261% 84.303% # ( 170, 250 ] 124 5.467% 89.771% # ( 250, 380 ] 86 3.792% 93.563% # ( 380, 580 ] 73 3.219% 96.781% # ( 580, 870 ] 36 1.587% 98.369% ( 870, 1300 ] 10 0.441% 98.810% ( 1300, 1900 ] 5 0.220% 99.030% ( 1900, 2900 ] 5 0.220% 99.250% ( 2900, 4400 ] 12 0.529% 99.780% ( 4400, 6600 ] 3 0.132% 99.912% ( 6600, 9900 ] 2 0.088% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 829.6667 StdDev: 1028.12 Min: 82 Median: 293.3333 Max: 3881 Percentiles: P50: 293.33 P75: 1300.00 P99: 3881.00 P99.9: 3881.00 P99.99: 3881.00 ------------------------------------------------------ ( 76, 110 ] 16 26.667% 26.667% ##### ( 110, 170 ] 8 13.333% 40.000% ### ( 170, 250 ] 4 6.667% 46.667% # ( 250, 380 ] 6 10.000% 56.667% ## ( 380, 580 ] 2 3.333% 60.000% # ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 4 6.667% 81.667% # ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 16.1 total, 3.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 304.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.795 H:M:S, 17.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 266.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.101 H:M:S, 29.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-00:48:46 ... thread 0: (1000000,6000000) ops and (178984.1,279298.1) ops/second in (5.587088,21.482423) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.34 GB 132.2 3.8 0.0 3.8 9.3 5.6 0.0 1.7 123.2 306.9 31.18 28.99 95 0.328 3901K 4141 0.0 0.0 L1 11/0 1.23 GB 125.7 4.0 3.1 0.8 3.9 3.1 0.1 1.3 231.0 229.4 17.53 16.92 4 4.383 4113K 27K 0.0 0.0 L2 8/4 957.75 MB 4.4 0.1 0.1 0.0 0.1 0.1 1.9 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 26/10 976.17 MB 0.5 1.5 0.7 0.8 1.5 0.7 0.4 2.1 215.9 215.5 7.34 6.87 7 1.049 1610K 3108 0.0 0.0 L4 171/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 124.2 124.2 2.01 1.45 5 0.402 249K 71 0.0 0.0 L5 1052/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/22 101.70 GB 0.0 9.6 4.2 5.4 15.2 9.7 4.3 2.7 168.1 265.5 58.52 54.67 112 0.523 9988K 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.6 4.2 5.4 15.2 9.7 4.3 2.7 168.1 265.5 58.52 54.67 112 0.523 9988K 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.6 4.2 5.4 9.6 4.1 0.0 0.0 235.1 234.2 41.86 39.94 31 1.350 9988K 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 344.1 16.66 14.73 81 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.7 total, 21.5 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.17 GB write, 715.09 MB/s write, 9.61 GB read, 452.90 MB/s read, 58.5 seconds Interval compaction: 15.17 GB write, 723.20 MB/s write, 9.61 GB read, 458.04 MB/s read, 58.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 22, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2003368 Average: 2.3421 StdDev: 11.70 Min: 0 Median: 1.5344 Max: 5238 Percentiles: P50: 1.53 P75: 1.91 P99: 5.94 P99.9: 12.62 P99.99: 95.54 ------------------------------------------------------ [ 0, 1 ] 291147 14.533% 14.533% ### ( 1, 2 ] 1329546 66.366% 80.898% ############# ( 2, 3 ] 226305 11.296% 92.195% ## ( 3, 4 ] 74638 3.726% 95.920% # ( 4, 6 ] 63715 3.180% 99.101% # ( 6, 10 ] 14456 0.722% 99.822% ( 10, 15 ] 2981 0.149% 99.971% ( 15, 22 ] 243 0.012% 99.983% ( 22, 34 ] 26 0.001% 99.984% ( 34, 51 ] 13 0.001% 99.985% ( 51, 76 ] 10 0.000% 99.986% ( 76, 110 ] 156 0.008% 99.993% ( 110, 170 ] 262 0.013% 100.006% ( 170, 250 ] 147 0.007% 100.014% ( 250, 380 ] 79 0.004% 100.018% ( 380, 580 ] 87 0.004% 100.022% ( 580, 870 ] 56 0.003% 100.025% ( 870, 1300 ] 23 0.001% 100.026% ( 1300, 1900 ] 11 0.001% 100.027% ( 1900, 2900 ] 15 0.001% 100.027% ( 2900, 4400 ] 4 0.000% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 542963 Average: 2.9801 StdDev: 23.22 Min: 1 Median: 1.6718 Max: 6519 Percentiles: P50: 1.67 P75: 2.30 P99: 8.45 P99.9: 21.69 P99.99: 266.60 ------------------------------------------------------ [ 0, 1 ] 48758 8.980% 8.980% ## ( 1, 2 ] 331552 61.063% 70.043% ############ ( 2, 3 ] 88436 16.288% 86.331% ### ( 3, 4 ] 31441 5.791% 92.122% # ( 4, 6 ] 32336 5.955% 98.077% # ( 6, 10 ] 8176 1.506% 99.583% ( 10, 15 ] 1553 0.286% 99.869% ( 15, 22 ] 178 0.033% 99.902% ( 22, 34 ] 14 0.003% 99.904% ( 34, 51 ] 3 0.001% 99.905% ( 51, 76 ] 3 0.001% 99.906% ( 76, 110 ] 163 0.030% 99.936% ( 110, 170 ] 190 0.035% 99.971% ( 170, 250 ] 98 0.018% 99.989% ( 250, 380 ] 76 0.014% 100.003% ( 380, 580 ] 77 0.014% 100.017% ( 580, 870 ] 41 0.008% 100.024% ( 870, 1300 ] 28 0.005% 100.029% ( 1300, 1900 ] 14 0.003% 100.032% ( 1900, 2900 ] 14 0.003% 100.035% ( 2900, 4400 ] 5 0.001% 100.036% ( 4400, 6600 ] 1 0.000% 100.036% ** Level 2 read latency histogram (micros): Count: 40578 Average: 2.5662 StdDev: 30.91 Min: 1 Median: 1.3989 Max: 4188 Percentiles: P50: 1.40 P75: 1.82 P99: 8.55 P99.9: 72.08 P99.99: 1072.57 ------------------------------------------------------ [ 0, 1 ] 10713 26.401% 26.401% ##### ( 1, 2 ] 24005 59.158% 85.559% ############ ( 2, 3 ] 3069 7.563% 93.122% ## ( 3, 4 ] 1071 2.639% 95.761% # ( 4, 6 ] 984 2.425% 98.186% ( 6, 10 ] 518 1.277% 99.463% ( 10, 15 ] 125 0.308% 99.771% ( 15, 22 ] 13 0.032% 99.803% ( 22, 34 ] 1 0.002% 99.805% ( 34, 51 ] 3 0.007% 99.813% ( 51, 76 ] 42 0.104% 99.916% ( 76, 110 ] 12 0.030% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 7 0.017% 99.965% ( 250, 380 ] 6 0.015% 99.980% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 2 0.005% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 226188 Average: 5.0928 StdDev: 70.69 Min: 1 Median: 1.9341 Max: 7451 Percentiles: P50: 1.93 P75: 2.88 P99: 9.76 P99.9: 279.90 P99.99: 531.90 ------------------------------------------------------ [ 0, 1 ] 5732 2.534% 2.534% # ( 1, 2 ] 114933 50.813% 53.347% ########## ( 2, 3 ] 55344 24.468% 77.815% ##### ( 3, 4 ] 21337 9.433% 87.249% ## ( 4, 6 ] 21547 9.526% 96.775% ## ( 6, 10 ] 5359 2.369% 99.144% ( 10, 15 ] 1150 0.508% 99.653% ( 15, 22 ] 142 0.063% 99.715% ( 22, 34 ] 19 0.008% 99.724% ( 34, 51 ] 3 0.001% 99.725% ( 51, 76 ] 1 0.000% 99.725% ( 76, 110 ] 51 0.023% 99.748% ( 110, 170 ] 149 0.066% 99.814% ( 170, 250 ] 162 0.072% 99.885% ( 250, 380 ] 147 0.065% 99.950% ( 380, 580 ] 119 0.053% 100.003% ( 580, 870 ] 65 0.029% 100.032% ( 870, 1300 ] 20 0.009% 100.041% ( 1300, 1900 ] 13 0.006% 100.046% ( 1900, 2900 ] 25 0.011% 100.057% ( 2900, 4400 ] 29 0.013% 100.070% ( 4400, 6600 ] 10 0.004% 100.075% ( 6600, 9900 ] 3 0.001% 100.076% ** Level 4 read latency histogram (micros): Count: 2268 Average: 108.1596 StdDev: 441.67 Min: 1 Median: 2.5102 Max: 7799 Percentiles: P50: 2.51 P75: 9.39 P99: 1818.40 P99.9: 6403.47 P99.99: 7799.00 ------------------------------------------------------ [ 0, 1 ] 55 2.425% 2.425% ( 1, 2 ] 830 36.596% 39.021% ####### ( 2, 3 ] 488 21.517% 60.538% #### ( 3, 4 ] 182 8.025% 68.563% ## ( 4, 6 ] 118 5.203% 73.765% # ( 6, 10 ] 33 1.455% 75.220% ( 10, 15 ] 16 0.705% 75.926% ( 15, 22 ] 2 0.088% 76.014% ( 51, 76 ] 10 0.441% 76.455% ( 76, 110 ] 36 1.587% 78.042% ( 110, 170 ] 142 6.261% 84.303% # ( 170, 250 ] 124 5.467% 89.771% # ( 250, 380 ] 86 3.792% 93.563% # ( 380, 580 ] 73 3.219% 96.781% # ( 580, 870 ] 36 1.587% 98.369% ( 870, 1300 ] 10 0.441% 98.810% ( 1300, 1900 ] 5 0.220% 99.030% ( 1900, 2900 ] 5 0.220% 99.250% ( 2900, 4400 ] 12 0.529% 99.780% ( 4400, 6600 ] 3 0.132% 99.912% ( 6600, 9900 ] 2 0.088% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 829.6667 StdDev: 1028.12 Min: 82 Median: 293.3333 Max: 3881 Percentiles: P50: 293.33 P75: 1300.00 P99: 3881.00 P99.9: 3881.00 P99.99: 3881.00 ------------------------------------------------------ ( 76, 110 ] 16 26.667% 26.667% ##### ( 110, 170 ] 8 13.333% 40.000% ### ( 170, 250 ] 4 6.667% 46.667% # ( 250, 380 ] 6 10.000% 56.667% ## ( 380, 580 ] 2 3.333% 60.000% # ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 4 6.667% 75.000% # ( 1300, 1900 ] 4 6.667% 81.667% # ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 21.7 total, 5.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 271.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.771 H:M:S, 26.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 176.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.976 H:M:S, 53.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/14-00:48:51 ... thread 0: (1000000,7000000) ops and (223035.5,269583.2) ops/second in (4.483591,25.966014) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.38 GB 56.7 5.1 0.0 5.1 11.7 6.6 0.0 1.8 127.6 293.4 40.98 37.27 111 0.369 5308K 7118 0.0 0.0 L1 11/11 1.23 GB 0.0 4.0 3.1 0.8 3.9 3.1 0.1 1.3 231.0 229.4 17.53 16.92 4 4.383 4113K 27K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.9 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 24/0 973.71 MB 1.0 3.5 1.7 1.9 3.5 1.7 0.4 2.1 198.5 197.7 18.20 16.22 15 1.214 3669K 14K 0.0 0.0 L4 177/0 9.57 GB 1.0 1.2 1.2 0.0 1.2 1.2 0.8 1.0 117.3 117.3 10.37 6.08 24 0.432 1226K 472 0.0 0.0 L5 1064/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/25 102.73 GB 0.0 13.9 6.0 7.9 20.5 12.6 5.3 3.1 162.4 239.6 87.54 76.92 155 0.565 14M 50K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 6.0 7.9 20.5 12.6 5.3 3.1 162.4 239.6 87.54 76.92 155 0.565 14M 50K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 6.0 7.9 13.8 6.0 0.0 0.0 213.2 212.4 66.71 59.35 61 1.094 14M 50K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 326.7 20.83 17.58 94 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.2 total, 26.0 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.48 GB write, 800.14 MB/s write, 13.89 GB read, 542.53 MB/s read, 87.5 seconds Interval compaction: 20.48 GB write, 807.64 MB/s write, 13.89 GB read, 547.61 MB/s read, 87.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 40, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2410191 Average: 2.5037 StdDev: 22.75 Min: 0 Median: 1.5674 Max: 23926 Percentiles: P50: 1.57 P75: 1.95 P99: 6.52 P99.9: 13.49 P99.99: 141.70 ------------------------------------------------------ [ 0, 1 ] 320304 13.290% 13.290% ### ( 1, 2 ] 1559440 64.702% 77.991% ############# ( 2, 3 ] 300475 12.467% 90.458% ## ( 3, 4 ] 104362 4.330% 94.788% # ( 4, 6 ] 98756 4.097% 98.886% # ( 6, 10 ] 21348 0.886% 99.772% ( 10, 15 ] 4431 0.184% 99.955% ( 15, 22 ] 386 0.016% 99.971% ( 22, 34 ] 39 0.002% 99.973% ( 34, 51 ] 15 0.001% 99.974% ( 51, 76 ] 12 0.000% 99.974% ( 76, 110 ] 178 0.007% 99.982% ( 110, 170 ] 388 0.016% 99.998% ( 170, 250 ] 240 0.010% 100.008% ( 250, 380 ] 145 0.006% 100.014% ( 380, 580 ] 156 0.006% 100.020% ( 580, 870 ] 113 0.005% 100.025% ( 870, 1300 ] 49 0.002% 100.027% ( 1300, 1900 ] 19 0.001% 100.028% ( 1900, 2900 ] 18 0.001% 100.028% ( 2900, 4400 ] 8 0.000% 100.029% ( 4400, 6600 ] 4 0.000% 100.029% ( 6600, 9900 ] 3 0.000% 100.029% ( 22000, 33000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 701438 Average: 3.3205 StdDev: 58.72 Min: 1 Median: 1.7217 Max: 39457 Percentiles: P50: 1.72 P75: 2.48 P99: 8.88 P99.9: 49.14 P99.99: 281.89 ------------------------------------------------------ [ 0, 1 ] 52675 7.510% 7.510% ## ( 1, 2 ] 412988 58.877% 66.387% ############ ( 2, 3 ] 125404 17.878% 84.265% #### ( 3, 4 ] 45508 6.488% 90.753% # ( 4, 6 ] 48863 6.966% 97.719% # ( 6, 10 ] 12492 1.781% 99.500% ( 10, 15 ] 2504 0.357% 99.857% ( 15, 22 ] 277 0.039% 99.896% ( 22, 34 ] 22 0.003% 99.899% ( 34, 51 ] 4 0.001% 99.900% ( 51, 76 ] 3 0.000% 99.900% ( 76, 110 ] 170 0.024% 99.925% ( 110, 170 ] 248 0.035% 99.960% ( 170, 250 ] 176 0.025% 99.985% ( 250, 380 ] 138 0.020% 100.005% ( 380, 580 ] 126 0.018% 100.023% ( 580, 870 ] 71 0.010% 100.033% ( 870, 1300 ] 48 0.007% 100.040% ( 1300, 1900 ] 22 0.003% 100.043% ( 1900, 2900 ] 15 0.002% 100.045% ( 2900, 4400 ] 12 0.002% 100.047% ( 4400, 6600 ] 3 0.000% 100.047% ( 6600, 9900 ] 5 0.001% 100.048% ( 33000, 50000 ] 1 0.000% 100.048% ** Level 2 read latency histogram (micros): Count: 40578 Average: 2.5662 StdDev: 30.91 Min: 1 Median: 1.3989 Max: 4188 Percentiles: P50: 1.40 P75: 1.82 P99: 8.55 P99.9: 72.08 P99.99: 1072.57 ------------------------------------------------------ [ 0, 1 ] 10713 26.401% 26.401% ##### ( 1, 2 ] 24005 59.158% 85.559% ############ ( 2, 3 ] 3069 7.563% 93.122% ## ( 3, 4 ] 1071 2.639% 95.761% # ( 4, 6 ] 984 2.425% 98.186% ( 6, 10 ] 518 1.277% 99.463% ( 10, 15 ] 125 0.308% 99.771% ( 15, 22 ] 13 0.032% 99.803% ( 22, 34 ] 1 0.002% 99.805% ( 34, 51 ] 3 0.007% 99.813% ( 51, 76 ] 42 0.104% 99.916% ( 76, 110 ] 12 0.030% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 7 0.017% 99.965% ( 250, 380 ] 6 0.015% 99.980% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 2 0.005% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 684324 Average: 4.2213 StdDev: 48.39 Min: 1 Median: 1.9875 Max: 7451 Percentiles: P50: 1.99 P75: 2.97 P99: 9.24 P99.9: 16.37 P99.99: 150.74 ------------------------------------------------------ [ 0, 1 ] 12599 1.841% 1.841% ( 1, 2 ] 333741 48.769% 50.611% ########## ( 2, 3 ] 171643 25.082% 75.693% ##### ( 3, 4 ] 68456 10.003% 85.696% ## ( 4, 6 ] 78601 11.486% 97.182% ## ( 6, 10 ] 15343 2.242% 99.424% ( 10, 15 ] 3178 0.464% 99.889% ( 15, 22 ] 402 0.059% 99.947% ( 22, 34 ] 35 0.005% 99.952% ( 34, 51 ] 4 0.001% 99.953% ( 51, 76 ] 3 0.000% 99.953% ( 76, 110 ] 72 0.011% 99.964% ( 110, 170 ] 263 0.038% 100.002% ( 170, 250 ] 285 0.042% 100.044% ( 250, 380 ] 255 0.037% 100.081% ( 380, 580 ] 228 0.033% 100.115% ( 580, 870 ] 156 0.023% 100.137% ( 870, 1300 ] 67 0.010% 100.147% ( 1300, 1900 ] 31 0.005% 100.152% ( 1900, 2900 ] 38 0.006% 100.157% ( 2900, 4400 ] 40 0.006% 100.163% ( 4400, 6600 ] 13 0.002% 100.165% ( 6600, 9900 ] 3 0.000% 100.165% ** Level 4 read latency histogram (micros): Count: 7129 Average: 311.9315 StdDev: 1033.29 Min: 0 Median: 2.7308 Max: 26753 Percentiles: P50: 2.73 P75: 79.94 P99: 4381.57 P99.9: 10495.18 P99.99: 23052.70 ------------------------------------------------------ [ 0, 1 ] 126 1.767% 1.767% ( 1, 2 ] 2256 31.645% 33.413% ###### ( 2, 3 ] 1618 22.696% 56.109% ##### ( 3, 4 ] 665 9.328% 65.437% ## ( 4, 6 ] 481 6.747% 72.184% # ( 6, 10 ] 117 1.641% 73.825% ( 10, 15 ] 62 0.870% 74.695% ( 15, 22 ] 7 0.098% 74.793% ( 51, 76 ] 10 0.140% 74.933% ( 76, 110 ] 41 0.575% 75.508% ( 110, 170 ] 187 2.623% 78.132% # ( 170, 250 ] 175 2.455% 80.586% ( 250, 380 ] 174 2.441% 83.027% ( 380, 580 ] 223 3.128% 86.155% # ( 580, 870 ] 230 3.226% 89.381% # ( 870, 1300 ] 243 3.409% 92.790% # ( 1300, 1900 ] 183 2.567% 95.357% # ( 1900, 2900 ] 156 2.188% 97.545% ( 2900, 4400 ] 105 1.473% 99.018% ( 4400, 6600 ] 44 0.617% 99.635% ( 6600, 9900 ] 18 0.252% 99.888% ( 9900, 14000 ] 6 0.084% 99.972% ( 14000, 22000 ] 1 0.014% 99.986% ( 22000, 33000 ] 3 0.042% 100.028% ** Level 5 read latency histogram (micros): Count: 120 Average: 1023.1083 StdDev: 1272.65 Min: 82 Median: 362.6667 Max: 6712 Percentiles: P50: 362.67 P75: 1600.00 P99: 6490.00 P99.9: 6712.00 P99.99: 6712.00 ------------------------------------------------------ ( 76, 110 ] 18 15.000% 15.000% ### ( 110, 170 ] 18 15.000% 30.000% ### ( 170, 250 ] 11 9.167% 39.167% ## ( 250, 380 ] 15 12.500% 51.667% ### ( 380, 580 ] 6 5.000% 56.667% # ( 580, 870 ] 9 7.500% 64.167% ## ( 870, 1300 ] 9 7.500% 71.667% ## ( 1300, 1900 ] 8 6.667% 78.333% # ( 1900, 2900 ] 15 12.500% 90.833% ### ( 2900, 4400 ] 6 5.000% 95.833% # ( 4400, 6600 ] 4 3.333% 99.167% # ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 26.2 total, 4.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 262.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.512 H:M:S, 28.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 219.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.742 H:M:S, 38.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-00:48:55 ... thread 0: (1000000,8000000) ops and (225374.8,263131.3) ops/second in (4.437054,30.403068) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 4.30 GB 182.5 6.5 0.0 6.5 14.0 7.6 0.0 1.9 135.1 293.2 48.95 44.84 131 0.374 6715K 8553 0.0 0.0 L1 11/11 1.23 GB 0.0 4.0 3.1 0.8 3.9 3.1 0.1 1.3 231.0 229.4 17.53 16.92 4 4.383 4113K 27K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 1.9 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 24/0 973.71 MB 1.0 3.5 1.7 1.9 3.5 1.7 0.4 2.1 198.5 197.7 18.20 16.22 15 1.214 3669K 14K 0.0 0.0 L4 177/0 9.57 GB 1.0 1.2 1.2 0.0 1.2 1.2 0.8 1.0 117.3 117.3 10.37 6.08 24 0.432 1226K 472 0.0 0.0 L5 1064/0 87.60 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/21 103.65 GB 0.0 15.2 6.0 9.2 22.8 13.5 5.3 3.0 163.4 244.0 95.51 84.49 175 0.546 15M 51K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.2 6.0 9.2 22.8 13.5 5.3 3.0 163.4 244.0 95.51 84.49 175 0.546 15M 51K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.2 6.0 9.2 15.2 6.0 0.0 0.0 216.8 216.1 71.97 64.50 66 1.090 15M 51K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 329.2 23.54 19.98 109 0.216 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.6 total, 30.4 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.76 GB write, 760.31 MB/s write, 15.24 GB read, 509.20 MB/s read, 95.5 seconds Interval compaction: 22.76 GB write, 766.40 MB/s write, 15.24 GB read, 513.28 MB/s read, 95.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 40, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2920150 Average: 2.4783 StdDev: 21.25 Min: 0 Median: 1.5585 Max: 23926 Percentiles: P50: 1.56 P75: 1.94 P99: 6.37 P99.9: 13.24 P99.99: 133.65 ------------------------------------------------------ [ 0, 1 ] 392743 13.449% 13.449% ### ( 1, 2 ] 1911081 65.445% 78.894% ############# ( 2, 3 ] 354100 12.126% 91.020% ## ( 3, 4 ] 120449 4.125% 95.145% # ( 4, 6 ] 110217 3.774% 98.919% # ( 6, 10 ] 25517 0.874% 99.793% ( 10, 15 ] 4814 0.165% 99.958% ( 15, 22 ] 425 0.015% 99.972% ( 22, 34 ] 41 0.001% 99.974% ( 34, 51 ] 18 0.001% 99.974% ( 51, 76 ] 14 0.000% 99.975% ( 76, 110 ] 234 0.008% 99.983% ( 110, 170 ] 520 0.018% 100.001% ( 170, 250 ] 309 0.011% 100.011% ( 250, 380 ] 178 0.006% 100.017% ( 380, 580 ] 199 0.007% 100.024% ( 580, 870 ] 135 0.005% 100.029% ( 870, 1300 ] 59 0.002% 100.031% ( 1300, 1900 ] 21 0.001% 100.032% ( 1900, 2900 ] 18 0.001% 100.032% ( 2900, 4400 ] 10 0.000% 100.033% ( 4400, 6600 ] 4 0.000% 100.033% ( 6600, 9900 ] 3 0.000% 100.033% ( 22000, 33000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 740815 Average: 3.2835 StdDev: 57.30 Min: 1 Median: 1.7064 Max: 39457 Percentiles: P50: 1.71 P75: 2.44 P99: 8.85 P99.9: 88.34 P99.99: 287.07 ------------------------------------------------------ [ 0, 1 ] 59454 8.025% 8.025% ## ( 1, 2 ] 440220 59.424% 67.449% ############ ( 2, 3 ] 128478 17.343% 84.792% ### ( 3, 4 ] 46445 6.269% 91.061% # ( 4, 6 ] 49484 6.680% 97.741% # ( 6, 10 ] 13089 1.767% 99.508% ( 10, 15 ] 2514 0.339% 99.847% ( 15, 22 ] 278 0.038% 99.885% ( 22, 34 ] 22 0.003% 99.888% ( 34, 51 ] 4 0.001% 99.888% ( 51, 76 ] 3 0.000% 99.889% ( 76, 110 ] 232 0.031% 99.920% ( 110, 170 ] 292 0.039% 99.960% ( 170, 250 ] 187 0.025% 99.985% ( 250, 380 ] 140 0.019% 100.004% ( 380, 580 ] 131 0.018% 100.021% ( 580, 870 ] 73 0.010% 100.031% ( 870, 1300 ] 48 0.006% 100.038% ( 1300, 1900 ] 22 0.003% 100.041% ( 1900, 2900 ] 15 0.002% 100.043% ( 2900, 4400 ] 13 0.002% 100.044% ( 4400, 6600 ] 3 0.000% 100.045% ( 6600, 9900 ] 5 0.001% 100.045% ( 33000, 50000 ] 1 0.000% 100.046% ** Level 2 read latency histogram (micros): Count: 40578 Average: 2.5662 StdDev: 30.91 Min: 1 Median: 1.3989 Max: 4188 Percentiles: P50: 1.40 P75: 1.82 P99: 8.55 P99.9: 72.08 P99.99: 1072.57 ------------------------------------------------------ [ 0, 1 ] 10713 26.401% 26.401% ##### ( 1, 2 ] 24005 59.158% 85.559% ############ ( 2, 3 ] 3069 7.563% 93.122% ## ( 3, 4 ] 1071 2.639% 95.761% # ( 4, 6 ] 984 2.425% 98.186% ( 6, 10 ] 518 1.277% 99.463% ( 10, 15 ] 125 0.308% 99.771% ( 15, 22 ] 13 0.032% 99.803% ( 22, 34 ] 1 0.002% 99.805% ( 34, 51 ] 3 0.007% 99.813% ( 51, 76 ] 42 0.104% 99.916% ( 76, 110 ] 12 0.030% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 7 0.017% 99.965% ( 250, 380 ] 6 0.015% 99.980% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 2 0.005% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 684324 Average: 4.2213 StdDev: 48.39 Min: 1 Median: 1.9875 Max: 7451 Percentiles: P50: 1.99 P75: 2.97 P99: 9.24 P99.9: 16.37 P99.99: 150.74 ------------------------------------------------------ [ 0, 1 ] 12599 1.841% 1.841% ( 1, 2 ] 333741 48.769% 50.611% ########## ( 2, 3 ] 171643 25.082% 75.693% ##### ( 3, 4 ] 68456 10.003% 85.696% ## ( 4, 6 ] 78601 11.486% 97.182% ## ( 6, 10 ] 15343 2.242% 99.424% ( 10, 15 ] 3178 0.464% 99.889% ( 15, 22 ] 402 0.059% 99.947% ( 22, 34 ] 35 0.005% 99.952% ( 34, 51 ] 4 0.001% 99.953% ( 51, 76 ] 3 0.000% 99.953% ( 76, 110 ] 72 0.011% 99.964% ( 110, 170 ] 263 0.038% 100.002% ( 170, 250 ] 285 0.042% 100.044% ( 250, 380 ] 255 0.037% 100.081% ( 380, 580 ] 228 0.033% 100.115% ( 580, 870 ] 156 0.023% 100.137% ( 870, 1300 ] 67 0.010% 100.147% ( 1300, 1900 ] 31 0.005% 100.152% ( 1900, 2900 ] 38 0.006% 100.157% ( 2900, 4400 ] 40 0.006% 100.163% ( 4400, 6600 ] 13 0.002% 100.165% ( 6600, 9900 ] 3 0.000% 100.165% ** Level 4 read latency histogram (micros): Count: 7129 Average: 311.9315 StdDev: 1033.29 Min: 0 Median: 2.7308 Max: 26753 Percentiles: P50: 2.73 P75: 79.94 P99: 4381.57 P99.9: 10495.18 P99.99: 23052.70 ------------------------------------------------------ [ 0, 1 ] 126 1.767% 1.767% ( 1, 2 ] 2256 31.645% 33.413% ###### ( 2, 3 ] 1618 22.696% 56.109% ##### ( 3, 4 ] 665 9.328% 65.437% ## ( 4, 6 ] 481 6.747% 72.184% # ( 6, 10 ] 117 1.641% 73.825% ( 10, 15 ] 62 0.870% 74.695% ( 15, 22 ] 7 0.098% 74.793% ( 51, 76 ] 10 0.140% 74.933% ( 76, 110 ] 41 0.575% 75.508% ( 110, 170 ] 187 2.623% 78.132% # ( 170, 250 ] 175 2.455% 80.586% ( 250, 380 ] 174 2.441% 83.027% ( 380, 580 ] 223 3.128% 86.155% # ( 580, 870 ] 230 3.226% 89.381% # ( 870, 1300 ] 243 3.409% 92.790% # ( 1300, 1900 ] 183 2.567% 95.357% # ( 1900, 2900 ] 156 2.188% 97.545% ( 2900, 4400 ] 105 1.473% 99.018% ( 4400, 6600 ] 44 0.617% 99.635% ( 6600, 9900 ] 18 0.252% 99.888% ( 9900, 14000 ] 6 0.084% 99.972% ( 14000, 22000 ] 1 0.014% 99.986% ( 22000, 33000 ] 3 0.042% 100.028% ** Level 5 read latency histogram (micros): Count: 120 Average: 1023.1083 StdDev: 1272.65 Min: 82 Median: 362.6667 Max: 6712 Percentiles: P50: 362.67 P75: 1600.00 P99: 6490.00 P99.9: 6712.00 P99.99: 6712.00 ------------------------------------------------------ ( 76, 110 ] 18 15.000% 15.000% ### ( 110, 170 ] 18 15.000% 30.000% ### ( 170, 250 ] 11 9.167% 39.167% ## ( 250, 380 ] 15 12.500% 51.667% ### ( 380, 580 ] 6 5.000% 56.667% # ( 580, 870 ] 9 7.500% 64.167% ## ( 870, 1300 ] 9 7.500% 71.667% ## ( 1300, 1900 ] 8 6.667% 78.333% # ( 1900, 2900 ] 15 12.500% 90.833% ### ( 2900, 4400 ] 6 5.000% 95.833% # ( 4400, 6600 ] 4 3.333% 99.167% # ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 30.6 total, 4.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 256.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.233 H:M:S, 30.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 221.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.721 H:M:S, 38.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-00:49:10 ... thread 0: (1000000,9000000) ops and (67718.8,199247.2) ops/second in (14.766953,45.170021) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.76 GB 18.9 8.0 0.0 8.0 16.5 8.5 0.0 1.9 140.1 289.6 58.45 53.28 149 0.392 8313K 13K 0.0 0.0 L1 15/15 1.85 GB 0.0 7.7 5.7 2.0 7.6 5.6 0.1 1.3 224.4 221.9 35.14 33.34 5 7.027 8008K 89K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 3.8 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 20/0 907.89 MB 0.9 5.7 3.0 2.6 5.7 3.0 0.8 1.9 176.4 175.4 33.04 26.66 25 1.321 5917K 32K 0.0 0.0 L4 171/0 9.47 GB 1.0 3.5 3.0 0.5 3.5 3.0 0.9 1.2 127.9 127.4 28.35 17.41 48 0.591 3646K 10K 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/25 104.54 GB 0.0 25.0 11.8 13.2 33.4 20.2 9.6 3.9 164.9 220.3 155.44 131.12 228 0.682 26M 146K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.0 11.8 13.2 33.4 20.2 9.6 3.9 164.9 220.3 155.44 131.12 228 0.682 26M 146K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.0 11.8 13.2 24.9 11.6 0.0 0.0 199.6 198.4 128.45 108.47 104 1.235 26M 146K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 324.5 26.98 22.65 124 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.4 total, 45.2 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.44 GB write, 754.06 MB/s write, 25.04 GB read, 564.55 MB/s read, 155.4 seconds Interval compaction: 33.44 GB write, 758.13 MB/s write, 25.04 GB read, 567.59 MB/s read, 155.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 59, total-stops: 51, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3845374 Average: 2.7415 StdDev: 26.22 Min: 0 Median: 1.5605 Max: 23926 Percentiles: P50: 1.56 P75: 1.95 P99: 7.40 P99.9: 96.56 P99.99: 285.64 ------------------------------------------------------ [ 0, 1 ] 522773 13.595% 13.595% ### ( 1, 2 ] 2497508 64.948% 78.543% ############# ( 2, 3 ] 464847 12.088% 90.632% ## ( 3, 4 ] 157711 4.101% 94.733% # ( 4, 6 ] 150176 3.905% 98.638% # ( 6, 10 ] 39754 1.034% 99.672% ( 10, 15 ] 7161 0.186% 99.858% ( 15, 22 ] 695 0.018% 99.877% ( 22, 34 ] 49 0.001% 99.878% ( 34, 51 ] 24 0.001% 99.878% ( 51, 76 ] 28 0.001% 99.879% ( 76, 110 ] 1329 0.035% 99.914% ( 110, 170 ] 2033 0.053% 99.967% ( 170, 250 ] 758 0.020% 99.986% ( 250, 380 ] 527 0.014% 100.000% ( 380, 580 ] 502 0.013% 100.013% ( 580, 870 ] 317 0.008% 100.021% ( 870, 1300 ] 147 0.004% 100.025% ( 1300, 1900 ] 64 0.002% 100.027% ( 1900, 2900 ] 43 0.001% 100.028% ( 2900, 4400 ] 37 0.001% 100.029% ( 4400, 6600 ] 10 0.000% 100.029% ( 6600, 9900 ] 7 0.000% 100.029% ( 22000, 33000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 1374980 Average: 3.9617 StdDev: 61.54 Min: 1 Median: 1.7244 Max: 39457 Percentiles: P50: 1.72 P75: 2.54 P99: 9.26 P99.9: 107.20 P99.99: 334.13 ------------------------------------------------------ [ 0, 1 ] 121410 8.830% 8.830% ## ( 1, 2 ] 781475 56.835% 65.665% ########### ( 2, 3 ] 235608 17.135% 82.801% ### ( 3, 4 ] 93969 6.834% 89.635% # ( 4, 6 ] 105322 7.660% 97.295% ## ( 6, 10 ] 28733 2.090% 99.385% ( 10, 15 ] 5683 0.413% 99.798% ( 15, 22 ] 677 0.049% 99.847% ( 22, 34 ] 55 0.004% 99.851% ( 34, 51 ] 22 0.002% 99.853% ( 51, 76 ] 49 0.004% 99.856% ( 76, 110 ] 656 0.048% 99.904% ( 110, 170 ] 630 0.046% 99.950% ( 170, 250 ] 338 0.025% 99.974% ( 250, 380 ] 333 0.024% 99.999% ( 380, 580 ] 347 0.025% 100.024% ( 580, 870 ] 265 0.019% 100.043% ( 870, 1300 ] 206 0.015% 100.058% ( 1300, 1900 ] 114 0.008% 100.066% ( 1900, 2900 ] 84 0.006% 100.072% ( 2900, 4400 ] 92 0.007% 100.079% ( 4400, 6600 ] 18 0.001% 100.080% ( 6600, 9900 ] 11 0.001% 100.081% ( 33000, 50000 ] 1 0.000% 100.081% ** Level 2 read latency histogram (micros): Count: 40578 Average: 2.5662 StdDev: 30.91 Min: 1 Median: 1.3989 Max: 4188 Percentiles: P50: 1.40 P75: 1.82 P99: 8.55 P99.9: 72.08 P99.99: 1072.57 ------------------------------------------------------ [ 0, 1 ] 10713 26.401% 26.401% ##### ( 1, 2 ] 24005 59.158% 85.559% ############ ( 2, 3 ] 3069 7.563% 93.122% ## ( 3, 4 ] 1071 2.639% 95.761% # ( 4, 6 ] 984 2.425% 98.186% ( 6, 10 ] 518 1.277% 99.463% ( 10, 15 ] 125 0.308% 99.771% ( 15, 22 ] 13 0.032% 99.803% ( 22, 34 ] 1 0.002% 99.805% ( 34, 51 ] 3 0.007% 99.813% ( 51, 76 ] 42 0.104% 99.916% ( 76, 110 ] 12 0.030% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 7 0.017% 99.965% ( 250, 380 ] 6 0.015% 99.980% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 2 0.005% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 1374091 Average: 4.7653 StdDev: 68.21 Min: 1 Median: 2.0545 Max: 37624 Percentiles: P50: 2.05 P75: 3.12 P99: 9.37 P99.9: 14.83 P99.99: 73.17 ------------------------------------------------------ [ 0, 1 ] 22170 1.613% 1.613% ( 1, 2 ] 646101 47.020% 48.634% ######### ( 2, 3 ] 344503 25.071% 73.705% ##### ( 3, 4 ] 145605 10.596% 84.301% ## ( 4, 6 ] 173934 12.658% 96.960% ### ( 6, 10 ] 33281 2.422% 99.382% ( 10, 15 ] 7377 0.537% 99.918% ( 15, 22 ] 862 0.063% 99.981% ( 22, 34 ] 66 0.005% 99.986% ( 34, 51 ] 20 0.001% 99.987% ( 51, 76 ] 39 0.003% 99.990% ( 76, 110 ] 96 0.007% 99.997% ( 110, 170 ] 330 0.024% 100.021% ( 170, 250 ] 406 0.030% 100.051% ( 250, 380 ] 453 0.033% 100.084% ( 380, 580 ] 526 0.038% 100.122% ( 580, 870 ] 445 0.032% 100.155% ( 870, 1300 ] 307 0.022% 100.177% ( 1300, 1900 ] 147 0.011% 100.188% ( 1900, 2900 ] 98 0.007% 100.195% ( 2900, 4400 ] 104 0.008% 100.202% ( 4400, 6600 ] 35 0.003% 100.205% ( 6600, 9900 ] 15 0.001% 100.206% ( 9900, 14000 ] 1 0.000% 100.206% ( 33000, 50000 ] 1 0.000% 100.206% ** Level 4 read latency histogram (micros): Count: 131721 Average: 46.9176 StdDev: 351.67 Min: 0 Median: 2.2463 Max: 28174 Percentiles: P50: 2.25 P75: 3.64 P99: 1216.68 P99.9: 3856.33 P99.99: 4554.47 ------------------------------------------------------ [ 0, 1 ] 2124 1.612% 1.612% ( 1, 2 ] 56022 42.531% 44.143% ######### ( 2, 3 ] 31318 23.776% 67.919% ##### ( 3, 4 ] 14574 11.064% 78.984% ## ( 4, 6 ] 17480 13.270% 92.254% ### ( 6, 10 ] 3812 2.894% 95.148% # ( 10, 15 ] 1193 0.906% 96.054% ( 15, 22 ] 109 0.083% 96.137% ( 22, 34 ] 17 0.013% 96.149% ( 34, 51 ] 11 0.008% 96.158% ( 51, 76 ] 21 0.016% 96.174% ( 76, 110 ] 68 0.052% 96.225% ( 110, 170 ] 312 0.237% 96.462% ( 170, 250 ] 382 0.290% 96.752% ( 250, 380 ] 533 0.405% 97.157% ( 380, 580 ] 813 0.617% 97.774% ( 580, 870 ] 969 0.736% 98.510% ( 870, 1300 ] 801 0.608% 99.118% ( 1300, 1900 ] 467 0.355% 99.472% ( 1900, 2900 ] 365 0.277% 99.749% ( 2900, 4400 ] 311 0.236% 99.986% ( 4400, 6600 ] 83 0.063% 100.049% ( 6600, 9900 ] 32 0.024% 100.073% ( 9900, 14000 ] 6 0.005% 100.077% ( 14000, 22000 ] 1 0.001% 100.078% ( 22000, 33000 ] 4 0.003% 100.081% ** Level 5 read latency histogram (micros): Count: 240 Average: 1186.7375 StdDev: 1390.33 Min: 82 Median: 494.2857 Max: 6793 Percentiles: P50: 494.29 P75: 1900.00 P99: 6502.22 P99.9: 6793.00 P99.99: 6793.00 ------------------------------------------------------ ( 76, 110 ] 22 9.167% 9.167% ## ( 110, 170 ] 30 12.500% 21.667% ### ( 170, 250 ] 24 10.000% 31.667% ## ( 250, 380 ] 32 13.333% 45.000% ### ( 380, 580 ] 21 8.750% 53.750% ## ( 580, 870 ] 16 6.667% 60.417% # ( 870, 1300 ] 22 9.167% 69.583% ## ( 1300, 1900 ] 13 5.417% 75.000% # ( 1900, 2900 ] 25 10.417% 85.417% ## ( 2900, 4400 ] 24 10.000% 95.417% ## ( 4400, 6600 ] 9 3.750% 99.167% # ( 6600, 9900 ] 2 0.833% 100.000% ** DB Stats ** Uptime(secs): 45.4 total, 14.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 195.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.978 H:M:S, 46.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 66.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.745 H:M:S, 79.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-00:49:13 ... thread 0: (1000000,10000000) ops and (327319.1,207360.7) ops/second in (3.055123,48.225144) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 3.68 GB 88.1 8.9 0.0 8.9 18.3 9.5 0.0 1.9 140.4 290.4 64.59 59.02 165 0.391 9209K 14K 0.0 0.0 L1 15/15 1.85 GB 0.0 7.7 5.7 2.0 7.6 5.6 0.1 1.3 224.4 221.9 35.14 33.34 5 7.027 8008K 89K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 3.8 1.8 245.0 245.0 0.45 0.43 1 0.455 113K 28 0.0 0.0 L3 20/0 907.89 MB 0.9 5.7 3.0 2.6 5.7 3.0 0.8 1.9 176.4 175.4 33.04 26.66 25 1.321 5917K 32K 0.0 0.0 L4 171/0 9.47 GB 1.0 3.5 3.0 0.5 3.5 3.0 0.9 1.2 127.9 127.4 28.35 17.41 48 0.591 3646K 10K 0.0 0.0 L5 1088/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1311/29 105.46 GB 0.0 25.9 11.8 14.1 35.2 21.1 9.6 3.7 164.1 223.3 161.57 136.86 244 0.662 26M 147K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.9 11.8 14.1 35.2 21.1 9.6 3.7 164.1 223.3 161.57 136.86 244 0.662 26M 147K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.9 11.8 14.1 25.8 11.6 0.0 0.0 201.1 200.0 131.86 111.80 107 1.232 26M 147K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 326.5 29.71 25.06 137 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.5 total, 48.2 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.23 GB write, 744.20 MB/s write, 25.90 GB read, 547.16 MB/s read, 161.6 seconds Interval compaction: 35.23 GB write, 747.96 MB/s write, 25.90 GB read, 549.92 MB/s read, 161.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 59, total-stops: 55, interval: 114 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4248375 Average: 2.7023 StdDev: 25.17 Min: 0 Median: 1.5620 Max: 23926 Percentiles: P50: 1.56 P75: 1.95 P99: 7.29 P99.9: 81.64 P99.99: 240.94 ------------------------------------------------------ [ 0, 1 ] 567744 13.364% 13.364% ### ( 1, 2 ] 2769286 65.185% 78.548% ############# ( 2, 3 ] 520299 12.247% 90.795% ## ( 3, 4 ] 172292 4.055% 94.851% # ( 4, 6 ] 162230 3.819% 98.670% # ( 6, 10 ] 43573 1.026% 99.695% ( 10, 15 ] 7641 0.180% 99.875% ( 15, 22 ] 738 0.017% 99.892% ( 22, 34 ] 52 0.001% 99.894% ( 34, 51 ] 25 0.001% 99.894% ( 51, 76 ] 29 0.001% 99.895% ( 76, 110 ] 1329 0.031% 99.926% ( 110, 170 ] 2035 0.048% 99.974% ( 170, 250 ] 767 0.018% 99.992% ( 250, 380 ] 530 0.012% 100.005% ( 380, 580 ] 508 0.012% 100.017% ( 580, 870 ] 322 0.008% 100.024% ( 870, 1300 ] 149 0.004% 100.028% ( 1300, 1900 ] 66 0.002% 100.029% ( 1900, 2900 ] 45 0.001% 100.030% ( 2900, 4400 ] 39 0.001% 100.031% ( 4400, 6600 ] 10 0.000% 100.031% ( 6600, 9900 ] 7 0.000% 100.032% ( 22000, 33000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1391110 Average: 3.9521 StdDev: 61.20 Min: 1 Median: 1.7226 Max: 39457 Percentiles: P50: 1.72 P75: 2.54 P99: 9.26 P99.9: 109.18 P99.99: 336.62 ------------------------------------------------------ [ 0, 1 ] 122829 8.830% 8.830% ## ( 1, 2 ] 792586 56.975% 65.805% ########### ( 2, 3 ] 237859 17.099% 82.903% ### ( 3, 4 ] 94490 6.792% 89.696% # ( 4, 6 ] 105766 7.603% 97.299% ## ( 6, 10 ] 29023 2.086% 99.385% ( 10, 15 ] 5711 0.411% 99.795% ( 15, 22 ] 680 0.049% 99.844% ( 22, 34 ] 55 0.004% 99.848% ( 34, 51 ] 22 0.002% 99.850% ( 51, 76 ] 49 0.004% 99.853% ( 76, 110 ] 665 0.048% 99.901% ( 110, 170 ] 661 0.048% 99.949% ( 170, 250 ] 349 0.025% 99.974% ( 250, 380 ] 339 0.024% 99.998% ( 380, 580 ] 350 0.025% 100.023% ( 580, 870 ] 268 0.019% 100.043% ( 870, 1300 ] 206 0.015% 100.057% ( 1300, 1900 ] 114 0.008% 100.066% ( 1900, 2900 ] 84 0.006% 100.072% ( 2900, 4400 ] 92 0.007% 100.078% ( 4400, 6600 ] 18 0.001% 100.080% ( 6600, 9900 ] 11 0.001% 100.080% ( 33000, 50000 ] 1 0.000% 100.080% ** Level 2 read latency histogram (micros): Count: 40578 Average: 2.5662 StdDev: 30.91 Min: 1 Median: 1.3989 Max: 4188 Percentiles: P50: 1.40 P75: 1.82 P99: 8.55 P99.9: 72.08 P99.99: 1072.57 ------------------------------------------------------ [ 0, 1 ] 10713 26.401% 26.401% ##### ( 1, 2 ] 24005 59.158% 85.559% ############ ( 2, 3 ] 3069 7.563% 93.122% ## ( 3, 4 ] 1071 2.639% 95.761% # ( 4, 6 ] 984 2.425% 98.186% ( 6, 10 ] 518 1.277% 99.463% ( 10, 15 ] 125 0.308% 99.771% ( 15, 22 ] 13 0.032% 99.803% ( 22, 34 ] 1 0.002% 99.805% ( 34, 51 ] 3 0.007% 99.813% ( 51, 76 ] 42 0.104% 99.916% ( 76, 110 ] 12 0.030% 99.946% ( 110, 170 ] 1 0.002% 99.948% ( 170, 250 ] 7 0.017% 99.965% ( 250, 380 ] 6 0.015% 99.980% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 2 0.005% 99.988% ( 870, 1300 ] 2 0.005% 99.993% ( 1300, 1900 ] 1 0.002% 99.995% ( 2900, 4400 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 1374091 Average: 4.7653 StdDev: 68.21 Min: 1 Median: 2.0545 Max: 37624 Percentiles: P50: 2.05 P75: 3.12 P99: 9.37 P99.9: 14.83 P99.99: 73.17 ------------------------------------------------------ [ 0, 1 ] 22170 1.613% 1.613% ( 1, 2 ] 646101 47.020% 48.634% ######### ( 2, 3 ] 344503 25.071% 73.705% ##### ( 3, 4 ] 145605 10.596% 84.301% ## ( 4, 6 ] 173934 12.658% 96.960% ### ( 6, 10 ] 33281 2.422% 99.382% ( 10, 15 ] 7377 0.537% 99.918% ( 15, 22 ] 862 0.063% 99.981% ( 22, 34 ] 66 0.005% 99.986% ( 34, 51 ] 20 0.001% 99.987% ( 51, 76 ] 39 0.003% 99.990% ( 76, 110 ] 96 0.007% 99.997% ( 110, 170 ] 330 0.024% 100.021% ( 170, 250 ] 406 0.030% 100.051% ( 250, 380 ] 453 0.033% 100.084% ( 380, 580 ] 526 0.038% 100.122% ( 580, 870 ] 445 0.032% 100.155% ( 870, 1300 ] 307 0.022% 100.177% ( 1300, 1900 ] 147 0.011% 100.188% ( 1900, 2900 ] 98 0.007% 100.195% ( 2900, 4400 ] 104 0.008% 100.202% ( 4400, 6600 ] 35 0.003% 100.205% ( 6600, 9900 ] 15 0.001% 100.206% ( 9900, 14000 ] 1 0.000% 100.206% ( 33000, 50000 ] 1 0.000% 100.206% ** Level 4 read latency histogram (micros): Count: 131721 Average: 46.9176 StdDev: 351.67 Min: 0 Median: 2.2463 Max: 28174 Percentiles: P50: 2.25 P75: 3.64 P99: 1216.68 P99.9: 3856.33 P99.99: 4554.47 ------------------------------------------------------ [ 0, 1 ] 2124 1.612% 1.612% ( 1, 2 ] 56022 42.531% 44.143% ######### ( 2, 3 ] 31318 23.776% 67.919% ##### ( 3, 4 ] 14574 11.064% 78.984% ## ( 4, 6 ] 17480 13.270% 92.254% ### ( 6, 10 ] 3812 2.894% 95.148% # ( 10, 15 ] 1193 0.906% 96.054% ( 15, 22 ] 109 0.083% 96.137% ( 22, 34 ] 17 0.013% 96.149% ( 34, 51 ] 11 0.008% 96.158% ( 51, 76 ] 21 0.016% 96.174% ( 76, 110 ] 68 0.052% 96.225% ( 110, 170 ] 312 0.237% 96.462% ( 170, 250 ] 382 0.290% 96.752% ( 250, 380 ] 533 0.405% 97.157% ( 380, 580 ] 813 0.617% 97.774% ( 580, 870 ] 969 0.736% 98.510% ( 870, 1300 ] 801 0.608% 99.118% ( 1300, 1900 ] 467 0.355% 99.472% ( 1900, 2900 ] 365 0.277% 99.749% ( 2900, 4400 ] 311 0.236% 99.986% ( 4400, 6600 ] 83 0.063% 100.049% ( 6600, 9900 ] 32 0.024% 100.073% ( 9900, 14000 ] 6 0.005% 100.077% ( 14000, 22000 ] 1 0.001% 100.078% ( 22000, 33000 ] 4 0.003% 100.081% ** Level 5 read latency histogram (micros): Count: 240 Average: 1186.7375 StdDev: 1390.33 Min: 82 Median: 494.2857 Max: 6793 Percentiles: P50: 494.29 P75: 1900.00 P99: 6502.22 P99.9: 6793.00 P99.99: 6793.00 ------------------------------------------------------ ( 76, 110 ] 22 9.167% 9.167% ## ( 110, 170 ] 30 12.500% 21.667% ### ( 170, 250 ] 24 10.000% 31.667% ## ( 250, 380 ] 32 13.333% 45.000% ### ( 380, 580 ] 21 8.750% 53.750% ## ( 580, 870 ] 16 6.667% 60.417% # ( 870, 1300 ] 22 9.167% 69.583% ## ( 1300, 1900 ] 13 5.417% 75.000% # ( 1900, 2900 ] 25 10.417% 85.417% ## ( 2900, 4400 ] 24 10.000% 95.417% ## ( 4400, 6600 ] 9 3.750% 99.167% # ( 6600, 9900 ] 2 0.833% 100.000% ** DB Stats ** Uptime(secs): 48.5 total, 3.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 203.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.404 H:M:S, 44.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.426 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.723 micros/op 174724 ops/sec 60.043 seconds 10490999 operations; 169.3 MB/s Microseconds per write: Count: 10490999 Average: 5.7233 StdDev: 365.94 Min: 0 Median: 1.7345 Max: 664352 Percentiles: P50: 1.73 P75: 2.74 P99: 9.08 P99.9: 1141.04 P99.99: 2700.07 ------------------------------------------------------ [ 0, 1 ] 1435796 13.686% 13.686% ### ( 1, 2 ] 5186668 49.439% 63.125% ########## ( 2, 3 ] 1694094 16.148% 79.273% ### ( 3, 4 ] 1429778 13.629% 92.902% ### ( 4, 6 ] 552286 5.264% 98.166% # ( 6, 10 ] 113722 1.084% 99.250% ( 10, 15 ] 36802 0.351% 99.601% ( 15, 22 ] 9011 0.086% 99.687% ( 22, 34 ] 1648 0.016% 99.703% ( 34, 51 ] 205 0.002% 99.705% ( 51, 76 ] 32 0.000% 99.705% ( 76, 110 ] 7375 0.070% 99.775% ( 110, 170 ] 2819 0.027% 99.802% ( 170, 250 ] 292 0.003% 99.805% ( 250, 380 ] 148 0.001% 99.806% ( 380, 580 ] 24 0.000% 99.807% ( 580, 870 ] 26 0.000% 99.807% ( 870, 1300 ] 15519 0.148% 99.955% ( 1300, 1900 ] 115 0.001% 99.956% ( 1900, 2900 ] 4487 0.043% 99.999% ( 2900, 4400 ] 88 0.001% 99.999% ( 4400, 6600 ] 29 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 5 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 224961 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10490999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10826710968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 593 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31441959 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34886734692 rocksdb.compact.write.bytes COUNT : 34675397568 rocksdb.flush.write.bytes COUNT : 10767302347 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 56 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 260 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10680577024 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4241408 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34984325136 rocksdb.non.last.level.read.count COUNT : 8456096 rocksdb.block.checksum.compute.count COUNT : 8454966 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.382792 P95 : 3.898028 P99 : 7.536872 P100 : 664349.000000 COUNT : 10490999 SUM : 55218594 rocksdb.compaction.times.micros P50 : 986285.714286 P95 : 3086666.666667 P99 : 13496000.000000 P100 : 17603651.000000 COUNT : 112 SUM : 142440344 rocksdb.compaction.times.cpu_micros P50 : 860000.000000 P95 : 3086666.666667 P99 : 9404000.000000 P100 : 16416711.000000 COUNT : 112 SUM : 121657204 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 699.938272 P95 : 1792.857143 P99 : 8415.000000 P100 : 66784.000000 COUNT : 145 SUM : 188649 rocksdb.compaction.outfile.sync.micros P50 : 1093.376623 P95 : 71875.000000 P99 : 138500.000000 P100 : 154835.000000 COUNT : 420 SUM : 4359558 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.134831 P95 : 770.916667 P99 : 2495.000000 P100 : 5572.000000 COUNT : 281 SUM : 67152 rocksdb.table.open.io.micros P50 : 1381.578947 P95 : 7497.187500 P99 : 17687.272727 P100 : 20400.000000 COUNT : 593 SUM : 1317776 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.671222 P95 : 8.162472 P99 : 12.194179 P100 : 39462.000000 COUNT : 8453254 SUM : 51302563 rocksdb.read.block.get.micros P50 : 452.592593 P95 : 3845.238095 P99 : 6296.714286 P100 : 7907.000000 COUNT : 1186 SUM : 1069687 rocksdb.write.raw.block.micros P50 : 0.512939 P95 : 0.974585 P99 : 3.202172 P100 : 59909.000000 COUNT : 11005866 SUM : 22185913 rocksdb.numfiles.in.singlecompaction P50 : 3.082090 P95 : 5.875000 P99 : 16.925000 P100 : 21.000000 COUNT : 145 SUM : 516 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.556756 P95 : 1154.552632 P99 : 2486.899398 P100 : 664169.000000 COUNT : 199293 SUM : 31458948 rocksdb.sst.read.micros P50 : 1.642304 P95 : 5.006882 P99 : 9.026705 P100 : 39457.000000 COUNT : 8456265 SUM : 34494169 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10490999 SUM : 10826710968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215045.045045 P95 : 421562.500000 P99 : 559312.500000 P100 : 845169.000000 COUNT : 145 SUM : 31362038 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 408 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0