[2024-12-13 17:02:25.055209] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 24.03.0 initialization... [2024-12-13 17:02:25.055376] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1702089 ] Set seed to 1734105745051744 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 17:02:25.171413] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 17:02:25.271310] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 17:02:25.271359] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1702089' to capture a snapshot of events at runtime. [2024-12-13 17:02:25.271371] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-13 17:02:25.271381] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-13 17:02:25.271389] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1702089 for offline analysis/debug. [2024-12-13 17:02:25.272677] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 17:02:33 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/13-17:02:36 ... thread 0: (1000000,1000000) ops and (335112.3,335112.3) ops/second in (2.984074,2.984074) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 566.93 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 346.5 2.55 2.26 12 0.212 0 0 0.0 0.0 L1 1/0 2.04 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 244.1 243.9 1.03 1.00 1 1.032 255K 215 0.0 0.0 L2 3/2 298.34 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 17/10 818.42 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 195.7 195.7 0.32 0.26 1 0.319 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/20 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 97.0 297.9 4.39 3.97 15 0.293 432K 250 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 97.0 297.9 4.39 3.97 15 0.293 432K 250 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 230.9 230.8 1.84 1.72 3 0.614 432K 250 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 346.5 2.55 2.26 12 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 408.12 MB/s write, 0.42 GB read, 132.89 MB/s read, 4.4 seconds Interval compaction: 1.28 GB write, 437.87 MB/s write, 0.42 GB read, 142.57 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 139501 Average: 2.1011 StdDev: 14.18 Min: 1 Median: 1.4134 Max: 4323 Percentiles: P50: 1.41 P75: 1.81 P99: 5.54 P99.9: 10.22 P99.99: 140.75 ------------------------------------------------------ [ 0, 1 ] 33458 23.984% 23.984% ##### ( 1, 2 ] 87798 62.937% 86.921% ############# ( 2, 3 ] 11017 7.897% 94.819% ## ( 3, 4 ] 3908 2.801% 97.620% # ( 4, 6 ] 2502 1.794% 99.414% ( 6, 10 ] 676 0.485% 99.898% ( 10, 15 ] 104 0.075% 99.973% ( 15, 22 ] 21 0.015% 99.988% ( 22, 34 ] 3 0.002% 99.990% ( 110, 170 ] 4 0.003% 99.993% ( 170, 250 ] 6 0.004% 99.997% ( 250, 380 ] 3 0.002% 99.999% ( 380, 580 ] 4 0.003% 100.002% ( 580, 870 ] 2 0.001% 100.004% ( 870, 1300 ] 2 0.001% 100.005% ( 1300, 1900 ] 2 0.001% 100.006% ( 2900, 4400 ] 1 0.001% 100.007% ** Level 1 read latency histogram (micros): Count: 21848 Average: 2.5793 StdDev: 11.84 Min: 1 Median: 1.6669 Max: 1252 Percentiles: P50: 1.67 P75: 2.18 P99: 6.40 P99.9: 13.47 P99.99: 367.99 ------------------------------------------------------ [ 0, 1 ] 1342 6.142% 6.142% # ( 1, 2 ] 14368 65.763% 71.906% ############# ( 2, 3 ] 3740 17.118% 89.024% ### ( 3, 4 ] 1120 5.126% 94.150% # ( 4, 6 ] 1041 4.765% 98.915% # ( 6, 10 ] 186 0.851% 99.767% ( 10, 15 ] 42 0.192% 99.959% ( 15, 22 ] 4 0.018% 99.977% ( 22, 34 ] 1 0.005% 99.982% ( 250, 380 ] 2 0.009% 99.991% ( 870, 1300 ] 2 0.009% 100.000% ** Level 2 read latency histogram (micros): Count: 28143 Average: 2.4839 StdDev: 25.98 Min: 1 Median: 1.2401 Max: 2683 Percentiles: P50: 1.24 P75: 1.69 P99: 7.16 P99.9: 169.14 P99.99: 1124.93 ------------------------------------------------------ [ 0, 1 ] 10316 36.656% 36.656% ####### ( 1, 2 ] 15642 55.580% 92.236% ########### ( 2, 3 ] 1258 4.470% 96.706% # ( 3, 4 ] 412 1.464% 98.170% ( 4, 6 ] 180 0.640% 98.810% ( 6, 10 ] 185 0.657% 99.467% ( 10, 15 ] 60 0.213% 99.680% ( 15, 22 ] 8 0.028% 99.709% ( 22, 34 ] 2 0.007% 99.716% ( 51, 76 ] 18 0.064% 99.780% ( 76, 110 ] 24 0.085% 99.865% ( 110, 170 ] 10 0.036% 99.901% ( 170, 250 ] 13 0.046% 99.947% ( 250, 380 ] 6 0.021% 99.968% ( 380, 580 ] 2 0.007% 99.975% ( 580, 870 ] 3 0.011% 99.986% ( 870, 1300 ] 2 0.007% 99.993% ( 1900, 2900 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 42757 Average: 7.2314 StdDev: 140.35 Min: 1 Median: 1.6478 Max: 8551 Percentiles: P50: 1.65 P75: 2.15 P99: 10.80 P99.9: 730.87 P99.99: 5974.18 ------------------------------------------------------ [ 0, 1 ] 3475 8.127% 8.127% ## ( 1, 2 ] 27636 64.635% 72.762% ############# ( 2, 3 ] 6378 14.917% 87.679% ### ( 3, 4 ] 2266 5.300% 92.979% # ( 4, 6 ] 1770 4.140% 97.119% # ( 6, 10 ] 779 1.822% 98.941% ( 10, 15 ] 165 0.386% 99.326% ( 15, 22 ] 25 0.058% 99.385% ( 22, 34 ] 5 0.012% 99.397% ( 34, 51 ] 1 0.002% 99.399% ( 76, 110 ] 51 0.119% 99.518% ( 110, 170 ] 77 0.180% 99.698% ( 170, 250 ] 30 0.070% 99.768% ( 250, 380 ] 29 0.068% 99.836% ( 380, 580 ] 22 0.051% 99.888% ( 580, 870 ] 12 0.028% 99.916% ( 870, 1300 ] 11 0.026% 99.942% ( 1300, 1900 ] 6 0.014% 99.956% ( 1900, 2900 ] 5 0.012% 99.967% ( 2900, 4400 ] 5 0.012% 99.979% ( 4400, 6600 ] 8 0.019% 99.998% ( 6600, 9900 ] 8 0.019% 100.016% ** Level 4 read latency histogram (micros): Count: 30 Average: 4032.3333 StdDev: 2602.68 Min: 642 Median: 3650.0000 Max: 9950 Percentiles: P50: 3650.00 P75: 5912.50 P99: 9950.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 4 13.333% 16.667% ### ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 4 13.333% 43.333% ### ( 2900, 4400 ] 4 13.333% 56.667% ### ( 4400, 6600 ] 8 26.667% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 307.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.425 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.425 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/13-17:02:39 ... thread 0: (1000000,2000000) ops and (322610.7,328742.7) ops/second in (3.099711,6.083785) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.54 GB 25.2 0.8 0.0 0.8 2.6 1.8 0.0 1.4 95.1 314.6 8.61 7.90 29 0.297 831K 831 0.0 0.0 L1 1/1 2.04 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 244.1 243.9 1.03 1.00 1 1.032 255K 215 0.0 0.0 L2 1/1 120.93 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 78/34 995.34 MB 0.9 1.0 0.2 0.8 1.0 0.2 0.0 4.4 213.7 213.6 4.92 4.21 3 1.641 1068K 540 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/46 97.98 GB 0.0 2.2 0.5 1.7 4.0 2.3 0.4 2.2 148.4 273.8 15.05 13.57 34 0.443 2268K 1621 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 0.5 1.7 4.0 2.3 0.4 2.2 148.4 273.8 15.05 13.57 34 0.443 2268K 1621 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 0.5 1.7 2.2 0.5 0.0 0.0 232.8 232.6 9.60 8.76 8 1.200 2268K 1621 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 346.4 5.46 4.81 26 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.03 GB write, 654.03 MB/s write, 2.18 GB read, 354.46 MB/s read, 15.1 seconds Interval compaction: 4.03 GB write, 677.42 MB/s write, 2.18 GB read, 367.14 MB/s read, 15.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 419739 Average: 2.3185 StdDev: 13.26 Min: 1 Median: 1.5576 Max: 4323 Percentiles: P50: 1.56 P75: 1.94 P99: 5.82 P99.9: 11.42 P99.99: 15.56 ------------------------------------------------------ [ 0, 1 ] 56106 13.367% 13.367% ### ( 1, 2 ] 275740 65.693% 79.060% ############# ( 2, 3 ] 57038 13.589% 92.649% ### ( 3, 4 ] 16688 3.976% 96.625% # ( 4, 6 ] 10966 2.613% 99.237% # ( 6, 10 ] 2634 0.628% 99.865% ( 10, 15 ] 522 0.124% 99.989% ( 15, 22 ] 50 0.012% 100.001% ( 22, 34 ] 5 0.001% 100.002% ( 34, 51 ] 1 0.000% 100.003% ( 51, 76 ] 3 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.004% ( 110, 170 ] 7 0.002% 100.005% ( 170, 250 ] 13 0.003% 100.008% ( 250, 380 ] 7 0.002% 100.010% ( 380, 580 ] 8 0.002% 100.012% ( 580, 870 ] 10 0.002% 100.014% ( 870, 1300 ] 4 0.001% 100.015% ( 1300, 1900 ] 4 0.001% 100.016% ( 1900, 2900 ] 3 0.001% 100.017% ( 2900, 4400 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 50006 Average: 2.5326 StdDev: 7.87 Min: 1 Median: 1.7005 Max: 1252 Percentiles: P50: 1.70 P75: 2.29 P99: 5.97 P99.9: 12.80 P99.99: 22.00 ------------------------------------------------------ [ 0, 1 ] 2376 4.751% 4.751% # ( 1, 2 ] 32304 64.600% 69.352% ############# ( 2, 3 ] 9830 19.658% 89.009% #### ( 3, 4 ] 2657 5.313% 94.323% # ( 4, 6 ] 2376 4.751% 99.074% # ( 6, 10 ] 367 0.734% 99.808% ( 10, 15 ] 84 0.168% 99.976% ( 15, 22 ] 8 0.016% 99.992% ( 22, 34 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 2 0.004% 100.002% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 212033 Average: 3.7762 StdDev: 64.43 Min: 0 Median: 1.6100 Max: 8551 Percentiles: P50: 1.61 P75: 1.99 P99: 8.91 P99.9: 247.57 P99.99: 1368.29 ------------------------------------------------------ [ 0, 1 ] 20165 9.510% 9.510% ## ( 1, 2 ] 140750 66.381% 75.891% ############# ( 2, 3 ] 31021 14.630% 90.522% ### ( 3, 4 ] 9072 4.279% 94.800% # ( 4, 6 ] 6243 2.944% 97.745% # ( 6, 10 ] 3663 1.728% 99.472% ( 10, 15 ] 365 0.172% 99.644% ( 15, 22 ] 57 0.027% 99.671% ( 22, 34 ] 7 0.003% 99.675% ( 34, 51 ] 1 0.000% 99.675% ( 51, 76 ] 4 0.002% 99.677% ( 76, 110 ] 126 0.059% 99.736% ( 110, 170 ] 250 0.118% 99.854% ( 170, 250 ] 100 0.047% 99.901% ( 250, 380 ] 85 0.040% 99.942% ( 380, 580 ] 50 0.024% 99.965% ( 580, 870 ] 34 0.016% 99.981% ( 870, 1300 ] 18 0.008% 99.990% ( 1300, 1900 ] 7 0.003% 99.993% ( 1900, 2900 ] 5 0.002% 99.995% ( 2900, 4400 ] 5 0.002% 99.998% ( 4400, 6600 ] 8 0.004% 100.001% ( 6600, 9900 ] 8 0.004% 100.005% ** Level 4 read latency histogram (micros): Count: 30 Average: 4032.3333 StdDev: 2602.68 Min: 642 Median: 3650.0000 Max: 9950 Percentiles: P50: 3650.00 P75: 5912.50 P99: 9950.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 4 13.333% 16.667% ### ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 4 13.333% 43.333% ### ( 2900, 4400 ] 4 13.333% 56.667% ### ( 4400, 6600 ] 8 26.667% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.3 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 312.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.858 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.433 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-17:02:42 ... thread 0: (1000000,3000000) ops and (327016.0,328165.1) ops/second in (3.057954,9.141739) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 2.46 GB 113.3 1.9 0.0 1.9 4.7 2.8 0.0 1.7 124.2 304.3 15.72 14.61 46 0.342 1982K 2024 0.0 0.0 L1 1/1 2.04 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 244.1 243.9 1.03 1.00 1 1.032 255K 215 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 28/0 998.51 MB 1.0 1.2 0.4 0.9 1.2 0.4 0.0 3.5 214.2 214.1 5.94 5.16 4 1.484 1263K 540 0.0 0.0 L4 140/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1227/11 98.90 GB 0.0 3.5 0.6 2.9 6.3 3.4 0.5 2.3 154.7 276.9 23.18 21.23 52 0.446 3614K 2814 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 0.6 2.9 6.3 3.4 0.5 2.3 154.7 276.9 23.18 21.23 52 0.446 3614K 2814 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 0.6 2.9 3.5 0.6 0.0 0.0 239.2 239.0 15.00 13.99 13 1.154 3614K 2814 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 346.3 8.19 7.23 39 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.27 GB write, 685.78 MB/s write, 3.50 GB read, 383.28 MB/s read, 23.2 seconds Interval compaction: 6.27 GB write, 702.11 MB/s write, 3.50 GB read, 392.40 MB/s read, 23.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 838194 Average: 2.3295 StdDev: 11.03 Min: 1 Median: 1.5774 Max: 4323 Percentiles: P50: 1.58 P75: 1.95 P99: 5.80 P99.9: 11.09 P99.99: 14.54 ------------------------------------------------------ [ 0, 1 ] 94611 11.287% 11.287% ## ( 1, 2 ] 561963 67.045% 78.332% ############# ( 2, 3 ] 121304 14.472% 92.804% ### ( 3, 4 ] 32911 3.926% 96.730% # ( 4, 6 ] 21139 2.522% 99.252% # ( 6, 10 ] 5191 0.619% 99.872% ( 10, 15 ] 1093 0.130% 100.002% ( 15, 22 ] 95 0.011% 100.013% ( 22, 34 ] 18 0.002% 100.016% ( 34, 51 ] 5 0.001% 100.016% ( 51, 76 ] 8 0.001% 100.017% ( 76, 110 ] 19 0.002% 100.019% ( 110, 170 ] 16 0.002% 100.021% ( 170, 250 ] 24 0.003% 100.024% ( 250, 380 ] 12 0.001% 100.026% ( 380, 580 ] 17 0.002% 100.028% ( 580, 870 ] 20 0.002% 100.030% ( 870, 1300 ] 8 0.001% 100.031% ( 1300, 1900 ] 7 0.001% 100.032% ( 1900, 2900 ] 5 0.001% 100.032% ( 2900, 4400 ] 2 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 63404 Average: 2.5371 StdDev: 7.01 Min: 1 Median: 1.7138 Max: 1252 Percentiles: P50: 1.71 P75: 2.32 P99: 5.98 P99.9: 13.27 P99.99: 31.70 ------------------------------------------------------ [ 0, 1 ] 2775 4.377% 4.377% # ( 1, 2 ] 40527 63.919% 68.295% ############# ( 2, 3 ] 13151 20.742% 89.037% #### ( 3, 4 ] 3354 5.290% 94.327% # ( 4, 6 ] 2998 4.728% 99.055% # ( 6, 10 ] 465 0.733% 99.789% ( 10, 15 ] 108 0.170% 99.959% ( 15, 22 ] 14 0.022% 99.981% ( 22, 34 ] 7 0.011% 99.992% ( 34, 51 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.003% 99.997% ( 870, 1300 ] 2 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 231786 Average: 3.6715 StdDev: 61.64 Min: 0 Median: 1.6192 Max: 8551 Percentiles: P50: 1.62 P75: 2.00 P99: 8.80 P99.9: 234.33 P99.99: 1271.84 ------------------------------------------------------ [ 0, 1 ] 21016 9.067% 9.067% ## ( 1, 2 ] 153220 66.104% 75.171% ############# ( 2, 3 ] 35504 15.318% 90.489% ### ( 3, 4 ] 10043 4.333% 94.822% # ( 4, 6 ] 7017 3.027% 97.849% # ( 6, 10 ] 3807 1.642% 99.491% ( 10, 15 ] 410 0.177% 99.668% ( 15, 22 ] 66 0.028% 99.697% ( 22, 34 ] 9 0.004% 99.701% ( 34, 51 ] 1 0.000% 99.701% ( 51, 76 ] 4 0.002% 99.703% ( 76, 110 ] 126 0.054% 99.757% ( 110, 170 ] 250 0.108% 99.865% ( 170, 250 ] 101 0.044% 99.909% ( 250, 380 ] 87 0.038% 99.946% ( 380, 580 ] 51 0.022% 99.968% ( 580, 870 ] 34 0.015% 99.983% ( 870, 1300 ] 18 0.008% 99.991% ( 1300, 1900 ] 7 0.003% 99.994% ( 1900, 2900 ] 5 0.002% 99.996% ( 2900, 4400 ] 5 0.002% 99.998% ( 4400, 6600 ] 8 0.003% 100.001% ( 6600, 9900 ] 8 0.003% 100.005% ** Level 4 read latency histogram (micros): Count: 30 Average: 4032.3333 StdDev: 2602.68 Min: 642 Median: 3650.0000 Max: 9950 Percentiles: P50: 3650.00 P75: 5912.50 P99: 9950.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 4 13.333% 16.667% ### ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 4 13.333% 43.333% ### ( 2900, 4400 ] 4 13.333% 56.667% ### ( 4400, 6600 ] 8 26.667% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.4 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 315.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.261 H:M:S, 13.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.403 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-17:02:45 ... thread 0: (1000000,4000000) ops and (333854.0,329569.1) ops/second in (2.995321,12.137060) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/14 2.34 GB 6.3 2.5 0.0 2.5 6.1 3.7 0.0 1.7 122.3 305.5 20.61 19.17 61 0.338 2558K 2644 0.0 0.0 L1 9/9 1.04 GB 0.0 1.3 1.2 0.1 1.3 1.2 0.1 1.0 227.1 226.2 5.83 5.65 2 2.915 1344K 4787 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 28/0 998.51 MB 1.0 1.2 0.4 0.9 1.2 0.4 0.0 3.5 214.2 214.1 5.94 5.16 4 1.484 1263K 540 0.0 0.0 L4 140/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/23 99.82 GB 0.0 5.1 1.6 3.5 8.8 5.3 0.5 2.4 159.0 273.7 32.87 30.43 68 0.483 5279K 8006 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.6 3.5 8.8 5.3 0.5 2.4 159.0 273.7 32.87 30.43 68 0.483 5279K 8006 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.6 3.5 5.1 1.6 0.0 0.0 237.5 237.1 22.01 20.81 16 1.376 5279K 8006 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 347.9 10.86 9.62 52 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.79 GB write, 728.22 MB/s write, 5.10 GB read, 423.01 MB/s read, 32.9 seconds Interval compaction: 8.79 GB write, 741.28 MB/s write, 5.10 GB read, 430.60 MB/s read, 32.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1062282 Average: 2.3006 StdDev: 11.33 Min: 1 Median: 1.5493 Max: 4323 Percentiles: P50: 1.55 P75: 1.92 P99: 5.73 P99.9: 11.43 P99.99: 16.24 ------------------------------------------------------ [ 0, 1 ] 138877 13.073% 13.073% ### ( 1, 2 ] 714151 67.228% 80.301% ############# ( 2, 3 ] 140480 13.224% 93.526% ### ( 3, 4 ] 37724 3.551% 97.077% # ( 4, 6 ] 23609 2.222% 99.300% ( 6, 10 ] 6003 0.565% 99.865% ( 10, 15 ] 1314 0.124% 99.988% ( 15, 22 ] 106 0.010% 99.998% ( 22, 34 ] 21 0.002% 100.000% ( 34, 51 ] 8 0.001% 100.001% ( 51, 76 ] 9 0.001% 100.002% ( 76, 110 ] 59 0.006% 100.007% ( 110, 170 ] 67 0.006% 100.014% ( 170, 250 ] 41 0.004% 100.018% ( 250, 380 ] 28 0.003% 100.020% ( 380, 580 ] 28 0.003% 100.023% ( 580, 870 ] 29 0.003% 100.026% ( 870, 1300 ] 15 0.001% 100.027% ( 1300, 1900 ] 7 0.001% 100.028% ( 1900, 2900 ] 6 0.001% 100.028% ( 2900, 4400 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 89273 Average: 2.8166 StdDev: 17.97 Min: 0 Median: 1.6266 Max: 2074 Percentiles: P50: 1.63 P75: 2.06 P99: 7.30 P99.9: 128.03 P99.99: 877.82 ------------------------------------------------------ [ 0, 1 ] 8619 9.655% 9.655% ## ( 1, 2 ] 57484 64.391% 74.046% ############# ( 2, 3 ] 14849 16.633% 90.679% ### ( 3, 4 ] 3853 4.316% 94.995% # ( 4, 6 ] 3298 3.694% 98.689% # ( 6, 10 ] 856 0.959% 99.648% ( 10, 15 ] 139 0.156% 99.804% ( 15, 22 ] 18 0.020% 99.824% ( 22, 34 ] 7 0.008% 99.832% ( 34, 51 ] 1 0.001% 99.833% ( 76, 110 ] 45 0.050% 99.884% ( 110, 170 ] 49 0.055% 99.938% ( 170, 250 ] 11 0.012% 99.951% ( 250, 380 ] 10 0.011% 99.962% ( 380, 580 ] 21 0.024% 99.985% ( 580, 870 ] 4 0.004% 99.990% ( 870, 1300 ] 4 0.004% 99.994% ( 1300, 1900 ] 4 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 231786 Average: 3.6715 StdDev: 61.64 Min: 0 Median: 1.6192 Max: 8551 Percentiles: P50: 1.62 P75: 2.00 P99: 8.80 P99.9: 234.33 P99.99: 1271.84 ------------------------------------------------------ [ 0, 1 ] 21016 9.067% 9.067% ## ( 1, 2 ] 153220 66.104% 75.171% ############# ( 2, 3 ] 35504 15.318% 90.489% ### ( 3, 4 ] 10043 4.333% 94.822% # ( 4, 6 ] 7017 3.027% 97.849% # ( 6, 10 ] 3807 1.642% 99.491% ( 10, 15 ] 410 0.177% 99.668% ( 15, 22 ] 66 0.028% 99.697% ( 22, 34 ] 9 0.004% 99.701% ( 34, 51 ] 1 0.000% 99.701% ( 51, 76 ] 4 0.002% 99.703% ( 76, 110 ] 126 0.054% 99.757% ( 110, 170 ] 250 0.108% 99.865% ( 170, 250 ] 101 0.044% 99.909% ( 250, 380 ] 87 0.038% 99.946% ( 380, 580 ] 51 0.022% 99.968% ( 580, 870 ] 34 0.015% 99.983% ( 870, 1300 ] 18 0.008% 99.991% ( 1300, 1900 ] 7 0.003% 99.994% ( 1900, 2900 ] 5 0.002% 99.996% ( 2900, 4400 ] 5 0.002% 99.998% ( 4400, 6600 ] 8 0.003% 100.001% ( 6600, 9900 ] 8 0.003% 100.005% ** Level 4 read latency histogram (micros): Count: 30 Average: 4032.3333 StdDev: 2602.68 Min: 642 Median: 3650.0000 Max: 9950 Percentiles: P50: 3650.00 P75: 5912.50 P99: 9950.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 4 13.333% 16.667% ### ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 4 13.333% 43.333% ### ( 2900, 4400 ] 4 13.333% 56.667% ### ( 4400, 6600 ] 8 26.667% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.4 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 318.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.653 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.391 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-17:02:49 ... thread 0: (1000000,5000000) ops and (253378.1,310873.1) ops/second in (3.946671,16.083731) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.38 GB 144.8 3.6 0.0 3.6 8.3 4.7 0.0 1.8 130.3 303.1 28.04 26.17 80 0.351 3709K 3932 0.0 0.0 L1 9/9 1.04 GB 0.0 1.3 1.2 0.1 1.3 1.2 0.1 1.0 227.1 226.2 5.83 5.65 2 2.915 1344K 4787 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 28/0 998.51 MB 1.0 1.2 0.4 0.9 1.2 0.4 0.0 3.5 214.2 214.1 5.94 5.16 4 1.484 1263K 540 0.0 0.0 L4 140/0 9.65 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/19 100.86 GB 0.0 6.2 1.6 4.6 10.9 6.4 0.5 2.3 157.8 277.9 40.30 37.44 87 0.463 6430K 9294 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 1.6 4.6 10.9 6.4 0.5 2.3 157.8 277.9 40.30 37.44 87 0.463 6430K 9294 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 1.6 4.6 6.2 1.6 0.0 0.0 240.7 240.4 26.42 25.14 20 1.321 6430K 9294 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 349.5 13.88 12.31 67 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.3 total, 16.1 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.94 GB write, 687.09 MB/s write, 6.21 GB read, 390.16 MB/s read, 40.3 seconds Interval compaction: 10.94 GB write, 696.39 MB/s write, 6.21 GB read, 395.44 MB/s read, 40.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 21, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1468834 Average: 2.3063 StdDev: 10.78 Min: 1 Median: 1.5522 Max: 4323 Percentiles: P50: 1.55 P75: 1.92 P99: 5.72 P99.9: 11.59 P99.99: 18.01 ------------------------------------------------------ [ 0, 1 ] 186596 12.704% 12.704% ### ( 1, 2 ] 992114 67.544% 80.248% ############## ( 2, 3 ] 198169 13.492% 93.740% ### ( 3, 4 ] 50228 3.420% 97.159% # ( 4, 6 ] 31431 2.140% 99.299% ( 6, 10 ] 8241 0.561% 99.860% ( 10, 15 ] 1851 0.126% 99.986% ( 15, 22 ] 135 0.009% 99.995% ( 22, 34 ] 24 0.002% 99.997% ( 34, 51 ] 10 0.001% 99.998% ( 51, 76 ] 11 0.001% 99.998% ( 76, 110 ] 82 0.006% 100.004% ( 110, 170 ] 129 0.009% 100.013% ( 170, 250 ] 63 0.004% 100.017% ( 250, 380 ] 42 0.003% 100.020% ( 380, 580 ] 53 0.004% 100.023% ( 580, 870 ] 42 0.003% 100.026% ( 870, 1300 ] 19 0.001% 100.028% ( 1300, 1900 ] 10 0.001% 100.028% ( 1900, 2900 ] 7 0.000% 100.029% ( 2900, 4400 ] 3 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 164763 Average: 2.7727 StdDev: 14.95 Min: 0 Median: 1.6110 Max: 2074 Percentiles: P50: 1.61 P75: 1.99 P99: 8.12 P99.9: 136.50 P99.99: 598.98 ------------------------------------------------------ [ 0, 1 ] 16450 9.984% 9.984% ## ( 1, 2 ] 107914 65.497% 75.481% ############# ( 2, 3 ] 26602 16.146% 91.626% ### ( 3, 4 ] 5968 3.622% 95.248% # ( 4, 6 ] 5046 3.063% 98.311% # ( 6, 10 ] 2140 1.299% 99.610% ( 10, 15 ] 264 0.160% 99.770% ( 15, 22 ] 29 0.018% 99.788% ( 22, 34 ] 8 0.005% 99.792% ( 34, 51 ] 1 0.001% 99.793% ( 51, 76 ] 2 0.001% 99.794% ( 76, 110 ] 123 0.075% 99.869% ( 110, 170 ] 116 0.070% 99.939% ( 170, 250 ] 31 0.019% 99.958% ( 250, 380 ] 21 0.013% 99.971% ( 380, 580 ] 31 0.019% 99.990% ( 580, 870 ] 8 0.005% 99.995% ( 870, 1300 ] 4 0.002% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 231786 Average: 3.6715 StdDev: 61.64 Min: 0 Median: 1.6192 Max: 8551 Percentiles: P50: 1.62 P75: 2.00 P99: 8.80 P99.9: 234.33 P99.99: 1271.84 ------------------------------------------------------ [ 0, 1 ] 21016 9.067% 9.067% ## ( 1, 2 ] 153220 66.104% 75.171% ############# ( 2, 3 ] 35504 15.318% 90.489% ### ( 3, 4 ] 10043 4.333% 94.822% # ( 4, 6 ] 7017 3.027% 97.849% # ( 6, 10 ] 3807 1.642% 99.491% ( 10, 15 ] 410 0.177% 99.668% ( 15, 22 ] 66 0.028% 99.697% ( 22, 34 ] 9 0.004% 99.701% ( 34, 51 ] 1 0.000% 99.701% ( 51, 76 ] 4 0.002% 99.703% ( 76, 110 ] 126 0.054% 99.757% ( 110, 170 ] 250 0.108% 99.865% ( 170, 250 ] 101 0.044% 99.909% ( 250, 380 ] 87 0.038% 99.946% ( 380, 580 ] 51 0.022% 99.968% ( 580, 870 ] 34 0.015% 99.983% ( 870, 1300 ] 18 0.008% 99.991% ( 1300, 1900 ] 7 0.003% 99.994% ( 1900, 2900 ] 5 0.002% 99.996% ( 2900, 4400 ] 5 0.002% 99.998% ( 4400, 6600 ] 8 0.003% 100.001% ( 6600, 9900 ] 8 0.003% 100.005% ** Level 4 read latency histogram (micros): Count: 30 Average: 4032.3333 StdDev: 2602.68 Min: 642 Median: 3650.0000 Max: 9950 Percentiles: P50: 3650.00 P75: 5912.50 P99: 9950.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 4 13.333% 16.667% ### ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 4 13.333% 43.333% ### ( 2900, 4400 ] 4 13.333% 56.667% ### ( 4400, 6600 ] 8 26.667% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 16.3 total, 3.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 301.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.921 H:M:S, 17.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 249.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.269 H:M:S, 32.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/13-17:03:00 ... thread 0: (1000000,6000000) ops and (91962.2,222570.3) ops/second in (10.874038,26.957769) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 2.33 GB 213.1 5.7 0.0 5.7 11.4 5.6 0.0 2.0 145.8 289.8 40.16 36.92 98 0.410 5947K 13K 0.0 0.0 L1 6/0 279.59 MB 28.0 4.3 3.2 1.1 4.3 3.2 0.1 1.3 213.3 211.1 20.65 19.34 3 6.885 4473K 44K 0.0 0.0 L2 10/7 1.17 GB 2.9 0.1 0.1 0.0 0.1 0.1 2.9 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 18/4 1.37 GB 0.9 1.7 0.8 0.9 1.7 0.8 1.1 2.2 165.3 165.1 10.55 7.49 13 0.812 1703K 707 0.0 0.0 L4 151/9 9.49 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/24 101.74 GB 0.0 11.8 4.0 7.8 17.4 9.6 6.7 3.1 168.6 248.4 71.86 64.21 115 0.625 12M 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.8 4.0 7.8 17.4 9.6 6.7 3.1 168.6 248.4 71.86 64.21 115 0.625 12M 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.8 4.0 7.8 11.8 4.0 0.0 0.0 221.2 220.1 54.80 49.45 34 1.612 12M 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 339.6 17.07 14.77 81 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.2 total, 27.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.44 GB write, 656.94 MB/s write, 11.83 GB read, 445.91 MB/s read, 71.9 seconds Interval compaction: 17.44 GB write, 662.24 MB/s write, 11.83 GB read, 449.51 MB/s read, 71.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 26, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2381969 Average: 2.7803 StdDev: 17.84 Min: 1 Median: 1.5481 Max: 6205 Percentiles: P50: 1.55 P75: 1.92 P99: 7.01 P99.9: 146.91 P99.99: 289.67 ------------------------------------------------------ [ 0, 1 ] 310904 13.052% 13.052% ### ( 1, 2 ] 1605659 67.409% 80.461% ############# ( 2, 3 ] 307380 12.904% 93.366% ### ( 3, 4 ] 78528 3.297% 96.663% # ( 4, 6 ] 50960 2.139% 98.802% ( 6, 10 ] 18760 0.788% 99.589% ( 10, 15 ] 2719 0.114% 99.704% ( 15, 22 ] 260 0.011% 99.715% ( 22, 34 ] 29 0.001% 99.716% ( 34, 51 ] 14 0.001% 99.716% ( 51, 76 ] 18 0.001% 99.717% ( 76, 110 ] 2207 0.093% 99.810% ( 110, 170 ] 3497 0.147% 99.957% ( 170, 250 ] 662 0.028% 99.984% ( 250, 380 ] 445 0.019% 100.003% ( 380, 580 ] 331 0.014% 100.017% ( 580, 870 ] 164 0.007% 100.024% ( 870, 1300 ] 48 0.002% 100.026% ( 1300, 1900 ] 18 0.001% 100.027% ( 1900, 2900 ] 20 0.001% 100.027% ( 2900, 4400 ] 9 0.000% 100.028% ( 4400, 6600 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 529519 Average: 4.5475 StdDev: 74.69 Min: 0 Median: 1.7292 Max: 10740 Percentiles: P50: 1.73 P75: 2.45 P99: 9.07 P99.9: 155.60 P99.99: 385.82 ------------------------------------------------------ [ 0, 1 ] 39599 7.478% 7.478% # ( 1, 2 ] 308794 58.316% 65.794% ############ ( 2, 3 ] 107397 20.282% 86.076% #### ( 3, 4 ] 31555 5.959% 92.035% # ( 4, 6 ] 29706 5.610% 97.645% # ( 6, 10 ] 9357 1.767% 99.412% ( 10, 15 ] 1555 0.294% 99.706% ( 15, 22 ] 202 0.038% 99.744% ( 22, 34 ] 19 0.004% 99.748% ( 34, 51 ] 12 0.002% 99.750% ( 51, 76 ] 10 0.002% 99.752% ( 76, 110 ] 426 0.080% 99.832% ( 110, 170 ] 473 0.089% 99.922% ( 170, 250 ] 167 0.032% 99.953% ( 250, 380 ] 190 0.036% 99.989% ( 380, 580 ] 208 0.039% 100.029% ( 580, 870 ] 142 0.027% 100.055% ( 870, 1300 ] 95 0.018% 100.073% ( 1300, 1900 ] 36 0.007% 100.080% ( 1900, 2900 ] 31 0.006% 100.086% ( 2900, 4400 ] 45 0.008% 100.094% ( 4400, 6600 ] 23 0.004% 100.099% ( 6600, 9900 ] 17 0.003% 100.102% ( 9900, 14000 ] 1 0.000% 100.102% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 252671 Average: 6.0171 StdDev: 80.90 Min: 0 Median: 1.6422 Max: 8551 Percentiles: P50: 1.64 P75: 2.12 P99: 9.80 P99.9: 781.49 P99.99: 2110.22 ------------------------------------------------------ [ 0, 1 ] 21496 8.508% 8.508% ## ( 1, 2 ] 163259 64.613% 73.121% ############# ( 2, 3 ] 40618 16.075% 89.196% ### ( 3, 4 ] 12190 4.824% 94.021% # ( 4, 6 ] 8512 3.369% 97.389% # ( 6, 10 ] 4281 1.694% 99.084% ( 10, 15 ] 508 0.201% 99.285% ( 15, 22 ] 86 0.034% 99.319% ( 22, 34 ] 12 0.005% 99.324% ( 34, 51 ] 1 0.000% 99.324% ( 51, 76 ] 4 0.002% 99.326% ( 76, 110 ] 137 0.054% 99.380% ( 110, 170 ] 319 0.126% 99.506% ( 170, 250 ] 239 0.095% 99.601% ( 250, 380 ] 295 0.117% 99.717% ( 380, 580 ] 305 0.121% 99.838% ( 580, 870 ] 225 0.089% 99.927% ( 870, 1300 ] 110 0.044% 99.971% ( 1300, 1900 ] 46 0.018% 99.989% ( 1900, 2900 ] 13 0.005% 99.994% ( 2900, 4400 ] 18 0.007% 100.001% ( 4400, 6600 ] 12 0.005% 100.006% ( 6600, 9900 ] 10 0.004% 100.010% ** Level 4 read latency histogram (micros): Count: 30 Average: 4032.3333 StdDev: 2602.68 Min: 642 Median: 3650.0000 Max: 9950 Percentiles: P50: 3650.00 P75: 5912.50 P99: 9950.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 4 13.333% 16.667% ### ( 1300, 1900 ] 4 13.333% 30.000% ### ( 1900, 2900 ] 4 13.333% 43.333% ### ( 2900, 4400 ] 4 13.333% 56.667% ### ( 4400, 6600 ] 8 26.667% 83.333% ##### ( 6600, 9900 ] 4 13.333% 96.667% ### ( 9900, 14000 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 1467.1250 StdDev: 1395.88 Min: 162 Median: 992.8571 Max: 6175 Percentiles: P50: 992.86 P75: 2000.00 P99: 6175.00 P99.9: 6175.00 P99.99: 6175.00 ------------------------------------------------------ ( 110, 170 ] 1 1.250% 1.250% ( 170, 250 ] 4 5.000% 6.250% # ( 250, 380 ] 11 13.750% 20.000% ### ( 380, 580 ] 12 15.000% 35.000% ### ( 580, 870 ] 8 10.000% 45.000% ## ( 870, 1300 ] 14 17.500% 62.500% #### ( 1300, 1900 ] 9 11.250% 73.750% ## ( 1900, 2900 ] 10 12.500% 86.250% ### ( 2900, 4400 ] 6 7.500% 93.750% ## ( 4400, 6600 ] 5 6.250% 100.000% # ** DB Stats ** Uptime(secs): 27.2 total, 10.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 217.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.744 H:M:S, 39.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 90.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.823 H:M:S, 71.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/13-17:03:03 ... thread 0: (1000000,7000000) ops and (298455.9,230959.5) ops/second in (3.350579,30.308348) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/11 3.31 GB 63.0 6.2 0.0 6.2 12.8 6.6 0.0 1.9 140.2 289.9 45.37 41.52 113 0.401 6459K 14K 0.0 0.0 L1 6/6 279.59 MB 0.0 4.3 3.2 1.1 4.3 3.2 0.1 1.3 213.3 211.1 20.65 19.34 3 6.885 4473K 44K 0.0 0.0 L2 10/7 1.17 GB 2.9 0.1 0.1 0.0 0.1 0.1 2.9 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 15/1 1020.02 MB 0.9 1.7 0.8 0.9 1.7 0.8 1.1 2.2 165.3 165.1 10.55 7.49 13 0.812 1703K 707 0.0 0.0 L4 150/0 9.50 GB 1.0 0.4 0.4 0.0 0.4 0.4 1.2 1.1 158.1 157.7 2.73 2.05 3 0.909 437K 1304 0.0 0.0 L5 1064/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/25 102.72 GB 0.0 12.7 4.4 8.3 19.3 11.0 7.1 2.9 163.6 248.1 79.80 70.86 133 0.600 13M 60K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.7 4.4 8.3 19.3 11.0 7.1 2.9 163.6 248.1 79.80 70.86 133 0.600 13M 60K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.7 4.4 8.3 12.7 4.3 0.0 0.0 218.9 217.9 59.63 53.48 39 1.529 13M 60K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 337.3 20.17 17.39 94 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.5 total, 30.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.33 GB write, 648.43 MB/s write, 12.75 GB read, 427.61 MB/s read, 79.8 seconds Interval compaction: 19.33 GB write, 653.08 MB/s write, 12.75 GB read, 430.68 MB/s read, 79.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 33, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2664808 Average: 2.7743 StdDev: 17.56 Min: 1 Median: 1.5640 Max: 6205 Percentiles: P50: 1.56 P75: 1.94 P99: 7.13 P99.9: 143.35 P99.99: 277.04 ------------------------------------------------------ [ 0, 1 ] 325450 12.213% 12.213% ## ( 1, 2 ] 1785236 66.993% 79.206% ############# ( 2, 3 ] 366865 13.767% 92.973% ### ( 3, 4 ] 91667 3.440% 96.413% # ( 4, 6 ] 62594 2.349% 98.762% ( 6, 10 ] 22485 0.844% 99.606% ( 10, 15 ] 3236 0.121% 99.727% ( 15, 22 ] 317 0.012% 99.739% ( 22, 34 ] 32 0.001% 99.740% ( 34, 51 ] 16 0.001% 99.741% ( 51, 76 ] 20 0.001% 99.741% ( 76, 110 ] 2227 0.084% 99.825% ( 110, 170 ] 3595 0.135% 99.960% ( 170, 250 ] 705 0.026% 99.986% ( 250, 380 ] 464 0.017% 100.004% ( 380, 580 ] 352 0.013% 100.017% ( 580, 870 ] 174 0.007% 100.024% ( 870, 1300 ] 54 0.002% 100.026% ( 1300, 1900 ] 20 0.001% 100.026% ( 1900, 2900 ] 22 0.001% 100.027% ( 2900, 4400 ] 11 0.000% 100.028% ( 4400, 6600 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 744907 Average: 4.1290 StdDev: 63.57 Min: 0 Median: 1.7419 Max: 10740 Percentiles: P50: 1.74 P75: 2.46 P99: 8.99 P99.9: 142.02 P99.99: 337.77 ------------------------------------------------------ [ 0, 1 ] 47998 6.443% 6.443% # ( 1, 2 ] 437317 58.708% 65.151% ############ ( 2, 3 ] 157909 21.198% 86.350% #### ( 3, 4 ] 43027 5.776% 92.126% # ( 4, 6 ] 40730 5.468% 97.594% # ( 6, 10 ] 14037 1.884% 99.478% ( 10, 15 ] 2015 0.271% 99.748% ( 15, 22 ] 254 0.034% 99.783% ( 22, 34 ] 22 0.003% 99.785% ( 34, 51 ] 13 0.002% 99.787% ( 51, 76 ] 11 0.001% 99.789% ( 76, 110 ] 519 0.070% 99.858% ( 110, 170 ] 581 0.078% 99.936% ( 170, 250 ] 226 0.030% 99.967% ( 250, 380 ] 257 0.035% 100.001% ( 380, 580 ] 257 0.035% 100.036% ( 580, 870 ] 156 0.021% 100.057% ( 870, 1300 ] 101 0.014% 100.070% ( 1300, 1900 ] 38 0.005% 100.075% ( 1900, 2900 ] 32 0.004% 100.080% ( 2900, 4400 ] 46 0.006% 100.086% ( 4400, 6600 ] 23 0.003% 100.089% ( 6600, 9900 ] 17 0.002% 100.091% ( 9900, 14000 ] 1 0.000% 100.091% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 275707 Average: 6.1588 StdDev: 80.02 Min: 0 Median: 1.6494 Max: 8551 Percentiles: P50: 1.65 P75: 2.15 P99: 9.85 P99.9: 802.15 P99.99: 2114.33 ------------------------------------------------------ [ 0, 1 ] 22744 8.249% 8.249% ## ( 1, 2 ] 177262 64.294% 72.543% ############# ( 2, 3 ] 45488 16.499% 89.042% ### ( 3, 4 ] 13455 4.880% 93.922% # ( 4, 6 ] 9463 3.432% 97.354% # ( 6, 10 ] 4718 1.711% 99.065% ( 10, 15 ] 548 0.199% 99.264% ( 15, 22 ] 94 0.034% 99.298% ( 22, 34 ] 13 0.005% 99.303% ( 34, 51 ] 1 0.000% 99.303% ( 51, 76 ] 4 0.001% 99.305% ( 76, 110 ] 142 0.052% 99.356% ( 110, 170 ] 338 0.123% 99.479% ( 170, 250 ] 261 0.095% 99.573% ( 250, 380 ] 337 0.122% 99.696% ( 380, 580 ] 359 0.130% 99.826% ( 580, 870 ] 268 0.097% 99.923% ( 870, 1300 ] 126 0.046% 99.969% ( 1300, 1900 ] 56 0.020% 99.989% ( 1900, 2900 ] 16 0.006% 99.995% ( 2900, 4400 ] 19 0.007% 100.002% ( 4400, 6600 ] 12 0.004% 100.006% ( 6600, 9900 ] 10 0.004% 100.010% ** Level 4 read latency histogram (micros): Count: 90 Average: 1449.7333 StdDev: 2386.76 Min: 1 Median: 155.0000 Max: 9950 Percentiles: P50: 155.00 P75: 1840.00 P99: 9950.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ [ 0, 1 ] 7 7.778% 7.778% ## ( 1, 2 ] 17 18.889% 26.667% #### ( 2, 3 ] 11 12.222% 38.889% ## ( 3, 4 ] 3 3.333% 42.222% # ( 6, 10 ] 3 3.333% 45.556% # ( 15, 22 ] 1 1.111% 46.667% ( 110, 170 ] 4 4.444% 51.111% # ( 170, 250 ] 2 2.222% 53.333% ( 250, 380 ] 4 4.444% 57.778% # ( 380, 580 ] 4 4.444% 62.222% # ( 580, 870 ] 3 3.333% 65.556% # ( 870, 1300 ] 4 4.444% 70.000% # ( 1300, 1900 ] 5 5.556% 75.556% # ( 1900, 2900 ] 5 5.556% 81.111% # ( 2900, 4400 ] 4 4.444% 85.556% # ( 4400, 6600 ] 8 8.889% 94.444% ## ( 6600, 9900 ] 4 4.444% 98.889% # ( 9900, 14000 ] 1 1.111% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1342.1700 StdDev: 1352.37 Min: 119 Median: 841.0000 Max: 6175 Percentiles: P50: 841.00 P75: 1845.45 P99: 6160.00 P99.9: 6175.00 P99.99: 6175.00 ------------------------------------------------------ ( 110, 170 ] 7 7.000% 7.000% # ( 170, 250 ] 6 6.000% 13.000% # ( 250, 380 ] 14 14.000% 27.000% ### ( 380, 580 ] 14 14.000% 41.000% ### ( 580, 870 ] 10 10.000% 51.000% ## ( 870, 1300 ] 14 14.000% 65.000% ### ( 1300, 1900 ] 11 11.000% 76.000% ## ( 1900, 2900 ] 11 11.000% 87.000% ## ( 2900, 4400 ] 8 8.000% 95.000% ## ( 4400, 6600 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 30.5 total, 3.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 225.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.463 H:M:S, 37.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.719 H:M:S, 21.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-17:03:07 ... thread 0: (1000000,8000000) ops and (276624.6,235825.7) ops/second in (3.615007,33.923355) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.23 GB 151.1 7.0 0.0 7.0 14.5 7.6 0.0 1.9 138.9 289.8 51.24 46.99 129 0.397 7226K 14K 0.0 0.0 L1 6/6 279.59 MB 0.0 4.3 3.2 1.1 4.3 3.2 0.1 1.3 213.3 211.1 20.65 19.34 3 6.885 4473K 44K 0.0 0.0 L2 1/0 35.80 MB 0.4 0.1 0.1 0.0 0.1 0.1 2.9 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 13/0 971.38 MB 1.0 3.0 1.9 1.1 3.0 1.9 1.1 1.6 179.3 179.0 17.26 13.46 16 1.079 3050K 3598 0.0 0.0 L4 164/0 9.69 GB 1.0 0.6 0.6 0.0 0.6 0.6 2.2 1.1 170.6 170.2 3.75 3.00 5 0.751 647K 1304 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1279/17 103.64 GB 0.0 15.0 5.7 9.3 22.5 13.2 9.0 3.0 164.5 246.8 93.40 83.25 154 0.607 15M 64K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.0 5.7 9.3 22.5 13.2 9.0 3.0 164.5 246.8 93.40 83.25 154 0.607 15M 64K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.0 5.7 9.3 14.9 5.7 0.0 0.0 218.1 217.2 70.45 63.42 47 1.499 15M 64K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 337.7 22.95 19.83 107 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.1 total, 33.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.51 GB write, 675.13 MB/s write, 15.01 GB read, 450.15 MB/s read, 93.4 seconds Interval compaction: 22.51 GB write, 679.46 MB/s write, 15.01 GB read, 453.04 MB/s read, 93.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 39, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3035357 Average: 2.7684 StdDev: 17.13 Min: 1 Median: 1.5780 Max: 6205 Percentiles: P50: 1.58 P75: 1.95 P99: 7.21 P99.9: 139.44 P99.99: 271.78 ------------------------------------------------------ [ 0, 1 ] 349563 11.516% 11.516% ## ( 1, 2 ] 2020797 66.575% 78.092% ############# ( 2, 3 ] 439974 14.495% 92.587% ### ( 3, 4 ] 108954 3.589% 96.176% # ( 4, 6 ] 77549 2.555% 98.731% # ( 6, 10 ] 27013 0.890% 99.621% ( 10, 15 ] 3911 0.129% 99.750% ( 15, 22 ] 400 0.013% 99.763% ( 22, 34 ] 35 0.001% 99.764% ( 34, 51 ] 18 0.001% 99.765% ( 51, 76 ] 21 0.001% 99.765% ( 76, 110 ] 2278 0.075% 99.840% ( 110, 170 ] 3688 0.122% 99.962% ( 170, 250 ] 767 0.025% 99.987% ( 250, 380 ] 516 0.017% 100.004% ( 380, 580 ] 392 0.013% 100.017% ( 580, 870 ] 194 0.006% 100.023% ( 870, 1300 ] 63 0.002% 100.026% ( 1300, 1900 ] 25 0.001% 100.026% ( 1900, 2900 ] 25 0.001% 100.027% ( 2900, 4400 ] 11 0.000% 100.028% ( 4400, 6600 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 835033 Average: 4.0230 StdDev: 60.36 Min: 0 Median: 1.7409 Max: 10740 Percentiles: P50: 1.74 P75: 2.45 P99: 8.96 P99.9: 144.65 P99.99: 360.23 ------------------------------------------------------ [ 0, 1 ] 51262 6.139% 6.139% # ( 1, 2 ] 494365 59.203% 65.342% ############ ( 2, 3 ] 177391 21.244% 86.586% #### ( 3, 4 ] 47243 5.658% 92.243% # ( 4, 6 ] 44623 5.344% 97.587% # ( 6, 10 ] 15924 1.907% 99.494% ( 10, 15 ] 2186 0.262% 99.756% ( 15, 22 ] 269 0.032% 99.788% ( 22, 34 ] 28 0.003% 99.791% ( 34, 51 ] 14 0.002% 99.793% ( 51, 76 ] 12 0.001% 99.794% ( 76, 110 ] 527 0.063% 99.858% ( 110, 170 ] 613 0.073% 99.931% ( 170, 250 ] 250 0.030% 99.961% ( 250, 380 ] 286 0.034% 99.995% ( 380, 580 ] 283 0.034% 100.029% ( 580, 870 ] 167 0.020% 100.049% ( 870, 1300 ] 111 0.013% 100.062% ( 1300, 1900 ] 40 0.005% 100.067% ( 1900, 2900 ] 32 0.004% 100.071% ( 2900, 4400 ] 46 0.006% 100.077% ( 4400, 6600 ] 23 0.003% 100.079% ( 6600, 9900 ] 17 0.002% 100.081% ( 9900, 14000 ] 1 0.000% 100.081% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 356259 Average: 5.4950 StdDev: 70.91 Min: 0 Median: 1.6794 Max: 8551 Percentiles: P50: 1.68 P75: 2.26 P99: 9.58 P99.9: 711.17 P99.99: 1686.63 ------------------------------------------------------ [ 0, 1 ] 24855 6.977% 6.977% # ( 1, 2 ] 225608 63.327% 70.304% ############# ( 2, 3 ] 65119 18.279% 88.582% #### ( 3, 4 ] 18243 5.121% 93.703% # ( 4, 6 ] 13757 3.862% 97.564% # ( 6, 10 ] 5711 1.603% 99.167% ( 10, 15 ] 747 0.210% 99.377% ( 15, 22 ] 113 0.032% 99.409% ( 22, 34 ] 15 0.004% 99.413% ( 34, 51 ] 2 0.001% 99.414% ( 51, 76 ] 4 0.001% 99.415% ( 76, 110 ] 194 0.054% 99.469% ( 110, 170 ] 372 0.104% 99.574% ( 170, 250 ] 300 0.084% 99.658% ( 250, 380 ] 356 0.100% 99.758% ( 380, 580 ] 381 0.107% 99.865% ( 580, 870 ] 278 0.078% 99.943% ( 870, 1300 ] 131 0.037% 99.980% ( 1300, 1900 ] 58 0.016% 99.996% ( 1900, 2900 ] 16 0.004% 100.000% ( 2900, 4400 ] 19 0.005% 100.006% ( 4400, 6600 ] 12 0.003% 100.009% ( 6600, 9900 ] 10 0.003% 100.012% ** Level 4 read latency histogram (micros): Count: 120 Average: 1115.8083 StdDev: 2148.98 Min: 1 Median: 8.6667 Max: 9950 Percentiles: P50: 8.67 P75: 977.50 P99: 9735.00 P99.9: 9950.00 P99.99: 9950.00 ------------------------------------------------------ [ 0, 1 ] 8 6.667% 6.667% # ( 1, 2 ] 32 26.667% 33.333% ##### ( 2, 3 ] 13 10.833% 44.167% ## ( 3, 4 ] 4 3.333% 47.500% # ( 4, 6 ] 1 0.833% 48.333% ( 6, 10 ] 3 2.500% 50.833% # ( 15, 22 ] 1 0.833% 51.667% ( 34, 51 ] 1 0.833% 52.500% ( 110, 170 ] 5 4.167% 56.667% # ( 170, 250 ] 5 4.167% 60.833% # ( 250, 380 ] 6 5.000% 65.833% # ( 380, 580 ] 5 4.167% 70.000% # ( 580, 870 ] 5 4.167% 74.167% # ( 870, 1300 ] 4 3.333% 77.500% # ( 1300, 1900 ] 5 4.167% 81.667% # ( 1900, 2900 ] 5 4.167% 85.833% # ( 2900, 4400 ] 4 3.333% 89.167% # ( 4400, 6600 ] 8 6.667% 95.833% # ( 6600, 9900 ] 4 3.333% 99.167% # ( 9900, 14000 ] 1 0.833% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1253.9688 StdDev: 1368.57 Min: 93 Median: 669.2308 Max: 6419 Percentiles: P50: 669.23 P75: 1700.00 P99: 6160.00 P99.9: 6419.00 P99.99: 6419.00 ------------------------------------------------------ ( 76, 110 ] 2 1.250% 1.250% ( 110, 170 ] 15 9.375% 10.625% ## ( 170, 250 ] 12 7.500% 18.125% ## ( 250, 380 ] 28 17.500% 35.625% #### ( 380, 580 ] 19 11.875% 47.500% ## ( 580, 870 ] 13 8.125% 55.625% ## ( 870, 1300 ] 21 13.125% 68.750% ### ( 1300, 1900 ] 15 9.375% 78.125% ## ( 1900, 2900 ] 14 8.750% 86.875% ## ( 2900, 4400 ] 13 8.125% 95.000% ## ( 4400, 6600 ] 8 5.000% 100.000% # ** DB Stats ** Uptime(secs): 34.1 total, 3.6 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 230.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.435 H:M:S, 36.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.972 H:M:S, 26.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-17:03:17 ... thread 0: (1000000,9000000) ops and (98622.4,204252.8) ops/second in (10.139689,44.063044) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 2.70 GB 6.3 9.1 0.0 9.1 17.6 8.5 0.0 2.1 138.5 267.3 67.31 58.18 146 0.461 9464K 23K 0.0 0.0 L1 4/4 439.40 MB 0.0 7.0 5.6 1.4 7.0 5.6 0.1 1.2 215.5 213.3 33.38 31.39 4 8.345 7020K 44K 0.0 0.0 L2 2/1 257.56 MB 1.3 0.1 0.1 0.0 0.1 0.1 5.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 34/12 2.06 GB 1.4 4.6 2.8 1.8 4.6 2.8 2.3 1.6 150.1 149.7 31.26 21.12 23 1.359 4674K 12K 0.0 0.0 L4 176/16 10.61 GB 1.0 1.8 1.5 0.3 1.8 1.5 2.2 1.2 135.3 134.7 13.98 8.97 16 0.874 1917K 8037 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/42 104.51 GB 0.0 22.7 10.0 12.7 31.0 18.4 12.5 3.7 158.5 217.1 146.42 120.12 190 0.771 23M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.7 10.0 12.7 31.0 18.4 12.5 3.7 158.5 217.1 146.42 120.12 190 0.771 23M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.7 10.0 12.7 22.5 9.9 0.0 0.0 195.7 194.7 118.61 97.69 70 1.694 23M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 312.6 27.81 22.43 120 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.3 total, 44.1 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.04 GB write, 717.77 MB/s write, 22.67 GB read, 524.14 MB/s read, 146.4 seconds Interval compaction: 31.04 GB write, 721.32 MB/s write, 22.67 GB read, 526.73 MB/s read, 146.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 57, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3869971 Average: 2.9555 StdDev: 25.54 Min: 1 Median: 1.5866 Max: 7786 Percentiles: P50: 1.59 P75: 1.96 P99: 7.68 P99.9: 147.02 P99.99: 366.85 ------------------------------------------------------ [ 0, 1 ] 431136 11.141% 11.141% ## ( 1, 2 ] 2563713 66.246% 77.387% ############# ( 2, 3 ] 567583 14.666% 92.053% ### ( 3, 4 ] 144570 3.736% 95.789% # ( 4, 6 ] 107902 2.788% 98.577% # ( 6, 10 ] 39009 1.008% 99.585% ( 10, 15 ] 5510 0.142% 99.727% ( 15, 22 ] 552 0.014% 99.742% ( 22, 34 ] 47 0.001% 99.743% ( 34, 51 ] 21 0.001% 99.743% ( 51, 76 ] 24 0.001% 99.744% ( 76, 110 ] 3073 0.079% 99.823% ( 110, 170 ] 4801 0.124% 99.948% ( 170, 250 ] 1022 0.026% 99.974% ( 250, 380 ] 692 0.018% 99.992% ( 380, 580 ] 589 0.015% 100.007% ( 580, 870 ] 356 0.009% 100.016% ( 870, 1300 ] 183 0.005% 100.021% ( 1300, 1900 ] 86 0.002% 100.023% ( 1900, 2900 ] 62 0.002% 100.025% ( 2900, 4400 ] 47 0.001% 100.026% ( 4400, 6600 ] 16 0.000% 100.026% ( 6600, 9900 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1408837 Average: 5.0177 StdDev: 72.06 Min: 0 Median: 1.8437 Max: 10740 Percentiles: P50: 1.84 P75: 2.70 P99: 9.36 P99.9: 138.37 P99.99: 344.26 ------------------------------------------------------ [ 0, 1 ] 61771 4.385% 4.385% # ( 1, 2 ] 761697 54.066% 58.450% ########### ( 2, 3 ] 335160 23.790% 82.240% ##### ( 3, 4 ] 103360 7.337% 89.577% # ( 4, 6 ] 104922 7.447% 97.024% # ( 6, 10 ] 33119 2.351% 99.375% ( 10, 15 ] 5439 0.386% 99.761% ( 15, 22 ] 689 0.049% 99.810% ( 22, 34 ] 59 0.004% 99.814% ( 34, 51 ] 21 0.001% 99.815% ( 51, 76 ] 21 0.001% 99.817% ( 76, 110 ] 755 0.054% 99.871% ( 110, 170 ] 878 0.062% 99.933% ( 170, 250 ] 423 0.030% 99.963% ( 250, 380 ] 527 0.037% 100.000% ( 380, 580 ] 571 0.041% 100.041% ( 580, 870 ] 474 0.034% 100.074% ( 870, 1300 ] 361 0.026% 100.100% ( 1300, 1900 ] 164 0.012% 100.112% ( 1900, 2900 ] 176 0.012% 100.124% ( 2900, 4400 ] 197 0.014% 100.138% ( 4400, 6600 ] 37 0.003% 100.141% ( 6600, 9900 ] 25 0.002% 100.143% ( 9900, 14000 ] 1 0.000% 100.143% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 716594 Average: 6.6033 StdDev: 85.75 Min: 0 Median: 1.8705 Max: 9186 Percentiles: P50: 1.87 P75: 2.75 P99: 9.64 P99.9: 529.39 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 27012 3.769% 3.769% # ( 1, 2 ] 380551 53.106% 56.875% ########### ( 2, 3 ] 174308 24.325% 81.200% ##### ( 3, 4 ] 57702 8.052% 89.252% ## ( 4, 6 ] 57077 7.965% 97.217% ## ( 6, 10 ] 14037 1.959% 99.176% ( 10, 15 ] 2734 0.382% 99.557% ( 15, 22 ] 316 0.044% 99.601% ( 22, 34 ] 28 0.004% 99.605% ( 34, 51 ] 8 0.001% 99.606% ( 51, 76 ] 10 0.001% 99.608% ( 76, 110 ] 204 0.028% 99.636% ( 110, 170 ] 420 0.059% 99.695% ( 170, 250 ] 400 0.056% 99.751% ( 250, 380 ] 558 0.078% 99.828% ( 380, 580 ] 686 0.096% 99.924% ( 580, 870 ] 622 0.087% 100.011% ( 870, 1300 ] 374 0.052% 100.063% ( 1300, 1900 ] 181 0.025% 100.088% ( 1900, 2900 ] 121 0.017% 100.105% ( 2900, 4400 ] 114 0.016% 100.121% ( 4400, 6600 ] 35 0.005% 100.126% ( 6600, 9900 ] 15 0.002% 100.128% ** Level 4 read latency histogram (micros): Count: 64222 Average: 17.5880 StdDev: 199.94 Min: 1 Median: 2.2547 Max: 9950 Percentiles: P50: 2.25 P75: 3.22 P99: 20.49 P99.9: 2673.67 P99.99: 3905.39 ------------------------------------------------------ [ 0, 1 ] 299 0.466% 0.466% ( 1, 2 ] 26853 41.813% 42.278% ######## ( 2, 3 ] 19469 30.315% 72.594% ###### ( 3, 4 ] 6954 10.828% 83.422% ## ( 4, 6 ] 7721 12.022% 95.444% ## ( 6, 10 ] 1835 2.857% 98.301% # ( 10, 15 ] 419 0.652% 98.954% ( 15, 22 ] 38 0.059% 99.013% ( 22, 34 ] 6 0.009% 99.022% ( 34, 51 ] 7 0.011% 99.033% ( 51, 76 ] 6 0.009% 99.042% ( 76, 110 ] 4 0.006% 99.049% ( 110, 170 ] 13 0.020% 99.069% ( 170, 250 ] 37 0.058% 99.126% ( 250, 380 ] 47 0.073% 99.200% ( 380, 580 ] 94 0.146% 99.346% ( 580, 870 ] 130 0.202% 99.548% ( 870, 1300 ] 104 0.162% 99.710% ( 1300, 1900 ] 80 0.125% 99.835% ( 1900, 2900 ] 54 0.084% 99.919% ( 2900, 4400 ] 68 0.106% 100.025% ( 4400, 6600 ] 20 0.031% 100.056% ( 6600, 9900 ] 6 0.009% 100.065% ( 9900, 14000 ] 1 0.002% 100.067% ** Level 5 read latency histogram (micros): Count: 160 Average: 1253.9688 StdDev: 1368.57 Min: 93 Median: 669.2308 Max: 6419 Percentiles: P50: 669.23 P75: 1700.00 P99: 6160.00 P99.9: 6419.00 P99.99: 6419.00 ------------------------------------------------------ ( 76, 110 ] 2 1.250% 1.250% ( 110, 170 ] 15 9.375% 10.625% ## ( 170, 250 ] 12 7.500% 18.125% ## ( 250, 380 ] 28 17.500% 35.625% #### ( 380, 580 ] 19 11.875% 47.500% ## ( 580, 870 ] 13 8.125% 55.625% ## ( 870, 1300 ] 21 13.125% 68.750% ### ( 1300, 1900 ] 15 9.375% 78.125% ## ( 1900, 2900 ] 14 8.750% 86.875% ## ( 2900, 4400 ] 13 8.125% 95.000% ## ( 4400, 6600 ] 8 5.000% 100.000% # ** DB Stats ** Uptime(secs): 44.3 total, 10.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 200.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.560 H:M:S, 44.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 97.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.125 H:M:S, 70.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/13-17:03:22 ... thread 0: (1000000,10000000) ops and (226234.2,206256.8) ops/second in (4.420198,48.483242) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 3.74 GB 88.1 9.7 0.0 9.7 19.2 9.5 0.0 2.0 134.4 265.9 74.05 63.51 161 0.460 10M 24K 0.0 0.0 L1 4/4 439.40 MB 0.0 7.0 5.6 1.4 7.0 5.6 0.1 1.2 215.5 213.3 33.38 31.39 4 8.345 7020K 44K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 17/0 991.51 MB 1.0 4.9 2.9 2.0 4.9 2.9 2.4 1.7 150.4 149.8 33.49 22.72 24 1.396 5022K 16K 0.0 0.0 L4 164/0 9.64 GB 1.0 4.5 2.9 1.6 4.4 2.8 2.2 1.5 138.3 137.1 32.96 21.47 34 0.969 4626K 38K 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/17 105.52 GB 0.0 26.2 11.5 14.8 35.6 20.9 14.9 3.7 154.0 209.1 174.37 139.55 224 0.778 26M 124K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.2 11.5 14.8 35.6 20.9 14.9 3.7 154.0 209.1 174.37 139.55 224 0.778 26M 124K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.2 11.5 14.8 26.1 11.3 0.0 0.0 188.6 187.5 142.34 114.24 91 1.564 26M 124K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 304.9 32.03 25.31 133 0.241 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.7 total, 48.5 interval Flush(GB): cumulative 9.535, interval 9.535 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.61 GB write, 748.63 MB/s write, 26.22 GB read, 551.30 MB/s read, 174.4 seconds Interval compaction: 35.61 GB write, 751.99 MB/s write, 26.22 GB read, 553.77 MB/s read, 174.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 76, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 76, interval: 98 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4271533 Average: 3.0069 StdDev: 27.71 Min: 1 Median: 1.6007 Max: 7786 Percentiles: P50: 1.60 P75: 1.98 P99: 7.78 P99.9: 144.70 P99.99: 369.81 ------------------------------------------------------ [ 0, 1 ] 454321 10.636% 10.636% ## ( 1, 2 ] 2799345 65.535% 76.171% ############# ( 2, 3 ] 657025 15.381% 91.552% ### ( 3, 4 ] 167305 3.917% 95.469% # ( 4, 6 ] 130676 3.059% 98.528% # ( 6, 10 ] 45367 1.062% 99.590% ( 10, 15 ] 6498 0.152% 99.743% ( 15, 22 ] 650 0.015% 99.758% ( 22, 34 ] 65 0.002% 99.759% ( 34, 51 ] 29 0.001% 99.760% ( 51, 76 ] 28 0.001% 99.761% ( 76, 110 ] 3128 0.073% 99.834% ( 110, 170 ] 4885 0.114% 99.948% ( 170, 250 ] 1089 0.025% 99.974% ( 250, 380 ] 755 0.018% 99.991% ( 380, 580 ] 651 0.015% 100.007% ( 580, 870 ] 427 0.010% 100.017% ( 870, 1300 ] 222 0.005% 100.022% ( 1300, 1900 ] 110 0.003% 100.024% ( 1900, 2900 ] 85 0.002% 100.026% ( 2900, 4400 ] 65 0.002% 100.028% ( 4400, 6600 ] 22 0.001% 100.028% ( 6600, 9900 ] 4 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 1499569 Average: 5.0975 StdDev: 73.71 Min: 0 Median: 1.8525 Max: 10740 Percentiles: P50: 1.85 P75: 2.71 P99: 9.38 P99.9: 145.09 P99.99: 386.30 ------------------------------------------------------ [ 0, 1 ] 63011 4.202% 4.202% # ( 1, 2 ] 805640 53.725% 57.927% ########### ( 2, 3 ] 360242 24.023% 81.950% ##### ( 3, 4 ] 111749 7.452% 89.402% # ( 4, 6 ] 113784 7.588% 96.990% ## ( 6, 10 ] 35647 2.377% 99.367% ( 10, 15 ] 5894 0.393% 99.760% ( 15, 22 ] 729 0.049% 99.808% ( 22, 34 ] 61 0.004% 99.812% ( 34, 51 ] 21 0.001% 99.814% ( 51, 76 ] 22 0.001% 99.815% ( 76, 110 ] 756 0.050% 99.866% ( 110, 170 ] 878 0.059% 99.924% ( 170, 250 ] 429 0.029% 99.953% ( 250, 380 ] 537 0.036% 99.989% ( 380, 580 ] 605 0.040% 100.029% ( 580, 870 ] 520 0.035% 100.064% ( 870, 1300 ] 400 0.027% 100.090% ( 1300, 1900 ] 185 0.012% 100.103% ( 1900, 2900 ] 194 0.013% 100.116% ( 2900, 4400 ] 221 0.015% 100.130% ( 4400, 6600 ] 41 0.003% 100.133% ( 6600, 9900 ] 28 0.002% 100.135% ( 9900, 14000 ] 1 0.000% 100.135% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 1045397 Average: 6.9890 StdDev: 93.48 Min: 0 Median: 1.9381 Max: 9186 Percentiles: P50: 1.94 P75: 2.84 P99: 9.63 P99.9: 495.87 P99.99: 775.99 ------------------------------------------------------ [ 0, 1 ] 29388 2.811% 2.811% # ( 1, 2 ] 525847 50.301% 53.112% ########## ( 2, 3 ] 271977 26.017% 79.129% ##### ( 3, 4 ] 92203 8.820% 87.949% ## ( 4, 6 ] 95244 9.111% 97.060% ## ( 6, 10 ] 22377 2.141% 99.200% ( 10, 15 ] 4459 0.427% 99.627% ( 15, 22 ] 496 0.047% 99.674% ( 22, 34 ] 37 0.004% 99.678% ( 34, 51 ] 15 0.001% 99.679% ( 51, 76 ] 18 0.002% 99.681% ( 76, 110 ] 227 0.022% 99.703% ( 110, 170 ] 456 0.044% 99.746% ( 170, 250 ] 446 0.043% 99.789% ( 250, 380 ] 657 0.063% 99.852% ( 380, 580 ] 871 0.083% 99.935% ( 580, 870 ] 850 0.081% 100.016% ( 870, 1300 ] 595 0.057% 100.073% ( 1300, 1900 ] 317 0.030% 100.104% ( 1900, 2900 ] 210 0.020% 100.124% ( 2900, 4400 ] 224 0.021% 100.145% ( 4400, 6600 ] 67 0.006% 100.152% ( 6600, 9900 ] 21 0.002% 100.154% ** Level 4 read latency histogram (micros): Count: 199386 Average: 13.3826 StdDev: 162.76 Min: 1 Median: 2.1549 Max: 9950 Percentiles: P50: 2.15 P75: 3.07 P99: 13.07 P99.9: 1813.10 P99.99: 3175.11 ------------------------------------------------------ [ 0, 1 ] 1869 0.937% 0.937% ( 1, 2 ] 88933 44.603% 45.541% ######### ( 2, 3 ] 57400 28.788% 74.329% ###### ( 3, 4 ] 20322 10.192% 84.521% ## ( 4, 6 ] 22701 11.385% 95.907% ## ( 6, 10 ] 5449 2.733% 98.640% # ( 10, 15 ] 1171 0.587% 99.227% ( 15, 22 ] 118 0.059% 99.286% ( 22, 34 ] 14 0.007% 99.293% ( 34, 51 ] 14 0.007% 99.300% ( 51, 76 ] 9 0.005% 99.305% ( 76, 110 ] 16 0.008% 99.313% ( 110, 170 ] 46 0.023% 99.336% ( 170, 250 ] 105 0.053% 99.389% ( 250, 380 ] 95 0.048% 99.436% ( 380, 580 ] 206 0.103% 99.540% ( 580, 870 ] 284 0.142% 99.682% ( 870, 1300 ] 267 0.134% 99.816% ( 1300, 1900 ] 196 0.098% 99.914% ( 1900, 2900 ] 123 0.062% 99.976% ( 2900, 4400 ] 153 0.077% 100.053% ( 4400, 6600 ] 34 0.017% 100.070% ( 6600, 9900 ] 11 0.006% 100.075% ( 9900, 14000 ] 1 0.001% 100.076% ** Level 5 read latency histogram (micros): Count: 300 Average: 1395.9133 StdDev: 1496.34 Min: 89 Median: 739.0323 Max: 6638 Percentiles: P50: 739.03 P75: 2118.75 P99: 6306.67 P99.9: 6638.00 P99.99: 6638.00 ------------------------------------------------------ ( 76, 110 ] 8 2.667% 2.667% # ( 110, 170 ] 26 8.667% 11.333% ## ( 170, 250 ] 24 8.000% 19.333% ## ( 250, 380 ] 42 14.000% 33.333% ### ( 380, 580 ] 33 11.000% 44.333% ## ( 580, 870 ] 31 10.333% 54.667% ## ( 870, 1300 ] 31 10.333% 65.000% ## ( 1300, 1900 ] 23 7.667% 72.667% ## ( 1900, 2900 ] 32 10.667% 83.333% ## ( 2900, 4400 ] 34 11.333% 94.667% ## ( 4400, 6600 ] 15 5.000% 99.667% # ( 6600, 9900 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 48.7 total, 4.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 202.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.231 H:M:S, 43.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 222.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.671 H:M:S, 37.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-17:03:27 ... thread 0: (1000000,11000000) ops and (191474.1,204819.3) ops/second in (5.222638,53.705880) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.66 GB 69.2 10.7 0.0 10.7 21.1 10.4 0.0 2.0 135.9 268.4 80.62 69.73 179 0.450 11M 25K 0.0 0.0 L1 4/4 439.40 MB 0.0 7.0 5.6 1.4 7.0 5.6 0.1 1.2 215.5 213.3 33.38 31.39 4 8.345 7020K 44K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 5.2 1.8 226.1 226.1 0.49 0.46 1 0.492 112K 35 0.0 0.0 L3 17/0 991.51 MB 1.0 4.9 2.9 2.0 4.9 2.9 2.4 1.7 150.4 149.8 33.49 22.72 24 1.396 5022K 16K 0.0 0.0 L4 164/0 9.64 GB 1.0 4.5 2.9 1.6 4.4 2.8 2.2 1.5 138.3 137.1 32.96 21.47 34 0.969 4626K 38K 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/20 106.44 GB 0.0 27.2 11.5 15.7 37.5 21.8 14.9 3.6 154.0 212.3 180.95 145.77 242 0.748 27M 125K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.2 11.5 15.7 37.5 21.8 14.9 3.6 154.0 212.3 180.95 145.77 242 0.748 27M 125K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.2 11.5 15.7 27.1 11.3 0.0 0.0 190.6 189.5 146.17 118.01 95 1.539 27M 125K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 307.9 34.78 27.76 147 0.237 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.9 total, 53.7 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.51 GB write, 712.32 MB/s write, 27.20 GB read, 516.60 MB/s read, 180.9 seconds Interval compaction: 37.51 GB write, 715.21 MB/s write, 27.20 GB read, 518.69 MB/s read, 180.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 28, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 28, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 78, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 78, interval: 106 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4819496 Average: 2.9300 StdDev: 26.36 Min: 1 Median: 1.5938 Max: 7786 Percentiles: P50: 1.59 P75: 1.97 P99: 7.63 P99.9: 138.90 P99.99: 351.27 ------------------------------------------------------ [ 0, 1 ] 522557 10.843% 10.843% ## ( 1, 2 ] 3178306 65.947% 76.789% ############# ( 2, 3 ] 727777 15.101% 91.890% ### ( 3, 4 ] 181766 3.771% 95.662% # ( 4, 6 ] 140396 2.913% 98.575% # ( 6, 10 ] 50446 1.047% 99.621% ( 10, 15 ] 6981 0.145% 99.766% ( 15, 22 ] 729 0.015% 99.781% ( 22, 34 ] 69 0.001% 99.783% ( 34, 51 ] 31 0.001% 99.783% ( 51, 76 ] 32 0.001% 99.784% ( 76, 110 ] 3180 0.066% 99.850% ( 110, 170 ] 4996 0.104% 99.954% ( 170, 250 ] 1135 0.024% 99.977% ( 250, 380 ] 787 0.016% 99.994% ( 380, 580 ] 683 0.014% 100.008% ( 580, 870 ] 446 0.009% 100.017% ( 870, 1300 ] 226 0.005% 100.022% ( 1300, 1900 ] 110 0.002% 100.024% ( 1900, 2900 ] 87 0.002% 100.026% ( 2900, 4400 ] 67 0.001% 100.027% ( 4400, 6600 ] 22 0.000% 100.028% ( 6600, 9900 ] 4 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1499569 Average: 5.0975 StdDev: 73.71 Min: 0 Median: 1.8525 Max: 10740 Percentiles: P50: 1.85 P75: 2.71 P99: 9.38 P99.9: 145.09 P99.99: 386.30 ------------------------------------------------------ [ 0, 1 ] 63011 4.202% 4.202% # ( 1, 2 ] 805640 53.725% 57.927% ########### ( 2, 3 ] 360242 24.023% 81.950% ##### ( 3, 4 ] 111749 7.452% 89.402% # ( 4, 6 ] 113784 7.588% 96.990% ## ( 6, 10 ] 35647 2.377% 99.367% ( 10, 15 ] 5894 0.393% 99.760% ( 15, 22 ] 729 0.049% 99.808% ( 22, 34 ] 61 0.004% 99.812% ( 34, 51 ] 21 0.001% 99.814% ( 51, 76 ] 22 0.001% 99.815% ( 76, 110 ] 756 0.050% 99.866% ( 110, 170 ] 878 0.059% 99.924% ( 170, 250 ] 429 0.029% 99.953% ( 250, 380 ] 537 0.036% 99.989% ( 380, 580 ] 605 0.040% 100.029% ( 580, 870 ] 520 0.035% 100.064% ( 870, 1300 ] 400 0.027% 100.090% ( 1300, 1900 ] 185 0.012% 100.103% ( 1900, 2900 ] 194 0.013% 100.116% ( 2900, 4400 ] 221 0.015% 100.130% ( 4400, 6600 ] 41 0.003% 100.133% ( 6600, 9900 ] 28 0.002% 100.135% ( 9900, 14000 ] 1 0.000% 100.135% ** Level 2 read latency histogram (micros): Count: 40479 Average: 2.4679 StdDev: 21.67 Min: 1 Median: 1.3948 Max: 2683 Percentiles: P50: 1.39 P75: 1.82 P99: 6.08 P99.9: 106.49 P99.99: 865.37 ------------------------------------------------------ [ 0, 1 ] 10924 26.987% 26.987% ##### ( 1, 2 ] 23593 58.285% 85.271% ############ ( 2, 3 ] 3797 9.380% 94.652% ## ( 3, 4 ] 1080 2.668% 97.320% # ( 4, 6 ] 675 1.668% 98.987% ( 6, 10 ] 249 0.615% 99.602% ( 10, 15 ] 71 0.175% 99.778% ( 15, 22 ] 8 0.020% 99.797% ( 22, 34 ] 2 0.005% 99.802% ( 51, 76 ] 18 0.044% 99.847% ( 76, 110 ] 24 0.059% 99.906% ( 110, 170 ] 10 0.025% 99.931% ( 170, 250 ] 13 0.032% 99.963% ( 250, 380 ] 6 0.015% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 1900, 2900 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 1045397 Average: 6.9890 StdDev: 93.48 Min: 0 Median: 1.9381 Max: 9186 Percentiles: P50: 1.94 P75: 2.84 P99: 9.63 P99.9: 495.87 P99.99: 775.99 ------------------------------------------------------ [ 0, 1 ] 29388 2.811% 2.811% # ( 1, 2 ] 525847 50.301% 53.112% ########## ( 2, 3 ] 271977 26.017% 79.129% ##### ( 3, 4 ] 92203 8.820% 87.949% ## ( 4, 6 ] 95244 9.111% 97.060% ## ( 6, 10 ] 22377 2.141% 99.200% ( 10, 15 ] 4459 0.427% 99.627% ( 15, 22 ] 496 0.047% 99.674% ( 22, 34 ] 37 0.004% 99.678% ( 34, 51 ] 15 0.001% 99.679% ( 51, 76 ] 18 0.002% 99.681% ( 76, 110 ] 227 0.022% 99.703% ( 110, 170 ] 456 0.044% 99.746% ( 170, 250 ] 446 0.043% 99.789% ( 250, 380 ] 657 0.063% 99.852% ( 380, 580 ] 871 0.083% 99.935% ( 580, 870 ] 850 0.081% 100.016% ( 870, 1300 ] 595 0.057% 100.073% ( 1300, 1900 ] 317 0.030% 100.104% ( 1900, 2900 ] 210 0.020% 100.124% ( 2900, 4400 ] 224 0.021% 100.145% ( 4400, 6600 ] 67 0.006% 100.152% ( 6600, 9900 ] 21 0.002% 100.154% ** Level 4 read latency histogram (micros): Count: 199386 Average: 13.3826 StdDev: 162.76 Min: 1 Median: 2.1549 Max: 9950 Percentiles: P50: 2.15 P75: 3.07 P99: 13.07 P99.9: 1813.10 P99.99: 3175.11 ------------------------------------------------------ [ 0, 1 ] 1869 0.937% 0.937% ( 1, 2 ] 88933 44.603% 45.541% ######### ( 2, 3 ] 57400 28.788% 74.329% ###### ( 3, 4 ] 20322 10.192% 84.521% ## ( 4, 6 ] 22701 11.385% 95.907% ## ( 6, 10 ] 5449 2.733% 98.640% # ( 10, 15 ] 1171 0.587% 99.227% ( 15, 22 ] 118 0.059% 99.286% ( 22, 34 ] 14 0.007% 99.293% ( 34, 51 ] 14 0.007% 99.300% ( 51, 76 ] 9 0.005% 99.305% ( 76, 110 ] 16 0.008% 99.313% ( 110, 170 ] 46 0.023% 99.336% ( 170, 250 ] 105 0.053% 99.389% ( 250, 380 ] 95 0.048% 99.436% ( 380, 580 ] 206 0.103% 99.540% ( 580, 870 ] 284 0.142% 99.682% ( 870, 1300 ] 267 0.134% 99.816% ( 1300, 1900 ] 196 0.098% 99.914% ( 1900, 2900 ] 123 0.062% 99.976% ( 2900, 4400 ] 153 0.077% 100.053% ( 4400, 6600 ] 34 0.017% 100.070% ( 6600, 9900 ] 11 0.006% 100.075% ( 9900, 14000 ] 1 0.001% 100.076% ** Level 5 read latency histogram (micros): Count: 300 Average: 1395.9133 StdDev: 1496.34 Min: 89 Median: 739.0323 Max: 6638 Percentiles: P50: 739.03 P75: 2118.75 P99: 6306.67 P99.9: 6638.00 P99.99: 6638.00 ------------------------------------------------------ ( 76, 110 ] 8 2.667% 2.667% # ( 110, 170 ] 26 8.667% 11.333% ## ( 170, 250 ] 24 8.000% 19.333% ## ( 250, 380 ] 42 14.000% 33.333% ### ( 380, 580 ] 33 11.000% 44.333% ## ( 580, 870 ] 31 10.333% 54.667% ## ( 870, 1300 ] 31 10.333% 65.000% ## ( 1300, 1900 ] 23 7.667% 72.667% ## ( 1900, 2900 ] 32 10.667% 83.333% ## ( 2900, 4400 ] 34 11.333% 94.667% ## ( 4400, 6600 ] 15 5.000% 99.667% # ( 6600, 9900 ] 1 0.333% 100.000% ** DB Stats ** Uptime(secs): 53.9 total, 5.2 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 200.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.839 H:M:S, 44.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 188.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.608 H:M:S, 49.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.379 micros/op 185917 ops/sec 60.021 seconds 11158999 operations; 180.1 MB/s Microseconds per write: Count: 11158999 Average: 5.3787 StdDev: 541.20 Min: 0 Median: 1.7336 Max: 1026151 Percentiles: P50: 1.73 P75: 2.73 P99: 8.89 P99.9: 1057.33 P99.99: 2650.08 ------------------------------------------------------ [ 0, 1 ] 1529086 13.703% 13.703% ### ( 1, 2 ] 5521378 49.479% 63.182% ########## ( 2, 3 ] 1815727 16.271% 79.453% ### ( 3, 4 ] 1516731 13.592% 93.045% ### ( 4, 6 ] 575597 5.158% 98.203% # ( 6, 10 ] 122847 1.101% 99.304% ( 10, 15 ] 38186 0.342% 99.647% ( 15, 22 ] 9627 0.086% 99.733% ( 22, 34 ] 1738 0.016% 99.748% ( 34, 51 ] 216 0.002% 99.750% ( 51, 76 ] 36 0.000% 99.751% ( 76, 110 ] 7760 0.070% 99.820% ( 110, 170 ] 3056 0.027% 99.848% ( 170, 250 ] 341 0.003% 99.851% ( 250, 380 ] 170 0.002% 99.852% ( 380, 580 ] 23 0.000% 99.852% ( 580, 870 ] 20 0.000% 99.852% ( 870, 1300 ] 12168 0.109% 99.962% ( 1300, 1900 ] 34 0.000% 99.962% ( 1900, 2900 ] 4189 0.038% 99.999% ( 2900, 4400 ] 23 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 5 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 20 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 206876 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11158999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11516086968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 628 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29515550 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34732409158 rocksdb.compact.write.bytes COUNT : 34514113260 rocksdb.flush.write.bytes COUNT : 11493729427 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 70 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 401 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11401291776 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4642816 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34842956286 rocksdb.non.last.level.read.count COUNT : 8414069 rocksdb.block.checksum.compute.count COUNT : 8412883 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.380647 P95 : 3.884770 P99 : 7.271362 P100 : 1026149.000000 COUNT : 11158999 SUM : 54876516 rocksdb.compaction.times.micros P50 : 1024137.931034 P95 : 6005000.000000 P99 : 15568336.000000 P100 : 15568336.000000 COUNT : 98 SUM : 168176856 rocksdb.compaction.times.cpu_micros P50 : 911515.151515 P95 : 5664000.000000 P99 : 12628000.000000 P100 : 13814907.000000 COUNT : 98 SUM : 137753044 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 700.542169 P95 : 5463.333333 P99 : 209200.000000 P100 : 520672.000000 COUNT : 151 SUM : 999792 rocksdb.compaction.outfile.sync.micros P50 : 1103.494624 P95 : 147666.666667 P99 : 350100.000000 P100 : 1202754.000000 COUNT : 407 SUM : 10548248 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.616279 P95 : 1156.115385 P99 : 4139.000000 P100 : 5749.000000 COUNT : 287 SUM : 89139 rocksdb.table.open.io.micros P50 : 1493.939394 P95 : 9214.615385 P99 : 19554.285714 P100 : 22694.000000 COUNT : 628 SUM : 1610608 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.734560 P95 : 7.952700 P99 : 12.246821 P100 : 14360.000000 COUNT : 8411314 SUM : 52672441 rocksdb.read.block.get.micros P50 : 518.922156 P95 : 4187.272727 P99 : 7175.142857 P100 : 10165.000000 COUNT : 1256 SUM : 1303146 rocksdb.write.raw.block.micros P50 : 0.513844 P95 : 0.976305 P99 : 2.964491 P100 : 13852.000000 COUNT : 11144332 SUM : 23649270 rocksdb.numfiles.in.singlecompaction P50 : 3.235955 P95 : 7.666667 P99 : 25.600000 P100 : 35.000000 COUNT : 170 SUM : 665 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559472 P95 : 1175.046269 P99 : 2536.617753 P100 : 1025958.000000 COUNT : 154958 SUM : 29530779 rocksdb.sst.read.micros P50 : 1.682886 P95 : 4.808784 P99 : 9.021330 P100 : 10740.000000 COUNT : 8414716 SUM : 35881880 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11158999 SUM : 11516086968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 218214.285714 P95 : 446500.000000 P99 : 943300.000000 P100 : 1159735.000000 COUNT : 151 SUM : 35554409 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 407 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0