[2024-12-13 09:24:20.174394] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-12-13 09:24:20.174565] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid334938 ] Set seed to 1734078260170852 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 09:24:20.303320] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 09:24:20.344327] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 09:24:20.344379] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 334938' to capture a snapshot of events at runtime. [2024-12-13 09:24:20.344392] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-13 09:24:20.344405] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-13 09:24:20.344415] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid334938 for offline analysis/debug. [2024-12-13 09:24:20.344515] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 09:24:22 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/13-09:24:25 ... thread 0: (1000000,1000000) ops and (336121.8,336121.8) ops/second in (2.975112,2.975112) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/9 567.01 MB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 360.9 2.44 2.29 13 0.188 0 0 0.0 0.0 L1 3/3 251.70 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 250.9 250.6 1.00 0.99 1 1.004 255K 238 0.0 0.0 L2 1/0 48.99 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 17/0 818.37 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 236.4 236.5 0.26 0.25 1 0.264 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1198/12 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 101.5 311.7 4.20 3.99 16 0.262 432K 266 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 101.5 311.7 4.20 3.99 16 0.262 432K 266 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 243.2 243.0 1.75 1.70 3 0.584 432K 266 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 360.9 2.44 2.29 13 0.188 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 416.68 MB/s write, 0.42 GB read, 135.71 MB/s read, 4.2 seconds Interval compaction: 1.28 GB write, 439.25 MB/s write, 0.42 GB read, 143.07 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 109579 Average: 1.8044 StdDev: 6.64 Min: 1 Median: 1.1948 Max: 1352 Percentiles: P50: 1.19 P75: 1.65 P99: 4.87 P99.9: 13.33 P99.99: 218.84 ------------------------------------------------------ [ 0, 1 ] 43023 39.262% 39.262% ######## ( 1, 2 ] 60402 55.122% 94.384% ########### ( 2, 3 ] 3581 3.268% 97.652% # ( 3, 4 ] 1241 1.133% 98.784% ( 4, 6 ] 548 0.500% 99.285% ( 6, 10 ] 567 0.517% 99.802% ( 10, 15 ] 166 0.151% 99.953% ( 15, 22 ] 21 0.019% 99.973% ( 22, 34 ] 3 0.003% 99.975% ( 34, 51 ] 1 0.001% 99.976% ( 51, 76 ] 2 0.002% 99.978% ( 76, 110 ] 2 0.002% 99.980% ( 170, 250 ] 23 0.021% 100.001% ( 380, 580 ] 1 0.001% 100.002% ( 870, 1300 ] 1 0.001% 100.003% ( 1300, 1900 ] 1 0.001% 100.004% ** Level 1 read latency histogram (micros): Count: 30400 Average: 2.3696 StdDev: 22.04 Min: 0 Median: 1.2646 Max: 2648 Percentiles: P50: 1.26 P75: 1.71 P99: 5.96 P99.9: 123.00 P99.99: 1282.80 ------------------------------------------------------ [ 0, 1 ] 10709 35.227% 35.227% ####### ( 1, 2 ] 16974 55.836% 91.062% ########### ( 2, 3 ] 1847 6.076% 97.138% # ( 3, 4 ] 331 1.089% 98.227% ( 4, 6 ] 241 0.793% 99.020% ( 6, 10 ] 187 0.615% 99.635% ( 10, 15 ] 36 0.118% 99.753% ( 15, 22 ] 2 0.007% 99.760% ( 22, 34 ] 1 0.003% 99.763% ( 76, 110 ] 40 0.132% 99.895% ( 110, 170 ] 12 0.039% 99.934% ( 170, 250 ] 12 0.039% 99.974% ( 250, 380 ] 1 0.003% 99.977% ( 380, 580 ] 3 0.010% 99.987% ( 580, 870 ] 1 0.003% 99.990% ( 870, 1300 ] 1 0.003% 99.993% ( 1300, 1900 ] 2 0.007% 100.000% ( 1900, 2900 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 15864 Average: 1.7671 StdDev: 3.17 Min: 1 Median: 1.1279 Max: 228 Percentiles: P50: 1.13 P75: 1.63 P99: 5.82 P99.9: 13.47 P99.99: 186.54 ------------------------------------------------------ [ 0, 1 ] 6927 43.665% 43.665% ######### ( 1, 2 ] 7858 49.534% 93.198% ########## ( 2, 3 ] 596 3.757% 96.955% # ( 3, 4 ] 155 0.977% 97.932% ( 4, 6 ] 186 1.172% 99.105% ( 6, 10 ] 106 0.668% 99.773% ( 10, 15 ] 29 0.183% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 2 0.013% 99.987% ( 170, 250 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 718.9412 StdDev: 886.29 Min: 0 Median: 180.0000 Max: 3028 Percentiles: P50: 180.00 P75: 1426.92 P99: 3028.00 P99.9: 3028.00 P99.99: 3028.00 ------------------------------------------------------ [ 0, 1 ] 32 37.647% 37.647% ######## ( 1, 2 ] 3 3.529% 41.176% # ( 3, 4 ] 2 2.353% 43.529% ( 110, 170 ] 5 5.882% 49.412% # ( 170, 250 ] 4 4.706% 54.118% # ( 250, 380 ] 1 1.176% 55.294% ( 380, 580 ] 3 3.529% 58.824% # ( 580, 870 ] 6 7.059% 65.882% # ( 870, 1300 ] 5 5.882% 71.765% # ( 1300, 1900 ] 13 15.294% 87.059% ### ( 1900, 2900 ] 9 10.588% 97.647% ## ( 2900, 4400 ] 2 2.353% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1262.8333 StdDev: 724.72 Min: 293 Median: 1300.0000 Max: 2902 Percentiles: P50: 1300.00 P75: 1709.09 P99: 2902.00 P99.9: 2902.00 P99.99: 2902.00 ------------------------------------------------------ ( 250, 380 ] 4 13.333% 13.333% ### ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 3 10.000% 30.000% ## ( 870, 1300 ] 6 20.000% 50.000% #### ( 1300, 1900 ] 11 36.667% 86.667% ####### ( 1900, 2900 ] 3 10.000% 96.667% ## ( 2900, 4400 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 313.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.150 H:M:S, 4.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.150 H:M:S, 5.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-09:24:27 ... thread 0: (1000000,2000000) ops and (346608.7,341284.7) ops/second in (2.885098,5.860210) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.17 GB 94.4 0.7 0.0 0.7 2.5 1.8 0.0 1.4 93.4 319.1 8.09 7.66 31 0.261 767K 751 0.0 0.0 L1 2/0 50.38 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 235.8 235.4 3.47 3.38 2 1.736 831K 1433 0.0 0.0 L2 5/4 564.05 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 17/10 818.37 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 236.4 236.5 0.26 0.25 1 0.264 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1202/18 97.92 GB 0.0 1.7 0.6 1.1 3.5 2.4 0.7 2.0 142.0 290.3 12.31 11.75 35 0.352 1775K 2212 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.1 3.5 2.4 0.6 2.0 142.0 290.3 12.31 11.75 35 0.352 1775K 2212 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.1 1.7 0.6 0.0 0.0 243.2 242.8 7.19 6.98 7 1.027 1775K 2212 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.9 5.12 4.77 28 0.183 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.49 GB write, 593.26 MB/s write, 1.71 GB read, 290.32 MB/s read, 12.3 seconds Interval compaction: 3.49 GB write, 609.58 MB/s write, 1.71 GB read, 298.31 MB/s read, 12.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 393964 Average: 2.0986 StdDev: 5.54 Min: 1 Median: 1.4335 Max: 1423 Percentiles: P50: 1.43 P75: 1.84 P99: 5.84 P99.9: 12.26 P99.99: 17.66 ------------------------------------------------------ [ 0, 1 ] 91052 23.112% 23.112% ##### ( 1, 2 ] 244366 62.027% 85.139% ############ ( 2, 3 ] 33590 8.526% 93.665% ## ( 3, 4 ] 14118 3.584% 97.249% # ( 4, 6 ] 7494 1.902% 99.151% ( 6, 10 ] 2677 0.680% 99.831% ( 10, 15 ] 605 0.154% 99.984% ( 15, 22 ] 62 0.016% 100.000% ( 22, 34 ] 11 0.003% 100.003% ( 34, 51 ] 4 0.001% 100.004% ( 51, 76 ] 2 0.001% 100.004% ( 76, 110 ] 3 0.001% 100.005% ( 170, 250 ] 46 0.012% 100.017% ( 250, 380 ] 7 0.002% 100.019% ( 380, 580 ] 2 0.001% 100.019% ( 580, 870 ] 1 0.000% 100.019% ( 870, 1300 ] 4 0.001% 100.020% ( 1300, 1900 ] 2 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 106797 Average: 2.3974 StdDev: 12.55 Min: 0 Median: 1.5290 Max: 2648 Percentiles: P50: 1.53 P75: 1.92 P99: 6.29 P99.9: 14.77 P99.99: 486.41 ------------------------------------------------------ [ 0, 1 ] 17571 16.453% 16.453% ### ( 1, 2 ] 67728 63.418% 79.870% ############# ( 2, 3 ] 12967 12.142% 92.012% ## ( 3, 4 ] 4379 4.100% 96.112% # ( 4, 6 ] 3024 2.832% 98.944% # ( 6, 10 ] 838 0.785% 99.728% ( 10, 15 ] 193 0.181% 99.909% ( 15, 22 ] 11 0.010% 99.919% ( 22, 34 ] 1 0.001% 99.920% ( 34, 51 ] 2 0.002% 99.922% ( 51, 76 ] 1 0.001% 99.923% ( 76, 110 ] 40 0.037% 99.961% ( 110, 170 ] 13 0.012% 99.973% ( 170, 250 ] 13 0.012% 99.985% ( 250, 380 ] 1 0.001% 99.986% ( 380, 580 ] 10 0.009% 99.995% ( 580, 870 ] 2 0.002% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 15894 Average: 1.7692 StdDev: 3.16 Min: 1 Median: 1.1296 Max: 228 Percentiles: P50: 1.13 P75: 1.63 P99: 5.83 P99.9: 13.47 P99.99: 186.42 ------------------------------------------------------ [ 0, 1 ] 6927 43.582% 43.582% ######### ( 1, 2 ] 7868 49.503% 93.085% ########## ( 2, 3 ] 614 3.863% 96.949% # ( 3, 4 ] 156 0.982% 97.930% ( 4, 6 ] 186 1.170% 99.100% ( 6, 10 ] 107 0.673% 99.773% ( 10, 15 ] 29 0.182% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 2 0.013% 99.987% ( 170, 250 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 43700 Average: 4.5287 StdDev: 50.86 Min: 0 Median: 1.7481 Max: 3028 Percentiles: P50: 1.75 P75: 2.59 P99: 11.02 P99.9: 268.78 P99.99: 2414.44 ------------------------------------------------------ [ 0, 1 ] 2839 6.497% 6.497% # ( 1, 2 ] 25414 58.156% 64.652% ############ ( 2, 3 ] 7616 17.428% 82.080% ### ( 3, 4 ] 3747 8.574% 90.654% ## ( 4, 6 ] 2500 5.721% 96.375% # ( 6, 10 ] 1108 2.535% 98.911% # ( 10, 15 ] 191 0.437% 99.348% ( 15, 22 ] 23 0.053% 99.400% ( 22, 34 ] 17 0.039% 99.439% ( 34, 51 ] 67 0.153% 99.593% ( 51, 76 ] 17 0.039% 99.632% ( 76, 110 ] 31 0.071% 99.703% ( 110, 170 ] 68 0.156% 99.858% ( 170, 250 ] 17 0.039% 99.897% ( 250, 380 ] 9 0.021% 99.918% ( 380, 580 ] 3 0.007% 99.924% ( 580, 870 ] 6 0.014% 99.938% ( 870, 1300 ] 5 0.011% 99.950% ( 1300, 1900 ] 13 0.030% 99.979% ( 1900, 2900 ] 9 0.021% 100.000% ( 2900, 4400 ] 2 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 30 Average: 1262.8333 StdDev: 724.72 Min: 293 Median: 1300.0000 Max: 2902 Percentiles: P50: 1300.00 P75: 1709.09 P99: 2902.00 P99.9: 2902.00 P99.99: 2902.00 ------------------------------------------------------ ( 250, 380 ] 4 13.333% 13.333% ### ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 3 10.000% 30.000% ## ( 870, 1300 ] 6 20.000% 50.000% #### ( 1300, 1900 ] 11 36.667% 86.667% ####### ( 1900, 2900 ] 3 10.000% 96.667% ## ( 2900, 4400 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.0 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 326.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.150 H:M:S, 2.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 341.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-09:24:31 ... thread 0: (1000000,3000000) ops and (322496.5,334783.4) ops/second in (3.100809,8.961019) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 195.1 1.8 0.0 1.8 4.6 2.8 0.0 1.6 121.0 308.7 15.10 14.33 50 0.302 1855K 1848 0.0 0.0 L1 2/0 50.38 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 235.8 235.4 3.47 3.38 2 1.736 831K 1433 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 24/0 989.31 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 225.2 225.1 6.49 6.14 4 1.622 1463K 788 0.0 0.0 L4 152/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/4 98.90 GB 0.0 4.1 1.2 3.0 6.9 3.9 1.4 2.5 165.2 276.0 25.54 24.30 57 0.448 4262K 4097 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.2 3.0 6.9 3.9 1.4 2.5 165.2 276.0 25.54 24.30 57 0.448 4262K 4097 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.2 3.0 4.1 1.2 0.0 0.0 239.2 238.9 17.63 16.98 14 1.260 4262K 4097 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 358.8 7.90 7.33 43 0.184 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 9.0 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.88 GB write, 772.53 MB/s write, 4.12 GB read, 462.29 MB/s read, 25.5 seconds Interval compaction: 6.88 GB write, 786.43 MB/s write, 4.12 GB read, 470.61 MB/s read, 25.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 653745 Average: 2.2096 StdDev: 6.12 Min: 1 Median: 1.4969 Max: 1725 Percentiles: P50: 1.50 P75: 1.89 P99: 5.94 P99.9: 12.69 P99.99: 17.01 ------------------------------------------------------ [ 0, 1 ] 122267 18.703% 18.703% #### ( 1, 2 ] 411741 62.982% 81.684% ############# ( 2, 3 ] 67748 10.363% 92.048% ## ( 3, 4 ] 29048 4.443% 96.491% # ( 4, 6 ] 16915 2.587% 99.078% # ( 6, 10 ] 4726 0.723% 99.801% ( 10, 15 ] 1203 0.184% 99.985% ( 15, 22 ] 110 0.017% 100.002% ( 22, 34 ] 19 0.003% 100.005% ( 34, 51 ] 5 0.001% 100.006% ( 51, 76 ] 4 0.001% 100.006% ( 76, 110 ] 3 0.000% 100.007% ( 170, 250 ] 70 0.011% 100.017% ( 250, 380 ] 12 0.002% 100.019% ( 380, 580 ] 5 0.001% 100.020% ( 580, 870 ] 1 0.000% 100.020% ( 870, 1300 ] 9 0.001% 100.022% ( 1300, 1900 ] 4 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 207033 Average: 2.4802 StdDev: 9.05 Min: 0 Median: 1.6318 Max: 2648 Percentiles: P50: 1.63 P75: 2.11 P99: 6.54 P99.9: 13.97 P99.99: 227.21 ------------------------------------------------------ [ 0, 1 ] 20725 10.010% 10.010% ## ( 1, 2 ] 131032 63.290% 73.301% ############# ( 2, 3 ] 32986 15.933% 89.234% ### ( 3, 4 ] 11403 5.508% 94.741% # ( 4, 6 ] 8579 4.144% 98.885% # ( 6, 10 ] 1769 0.854% 99.740% ( 10, 15 ] 418 0.202% 99.942% ( 15, 22 ] 28 0.014% 99.955% ( 22, 34 ] 6 0.003% 99.958% ( 34, 51 ] 3 0.001% 99.959% ( 51, 76 ] 1 0.000% 99.960% ( 76, 110 ] 40 0.019% 99.979% ( 110, 170 ] 13 0.006% 99.986% ( 170, 250 ] 13 0.006% 99.992% ( 250, 380 ] 1 0.000% 99.992% ( 380, 580 ] 10 0.005% 99.997% ( 580, 870 ] 2 0.001% 99.998% ( 870, 1300 ] 1 0.000% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 212238 Average: 3.3182 StdDev: 25.60 Min: 0 Median: 1.6715 Max: 3028 Percentiles: P50: 1.67 P75: 2.27 P99: 9.56 P99.9: 165.17 P99.99: 679.55 ------------------------------------------------------ [ 0, 1 ] 15323 7.220% 7.220% # ( 1, 2 ] 135222 63.712% 70.932% ############# ( 2, 3 ] 31678 14.926% 85.858% ### ( 3, 4 ] 14038 6.614% 92.472% # ( 4, 6 ] 9883 4.657% 97.129% # ( 6, 10 ] 4457 2.100% 99.229% ( 10, 15 ] 696 0.328% 99.557% ( 15, 22 ] 68 0.032% 99.589% ( 22, 34 ] 37 0.017% 99.606% ( 34, 51 ] 247 0.116% 99.722% ( 51, 76 ] 70 0.033% 99.755% ( 76, 110 ] 87 0.041% 99.796% ( 110, 170 ] 239 0.113% 99.909% ( 170, 250 ] 103 0.049% 99.958% ( 250, 380 ] 53 0.025% 99.983% ( 380, 580 ] 12 0.006% 99.988% ( 580, 870 ] 11 0.005% 99.993% ( 870, 1300 ] 16 0.008% 100.001% ( 1300, 1900 ] 13 0.006% 100.007% ( 1900, 2900 ] 9 0.004% 100.011% ( 2900, 4400 ] 2 0.001% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1262.8333 StdDev: 724.72 Min: 293 Median: 1300.0000 Max: 2902 Percentiles: P50: 1300.00 P75: 1709.09 P99: 2902.00 P99.9: 2902.00 P99.99: 2902.00 ------------------------------------------------------ ( 250, 380 ] 4 13.333% 13.333% ### ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 3 10.000% 30.000% ## ( 870, 1300 ] 6 20.000% 50.000% #### ( 1300, 1900 ] 11 36.667% 86.667% ####### ( 1900, 2900 ] 3 10.000% 96.667% ## ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 375.6000 StdDev: 340.26 Min: 105 Median: 210.0000 Max: 1338 Percentiles: P50: 210.00 P75: 380.00 P99: 1338.00 P99.9: 1338.00 P99.99: 1338.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 8 40.000% 70.000% ######## ( 250, 380 ] 1 5.000% 75.000% # ( 580, 870 ] 3 15.000% 90.000% ### ( 870, 1300 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.312 H:M:S, 3.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.162 H:M:S, 5.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/13-09:24:33 ... thread 0: (1000000,4000000) ops and (338335.5,335664.4) ops/second in (2.955646,11.916665) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.13 GB 289.5 2.8 0.0 2.8 6.5 3.7 0.0 1.7 131.4 309.4 21.58 20.56 69 0.313 2878K 2866 0.0 0.0 L1 2/0 50.38 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 235.8 235.4 3.47 3.38 2 1.736 831K 1433 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 24/0 989.31 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 225.2 225.1 6.49 6.14 4 1.622 1463K 788 0.0 0.0 L4 152/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/4 99.88 GB 0.0 5.1 1.2 3.9 8.9 4.9 1.4 2.4 163.2 283.1 32.02 30.54 76 0.421 5286K 5115 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.2 3.9 8.9 4.9 1.4 2.4 163.2 283.1 32.02 30.54 76 0.421 5286K 5115 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.2 3.9 5.1 1.2 0.0 0.0 243.9 243.7 21.42 20.70 18 1.190 5286K 5115 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 362.7 10.59 9.84 58 0.183 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.85 GB write, 750.31 MB/s write, 5.10 GB read, 432.62 MB/s read, 32.0 seconds Interval compaction: 8.85 GB write, 760.46 MB/s write, 5.10 GB read, 438.48 MB/s read, 32.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 895929 Average: 2.1253 StdDev: 6.53 Min: 0 Median: 1.4450 Max: 1725 Percentiles: P50: 1.45 P75: 1.85 P99: 5.84 P99.9: 12.75 P99.99: 18.42 ------------------------------------------------------ [ 0, 1 ] 200183 22.344% 22.344% #### ( 1, 2 ] 556797 62.147% 84.491% ############ ( 2, 3 ] 79983 8.927% 93.418% ## ( 3, 4 ] 33252 3.711% 97.130% # ( 4, 6 ] 18187 2.030% 99.160% ( 6, 10 ] 5733 0.640% 99.800% ( 10, 15 ] 1634 0.182% 99.982% ( 15, 22 ] 144 0.016% 99.998% ( 22, 34 ] 26 0.003% 100.001% ( 34, 51 ] 5 0.001% 100.002% ( 51, 76 ] 7 0.001% 100.002% ( 76, 110 ] 4 0.000% 100.003% ( 170, 250 ] 92 0.010% 100.013% ( 250, 380 ] 18 0.002% 100.015% ( 380, 580 ] 7 0.001% 100.016% ( 580, 870 ] 4 0.000% 100.016% ( 870, 1300 ] 12 0.001% 100.018% ( 1300, 1900 ] 7 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 207033 Average: 2.4802 StdDev: 9.05 Min: 0 Median: 1.6318 Max: 2648 Percentiles: P50: 1.63 P75: 2.11 P99: 6.54 P99.9: 13.97 P99.99: 227.21 ------------------------------------------------------ [ 0, 1 ] 20725 10.010% 10.010% ## ( 1, 2 ] 131032 63.290% 73.301% ############# ( 2, 3 ] 32986 15.933% 89.234% ### ( 3, 4 ] 11403 5.508% 94.741% # ( 4, 6 ] 8579 4.144% 98.885% # ( 6, 10 ] 1769 0.854% 99.740% ( 10, 15 ] 418 0.202% 99.942% ( 15, 22 ] 28 0.014% 99.955% ( 22, 34 ] 6 0.003% 99.958% ( 34, 51 ] 3 0.001% 99.959% ( 51, 76 ] 1 0.000% 99.960% ( 76, 110 ] 40 0.019% 99.979% ( 110, 170 ] 13 0.006% 99.986% ( 170, 250 ] 13 0.006% 99.992% ( 250, 380 ] 1 0.000% 99.992% ( 380, 580 ] 10 0.005% 99.997% ( 580, 870 ] 2 0.001% 99.998% ( 870, 1300 ] 1 0.000% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 212238 Average: 3.3182 StdDev: 25.60 Min: 0 Median: 1.6715 Max: 3028 Percentiles: P50: 1.67 P75: 2.27 P99: 9.56 P99.9: 165.17 P99.99: 679.55 ------------------------------------------------------ [ 0, 1 ] 15323 7.220% 7.220% # ( 1, 2 ] 135222 63.712% 70.932% ############# ( 2, 3 ] 31678 14.926% 85.858% ### ( 3, 4 ] 14038 6.614% 92.472% # ( 4, 6 ] 9883 4.657% 97.129% # ( 6, 10 ] 4457 2.100% 99.229% ( 10, 15 ] 696 0.328% 99.557% ( 15, 22 ] 68 0.032% 99.589% ( 22, 34 ] 37 0.017% 99.606% ( 34, 51 ] 247 0.116% 99.722% ( 51, 76 ] 70 0.033% 99.755% ( 76, 110 ] 87 0.041% 99.796% ( 110, 170 ] 239 0.113% 99.909% ( 170, 250 ] 103 0.049% 99.958% ( 250, 380 ] 53 0.025% 99.983% ( 380, 580 ] 12 0.006% 99.988% ( 580, 870 ] 11 0.005% 99.993% ( 870, 1300 ] 16 0.008% 100.001% ( 1300, 1900 ] 13 0.006% 100.007% ( 1900, 2900 ] 9 0.004% 100.011% ( 2900, 4400 ] 2 0.001% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1262.8333 StdDev: 724.72 Min: 293 Median: 1300.0000 Max: 2902 Percentiles: P50: 1300.00 P75: 1709.09 P99: 2902.00 P99.9: 2902.00 P99.99: 2902.00 ------------------------------------------------------ ( 250, 380 ] 4 13.333% 13.333% ### ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 3 10.000% 30.000% ## ( 870, 1300 ] 6 20.000% 50.000% #### ( 1300, 1900 ] 11 36.667% 86.667% ####### ( 1900, 2900 ] 3 10.000% 96.667% ## ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 375.6000 StdDev: 340.26 Min: 105 Median: 210.0000 Max: 1338 Percentiles: P50: 210.00 P75: 380.00 P99: 1338.00 P99.9: 1338.00 P99.99: 1338.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 8 40.000% 70.000% ######## ( 250, 380 ] 1 5.000% 75.000% # ( 580, 870 ] 3 15.000% 90.000% ### ( 870, 1300 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.480 H:M:S, 4.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.168 H:M:S, 5.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/13-09:24:38 ... thread 0: (1000000,5000000) ops and (233106.9,308517.4) ops/second in (4.289877,16.206542) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 21/18 4.18 GB 18.9 3.8 0.0 3.8 8.6 4.8 0.0 1.8 137.2 309.7 28.47 27.19 90 0.316 3965K 3969 0.0 0.0 L1 2/2 50.38 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 235.8 235.4 3.47 3.38 2 1.736 831K 1433 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 24/0 989.31 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.3 225.2 225.1 6.49 6.14 4 1.622 1463K 788 0.0 0.0 L4 152/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/20 100.93 GB 0.0 6.1 1.2 5.0 10.9 6.0 1.4 2.3 161.8 287.9 38.91 37.17 97 0.401 6373K 6218 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 1.2 5.0 10.9 6.0 1.4 2.3 161.8 287.9 38.91 37.17 97 0.401 6373K 6218 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 1.2 5.0 6.1 1.2 0.0 0.0 247.7 247.4 25.42 24.63 22 1.156 6373K 6218 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.8 4.8 0.0 0.0 0.0 364.4 13.49 12.54 75 0.180 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.2 interval Flush(GB): cumulative 4.799, interval 4.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.94 GB write, 684.44 MB/s write, 6.15 GB read, 384.66 MB/s read, 38.9 seconds Interval compaction: 10.94 GB write, 691.25 MB/s write, 6.15 GB read, 388.49 MB/s read, 38.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 8, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1214048 Average: 2.0789 StdDev: 6.61 Min: 0 Median: 1.3966 Max: 1725 Percentiles: P50: 1.40 P75: 1.81 P99: 5.76 P99.9: 13.59 P99.99: 103.48 ------------------------------------------------------ [ 0, 1 ] 312472 25.738% 25.738% ##### ( 1, 2 ] 742687 61.174% 86.912% ############ ( 2, 3 ] 91702 7.553% 94.466% ## ( 3, 4 ] 37730 3.108% 97.574% # ( 4, 6 ] 19732 1.625% 99.199% ( 6, 10 ] 7013 0.578% 99.777% ( 10, 15 ] 2092 0.172% 99.949% ( 15, 22 ] 187 0.015% 99.964% ( 22, 34 ] 38 0.003% 99.967% ( 34, 51 ] 6 0.000% 99.968% ( 51, 76 ] 12 0.001% 99.969% ( 76, 110 ] 320 0.026% 99.995% ( 110, 170 ] 55 0.005% 100.000% ( 170, 250 ] 132 0.011% 100.011% ( 250, 380 ] 24 0.002% 100.013% ( 380, 580 ] 8 0.001% 100.013% ( 580, 870 ] 9 0.001% 100.014% ( 870, 1300 ] 14 0.001% 100.015% ( 1300, 1900 ] 8 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 207034 Average: 2.4807 StdDev: 9.05 Min: 0 Median: 1.6318 Max: 2648 Percentiles: P50: 1.63 P75: 2.11 P99: 6.54 P99.9: 13.98 P99.99: 227.21 ------------------------------------------------------ [ 0, 1 ] 20725 10.010% 10.010% ## ( 1, 2 ] 131032 63.290% 73.301% ############# ( 2, 3 ] 32986 15.933% 89.233% ### ( 3, 4 ] 11403 5.508% 94.741% # ( 4, 6 ] 8579 4.144% 98.885% # ( 6, 10 ] 1769 0.854% 99.739% ( 10, 15 ] 418 0.202% 99.941% ( 15, 22 ] 28 0.014% 99.955% ( 22, 34 ] 6 0.003% 99.957% ( 34, 51 ] 3 0.001% 99.959% ( 51, 76 ] 1 0.000% 99.959% ( 76, 110 ] 41 0.020% 99.979% ( 110, 170 ] 13 0.006% 99.986% ( 170, 250 ] 13 0.006% 99.992% ( 250, 380 ] 1 0.000% 99.992% ( 380, 580 ] 10 0.005% 99.997% ( 580, 870 ] 2 0.001% 99.998% ( 870, 1300 ] 1 0.000% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 212238 Average: 3.3182 StdDev: 25.60 Min: 0 Median: 1.6715 Max: 3028 Percentiles: P50: 1.67 P75: 2.27 P99: 9.56 P99.9: 165.17 P99.99: 679.55 ------------------------------------------------------ [ 0, 1 ] 15323 7.220% 7.220% # ( 1, 2 ] 135222 63.712% 70.932% ############# ( 2, 3 ] 31678 14.926% 85.858% ### ( 3, 4 ] 14038 6.614% 92.472% # ( 4, 6 ] 9883 4.657% 97.129% # ( 6, 10 ] 4457 2.100% 99.229% ( 10, 15 ] 696 0.328% 99.557% ( 15, 22 ] 68 0.032% 99.589% ( 22, 34 ] 37 0.017% 99.606% ( 34, 51 ] 247 0.116% 99.722% ( 51, 76 ] 70 0.033% 99.755% ( 76, 110 ] 87 0.041% 99.796% ( 110, 170 ] 239 0.113% 99.909% ( 170, 250 ] 103 0.049% 99.958% ( 250, 380 ] 53 0.025% 99.983% ( 380, 580 ] 12 0.006% 99.988% ( 580, 870 ] 11 0.005% 99.993% ( 870, 1300 ] 16 0.008% 100.001% ( 1300, 1900 ] 13 0.006% 100.007% ( 1900, 2900 ] 9 0.004% 100.011% ( 2900, 4400 ] 2 0.001% 100.012% ** Level 4 read latency histogram (micros): Count: 30 Average: 1262.8333 StdDev: 724.72 Min: 293 Median: 1300.0000 Max: 2902 Percentiles: P50: 1300.00 P75: 1709.09 P99: 2902.00 P99.9: 2902.00 P99.99: 2902.00 ------------------------------------------------------ ( 250, 380 ] 4 13.333% 13.333% ### ( 380, 580 ] 2 6.667% 20.000% # ( 580, 870 ] 3 10.000% 30.000% ## ( 870, 1300 ] 6 20.000% 50.000% #### ( 1300, 1900 ] 11 36.667% 86.667% ####### ( 1900, 2900 ] 3 10.000% 96.667% ## ( 2900, 4400 ] 1 3.333% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 375.6000 StdDev: 340.26 Min: 105 Median: 210.0000 Max: 1338 Percentiles: P50: 210.00 P75: 380.00 P99: 1338.00 P99.9: 1338.00 P99.99: 1338.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 5 25.000% 30.000% ##### ( 170, 250 ] 8 40.000% 70.000% ######## ( 250, 380 ] 1 5.000% 75.000% # ( 580, 870 ] 3 15.000% 90.000% ### ( 870, 1300 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.4 total, 4.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 300.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.886 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 229.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.406 H:M:S, 32.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/13-09:25:00 ... thread 0: (1000000,6000000) ops and (45873.2,157870.8) ops/second in (21.799208,38.005750) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/3 1007.28 MB 63.0 4.4 0.0 4.4 10.0 5.6 0.0 1.8 128.5 293.1 34.80 31.68 103 0.338 4541K 4573 0.0 0.0 L1 6/6 346.21 MB 0.0 4.8 4.5 0.4 4.8 4.4 0.1 1.1 224.3 220.5 22.12 20.45 3 7.372 5036K 83K 0.0 0.0 L2 7/7 824.17 MB 0.0 0.1 0.1 0.0 0.1 0.1 4.2 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 15/2 1.12 GB 1.0 1.9 1.0 0.9 1.8 1.0 2.4 1.9 193.8 193.5 9.78 8.20 9 1.087 1681K 788 0.0 0.0 L4 166/15 10.71 GB 1.0 2.4 1.7 0.7 2.4 1.6 1.4 1.4 126.2 125.0 19.48 11.54 15 1.299 2209K 8702 0.0 0.0 L5 1075/0 87.66 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/33 101.62 GB 0.0 13.6 7.2 6.4 19.1 12.7 10.0 3.4 160.4 225.2 86.66 72.35 131 0.662 13M 97K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.6 7.2 6.4 19.1 12.7 9.9 3.4 160.4 225.2 86.66 72.35 131 0.662 13M 97K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.6 7.2 6.4 13.5 7.1 0.0 0.0 200.9 199.3 69.17 57.52 45 1.537 13M 97K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 327.7 17.49 14.83 86 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.2 total, 38.0 interval Flush(GB): cumulative 5.599, interval 5.599 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.06 GB write, 511.35 MB/s write, 13.57 GB read, 364.12 MB/s read, 86.7 seconds Interval compaction: 19.06 GB write, 513.52 MB/s write, 13.57 GB read, 365.67 MB/s read, 86.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 22, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2427612 Average: 2.7858 StdDev: 26.04 Min: 0 Median: 1.3652 Max: 8019 Percentiles: P50: 1.37 P75: 1.79 P99: 7.57 P99.9: 159.79 P99.99: 327.56 ------------------------------------------------------ [ 0, 1 ] 691390 28.480% 28.480% ###### ( 1, 2 ] 1430638 58.932% 87.412% ############ ( 2, 3 ] 155384 6.401% 93.813% # ( 3, 4 ] 69867 2.878% 96.691% # ( 4, 6 ] 50409 2.076% 98.767% ( 6, 10 ] 14423 0.594% 99.361% ( 10, 15 ] 3644 0.150% 99.512% ( 15, 22 ] 466 0.019% 99.531% ( 22, 34 ] 65 0.003% 99.533% ( 34, 51 ] 12 0.000% 99.534% ( 51, 76 ] 28 0.001% 99.535% ( 76, 110 ] 2850 0.117% 99.652% ( 110, 170 ] 7240 0.298% 99.951% ( 170, 250 ] 677 0.028% 99.979% ( 250, 380 ] 463 0.019% 99.998% ( 380, 580 ] 84 0.003% 100.001% ( 580, 870 ] 41 0.002% 100.003% ( 870, 1300 ] 37 0.002% 100.004% ( 1300, 1900 ] 25 0.001% 100.005% ( 1900, 2900 ] 25 0.001% 100.006% ( 2900, 4400 ] 42 0.002% 100.008% ( 4400, 6600 ] 16 0.001% 100.009% ( 6600, 9900 ] 2 0.000% 100.009% ** Level 1 read latency histogram (micros): Count: 923400 Average: 5.6499 StdDev: 91.89 Min: 0 Median: 1.9446 Max: 10646 Percentiles: P50: 1.94 P75: 2.92 P99: 9.44 P99.9: 28.21 P99.99: 168.75 ------------------------------------------------------ [ 0, 1 ] 32343 3.503% 3.503% # ( 1, 2 ] 454547 49.225% 52.728% ########## ( 2, 3 ] 223380 24.191% 76.919% ##### ( 3, 4 ] 91545 9.914% 86.833% ## ( 4, 6 ] 95098 10.299% 97.132% ## ( 6, 10 ] 20068 2.173% 99.305% ( 10, 15 ] 4790 0.519% 99.824% ( 15, 22 ] 659 0.071% 99.895% ( 22, 34 ] 92 0.010% 99.905% ( 34, 51 ] 40 0.004% 99.909% ( 51, 76 ] 21 0.002% 99.912% ( 76, 110 ] 239 0.026% 99.937% ( 110, 170 ] 497 0.054% 99.991% ( 170, 250 ] 317 0.034% 100.026% ( 250, 380 ] 347 0.038% 100.063% ( 380, 580 ] 271 0.029% 100.092% ( 580, 870 ] 150 0.016% 100.109% ( 870, 1300 ] 89 0.010% 100.118% ( 1300, 1900 ] 95 0.010% 100.129% ( 1900, 2900 ] 162 0.018% 100.146% ( 2900, 4400 ] 248 0.027% 100.173% ( 4400, 6600 ] 63 0.007% 100.180% ( 6600, 9900 ] 18 0.002% 100.182% ( 9900, 14000 ] 1 0.000% 100.182% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 358719 Average: 8.7363 StdDev: 111.20 Min: 0 Median: 1.7923 Max: 8876 Percentiles: P50: 1.79 P75: 2.69 P99: 20.08 P99.9: 1044.36 P99.99: 3318.71 ------------------------------------------------------ [ 0, 1 ] 17691 4.932% 4.932% # ( 1, 2 ] 204048 56.882% 61.814% ########### ( 2, 3 ] 68448 19.081% 80.895% #### ( 3, 4 ] 31596 8.808% 89.703% ## ( 4, 6 ] 23589 6.576% 96.279% # ( 6, 10 ] 8025 2.237% 98.516% ( 10, 15 ] 1591 0.444% 98.960% ( 15, 22 ] 198 0.055% 99.015% ( 22, 34 ] 52 0.014% 99.030% ( 34, 51 ] 253 0.071% 99.100% ( 51, 76 ] 73 0.020% 99.120% ( 76, 110 ] 144 0.040% 99.161% ( 110, 170 ] 635 0.177% 99.338% ( 170, 250 ] 585 0.163% 99.501% ( 250, 380 ] 614 0.171% 99.672% ( 380, 580 ] 508 0.142% 99.814% ( 580, 870 ] 260 0.072% 99.886% ( 870, 1300 ] 124 0.035% 99.921% ( 1300, 1900 ] 70 0.020% 99.940% ( 1900, 2900 ] 130 0.036% 99.976% ( 2900, 4400 ] 176 0.049% 100.025% ( 4400, 6600 ] 21 0.006% 100.031% ( 6600, 9900 ] 4 0.001% 100.032% ** Level 4 read latency histogram (micros): Count: 46467 Average: 7.8318 StdDev: 98.38 Min: 1 Median: 2.1948 Max: 4802 Percentiles: P50: 2.19 P75: 3.23 P99: 12.20 P99.9: 1465.99 P99.99: 3835.33 ------------------------------------------------------ [ 0, 1 ] 338 0.727% 0.727% ( 1, 2 ] 20388 43.876% 44.604% ######### ( 2, 3 ] 12875 27.708% 72.312% ###### ( 3, 4 ] 5418 11.660% 83.971% ## ( 4, 6 ] 5603 12.058% 96.029% ## ( 6, 10 ] 1239 2.666% 98.696% # ( 10, 15 ] 321 0.691% 99.387% ( 15, 22 ] 42 0.090% 99.477% ( 22, 34 ] 3 0.006% 99.484% ( 34, 51 ] 5 0.011% 99.494% ( 51, 76 ] 4 0.009% 99.503% ( 76, 110 ] 2 0.004% 99.507% ( 110, 170 ] 16 0.034% 99.542% ( 170, 250 ] 49 0.105% 99.647% ( 250, 380 ] 37 0.080% 99.727% ( 380, 580 ] 31 0.067% 99.793% ( 580, 870 ] 22 0.047% 99.841% ( 870, 1300 ] 22 0.047% 99.888% ( 1300, 1900 ] 20 0.043% 99.931% ( 1900, 2900 ] 18 0.039% 99.970% ( 2900, 4400 ] 15 0.032% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ** Level 5 read latency histogram (micros): Count: 95 Average: 682.1158 StdDev: 785.18 Min: 105 Median: 388.3333 Max: 4650 Percentiles: P50: 388.33 P75: 853.27 P99: 4510.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 76, 110 ] 1 1.053% 1.053% ( 110, 170 ] 9 9.474% 10.526% ## ( 170, 250 ] 18 18.947% 29.474% #### ( 250, 380 ] 19 20.000% 49.474% #### ( 380, 580 ] 12 12.632% 62.105% ### ( 580, 870 ] 13 13.684% 75.789% ### ( 870, 1300 ] 15 15.789% 91.579% ### ( 1300, 1900 ] 3 3.158% 94.737% # ( 1900, 2900 ] 1 1.053% 95.789% ( 2900, 4400 ] 3 3.158% 98.947% # ( 4400, 6600 ] 1 1.053% 100.000% ** DB Stats ** Uptime(secs): 38.2 total, 21.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 154.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.523 H:M:S, 51.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 45.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:17.637 H:M:S, 80.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-09:25:03 ... thread 0: (1000000,7000000) ops and (284673.6,168599.4) ops/second in (3.512795,41.518545) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 1.66 GB 44.1 4.9 0.0 4.9 11.5 6.6 0.0 1.7 123.7 292.7 40.23 36.56 120 0.335 5053K 5074 0.0 0.0 L1 5/5 480.92 MB 0.0 5.6 4.9 0.7 5.5 4.8 0.1 1.1 212.2 209.0 26.78 23.89 4 6.695 5419K 83K 0.0 0.0 L2 1/0 59.90 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.4 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 20/1 1.00 GB 1.0 3.6 2.0 1.6 3.6 2.0 2.4 1.8 186.3 185.7 19.73 16.50 13 1.517 2781K 3218 0.0 0.0 L4 171/15 10.82 GB 1.0 2.6 1.8 0.8 2.6 1.8 2.3 1.4 129.7 128.6 20.48 12.47 17 1.205 2401K 9285 0.0 0.0 L5 1087/0 88.65 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1298/31 102.66 GB 0.0 16.7 8.7 8.0 23.2 15.2 12.1 3.5 158.8 220.8 107.70 89.87 155 0.695 15M 101K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.7 8.7 8.0 23.2 15.2 12.1 3.5 158.8 220.8 107.70 89.87 155 0.695 15M 101K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.7 8.7 8.0 16.6 8.6 0.0 0.0 196.9 195.4 86.87 72.20 54 1.609 15M 101K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 326.7 20.83 17.68 101 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.7 total, 41.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.22 GB write, 570.56 MB/s write, 16.70 GB read, 410.32 MB/s read, 107.7 seconds Interval compaction: 23.22 GB write, 572.78 MB/s write, 16.70 GB read, 411.91 MB/s read, 107.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 27, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2725670 Average: 2.8044 StdDev: 25.52 Min: 0 Median: 1.4103 Max: 8019 Percentiles: P50: 1.41 P75: 1.83 P99: 7.73 P99.9: 157.85 P99.99: 314.59 ------------------------------------------------------ [ 0, 1 ] 703968 25.827% 25.827% ##### ( 1, 2 ] 1605863 58.916% 84.744% ############ ( 2, 3 ] 214339 7.864% 92.607% ## ( 3, 4 ] 94133 3.454% 96.061% # ( 4, 6 ] 72019 2.642% 98.703% # ( 6, 10 ] 18679 0.685% 99.388% ( 10, 15 ] 4583 0.168% 99.557% ( 15, 22 ] 562 0.021% 99.577% ( 22, 34 ] 70 0.003% 99.580% ( 34, 51 ] 14 0.001% 99.580% ( 51, 76 ] 29 0.001% 99.581% ( 76, 110 ] 2861 0.105% 99.686% ( 110, 170 ] 7305 0.268% 99.954% ( 170, 250 ] 729 0.027% 99.981% ( 250, 380 ] 492 0.018% 99.999% ( 380, 580 ] 91 0.003% 100.002% ( 580, 870 ] 48 0.002% 100.004% ( 870, 1300 ] 40 0.001% 100.006% ( 1300, 1900 ] 31 0.001% 100.007% ( 1900, 2900 ] 32 0.001% 100.008% ( 2900, 4400 ] 47 0.002% 100.010% ( 4400, 6600 ] 16 0.001% 100.010% ( 6600, 9900 ] 2 0.000% 100.010% ** Level 1 read latency histogram (micros): Count: 1226566 Average: 5.2595 StdDev: 82.34 Min: 0 Median: 1.9489 Max: 10646 Percentiles: P50: 1.95 P75: 2.92 P99: 9.49 P99.9: 34.17 P99.99: 164.79 ------------------------------------------------------ [ 0, 1 ] 35365 2.883% 2.883% # ( 1, 2 ] 609027 49.653% 52.536% ########## ( 2, 3 ] 298326 24.322% 76.858% ##### ( 3, 4 ] 122598 9.995% 86.854% ## ( 4, 6 ] 124084 10.116% 96.970% ## ( 6, 10 ] 28543 2.327% 99.297% ( 10, 15 ] 6441 0.525% 99.822% ( 15, 22 ] 852 0.069% 99.892% ( 22, 34 ] 103 0.008% 99.900% ( 34, 51 ] 43 0.004% 99.903% ( 51, 76 ] 26 0.002% 99.906% ( 76, 110 ] 314 0.026% 99.931% ( 110, 170 ] 790 0.064% 99.996% ( 170, 250 ] 500 0.041% 100.036% ( 250, 380 ] 452 0.037% 100.073% ( 380, 580 ] 321 0.026% 100.099% ( 580, 870 ] 171 0.014% 100.113% ( 870, 1300 ] 92 0.008% 100.121% ( 1300, 1900 ] 97 0.008% 100.129% ( 1900, 2900 ] 215 0.018% 100.146% ( 2900, 4400 ] 260 0.021% 100.167% ( 4400, 6600 ] 63 0.005% 100.173% ( 6600, 9900 ] 18 0.001% 100.174% ( 9900, 14000 ] 1 0.000% 100.174% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 428080 Average: 7.9787 StdDev: 102.55 Min: 0 Median: 1.8096 Max: 8876 Percentiles: P50: 1.81 P75: 2.72 P99: 14.29 P99.9: 832.60 P99.99: 3078.58 ------------------------------------------------------ [ 0, 1 ] 18934 4.423% 4.423% # ( 1, 2 ] 240983 56.294% 60.717% ########### ( 2, 3 ] 84713 19.789% 80.506% #### ( 3, 4 ] 38465 8.985% 89.491% ## ( 4, 6 ] 29980 7.003% 96.495% # ( 6, 10 ] 9194 2.148% 98.643% ( 10, 15 ] 1782 0.416% 99.059% ( 15, 22 ] 215 0.050% 99.109% ( 22, 34 ] 52 0.012% 99.121% ( 34, 51 ] 254 0.059% 99.181% ( 51, 76 ] 74 0.017% 99.198% ( 76, 110 ] 164 0.038% 99.236% ( 110, 170 ] 736 0.172% 99.408% ( 170, 250 ] 659 0.154% 99.562% ( 250, 380 ] 683 0.160% 99.722% ( 380, 580 ] 527 0.123% 99.845% ( 580, 870 ] 272 0.064% 99.908% ( 870, 1300 ] 126 0.029% 99.938% ( 1300, 1900 ] 72 0.017% 99.954% ( 1900, 2900 ] 131 0.031% 99.985% ( 2900, 4400 ] 178 0.042% 100.027% ( 4400, 6600 ] 21 0.005% 100.032% ( 6600, 9900 ] 4 0.001% 100.032% ** Level 4 read latency histogram (micros): Count: 47749 Average: 8.5877 StdDev: 98.92 Min: 1 Median: 2.1915 Max: 4802 Percentiles: P50: 2.19 P75: 3.24 P99: 14.63 P99.9: 1457.53 P99.99: 3822.51 ------------------------------------------------------ [ 0, 1 ] 374 0.783% 0.783% ( 1, 2 ] 20986 43.951% 44.734% ######### ( 2, 3 ] 13128 27.494% 72.228% ##### ( 3, 4 ] 5537 11.596% 83.824% ## ( 4, 6 ] 5682 11.900% 95.723% ## ( 6, 10 ] 1262 2.643% 98.366% # ( 10, 15 ] 327 0.685% 99.051% ( 15, 22 ] 42 0.088% 99.139% ( 22, 34 ] 4 0.008% 99.148% ( 34, 51 ] 5 0.010% 99.158% ( 51, 76 ] 5 0.010% 99.169% ( 76, 110 ] 11 0.023% 99.192% ( 110, 170 ] 69 0.145% 99.336% ( 170, 250 ] 99 0.207% 99.543% ( 250, 380 ] 68 0.142% 99.686% ( 380, 580 ] 40 0.084% 99.770% ( 580, 870 ] 35 0.073% 99.843% ( 870, 1300 ] 23 0.048% 99.891% ( 1300, 1900 ] 20 0.042% 99.933% ( 1900, 2900 ] 19 0.040% 99.973% ( 2900, 4400 ] 15 0.031% 100.004% ( 4400, 6600 ] 2 0.004% 100.008% ** Level 5 read latency histogram (micros): Count: 155 Average: 575.5419 StdDev: 654.93 Min: 101 Median: 348.4286 Max: 4650 Percentiles: P50: 348.43 P75: 728.62 P99: 4125.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 76, 110 ] 3 1.935% 1.935% ( 110, 170 ] 15 9.677% 11.613% ## ( 170, 250 ] 33 21.290% 32.903% #### ( 250, 380 ] 35 22.581% 55.484% ##### ( 380, 580 ] 20 12.903% 68.387% ### ( 580, 870 ] 20 12.903% 81.290% ### ( 870, 1300 ] 21 13.548% 94.839% ### ( 1300, 1900 ] 3 1.935% 96.774% ( 1900, 2900 ] 1 0.645% 97.419% ( 2900, 4400 ] 3 1.935% 99.355% ( 4400, 6600 ] 1 0.645% 100.000% ** DB Stats ** Uptime(secs): 41.7 total, 3.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 165.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.899 H:M:S, 47.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.376 H:M:S, 10.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/13-09:25:06 ... thread 0: (1000000,8000000) ops and (327426.8,179482.2) ops/second in (3.054118,44.572663) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 2.64 GB 151.0 5.9 0.0 5.9 13.5 7.6 0.0 1.8 128.2 293.5 47.19 43.23 139 0.340 6140K 6205 0.0 0.0 L1 5/5 480.92 MB 0.0 5.6 4.9 0.7 5.5 4.8 0.1 1.1 212.2 209.0 26.78 23.89 4 6.695 5419K 83K 0.0 0.0 L2 1/0 59.90 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.4 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 19/0 970.79 MB 1.0 3.6 2.0 1.6 3.6 2.0 2.4 1.8 186.3 185.7 19.73 16.50 13 1.517 2781K 3218 0.0 0.0 L4 156/0 9.65 GB 1.0 3.8 1.9 1.9 3.7 1.8 2.3 2.0 147.9 144.9 26.42 17.42 18 1.468 2905K 9285 0.0 0.0 L5 1106/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/15 103.59 GB 0.0 19.0 8.8 10.2 26.4 16.2 13.3 3.5 161.1 224.3 120.61 101.49 175 0.689 17M 102K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.0 8.8 10.2 26.4 16.2 13.2 3.5 161.1 224.3 120.61 101.49 175 0.689 17M 102K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.0 8.8 10.2 18.8 8.6 0.0 0.0 200.3 198.4 97.01 81.26 59 1.644 17M 102K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 331.0 23.60 20.23 116 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.7 total, 44.6 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.42 GB write, 604.76 MB/s write, 18.97 GB read, 434.21 MB/s read, 120.6 seconds Interval compaction: 26.42 GB write, 606.95 MB/s write, 18.97 GB read, 435.78 MB/s read, 120.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 28, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3097479 Average: 2.7485 StdDev: 24.03 Min: 0 Median: 1.4315 Max: 8019 Percentiles: P50: 1.43 P75: 1.85 P99: 7.58 P99.9: 153.84 P99.99: 264.65 ------------------------------------------------------ [ 0, 1 ] 748713 24.172% 24.172% ##### ( 1, 2 ] 1854178 59.861% 84.033% ############ ( 2, 3 ] 261782 8.451% 92.484% ## ( 3, 4 ] 111192 3.590% 96.074% # ( 4, 6 ] 81868 2.643% 98.717% # ( 6, 10 ] 22257 0.719% 99.435% ( 10, 15 ] 5400 0.174% 99.610% ( 15, 22 ] 625 0.020% 99.630% ( 22, 34 ] 77 0.002% 99.632% ( 34, 51 ] 14 0.000% 99.633% ( 51, 76 ] 35 0.001% 99.634% ( 76, 110 ] 2886 0.093% 99.727% ( 110, 170 ] 7330 0.237% 99.964% ( 170, 250 ] 756 0.024% 99.988% ( 250, 380 ] 508 0.016% 100.005% ( 380, 580 ] 96 0.003% 100.008% ( 580, 870 ] 52 0.002% 100.009% ( 870, 1300 ] 44 0.001% 100.011% ( 1300, 1900 ] 32 0.001% 100.012% ( 1900, 2900 ] 32 0.001% 100.013% ( 2900, 4400 ] 47 0.002% 100.014% ( 4400, 6600 ] 16 0.001% 100.015% ( 6600, 9900 ] 2 0.000% 100.015% ** Level 1 read latency histogram (micros): Count: 1296363 Average: 5.1254 StdDev: 80.12 Min: 0 Median: 1.9250 Max: 10646 Percentiles: P50: 1.92 P75: 2.89 P99: 9.47 P99.9: 80.70 P99.99: 167.75 ------------------------------------------------------ [ 0, 1 ] 41190 3.177% 3.177% # ( 1, 2 ] 656236 50.621% 53.799% ########## ( 2, 3 ] 308496 23.797% 77.596% ##### ( 3, 4 ] 125657 9.693% 87.289% ## ( 4, 6 ] 125918 9.713% 97.002% ## ( 6, 10 ] 29900 2.306% 99.308% ( 10, 15 ] 6584 0.508% 99.816% ( 15, 22 ] 860 0.066% 99.883% ( 22, 34 ] 103 0.008% 99.891% ( 34, 51 ] 44 0.003% 99.894% ( 51, 76 ] 26 0.002% 99.896% ( 76, 110 ] 381 0.029% 99.925% ( 110, 170 ] 871 0.067% 99.993% ( 170, 250 ] 531 0.041% 100.033% ( 250, 380 ] 461 0.036% 100.069% ( 380, 580 ] 324 0.025% 100.094% ( 580, 870 ] 171 0.013% 100.107% ( 870, 1300 ] 92 0.007% 100.114% ( 1300, 1900 ] 97 0.007% 100.122% ( 1900, 2900 ] 215 0.017% 100.138% ( 2900, 4400 ] 260 0.020% 100.158% ( 4400, 6600 ] 63 0.005% 100.163% ( 6600, 9900 ] 18 0.001% 100.165% ( 9900, 14000 ] 1 0.000% 100.165% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 428080 Average: 7.9787 StdDev: 102.55 Min: 0 Median: 1.8096 Max: 8876 Percentiles: P50: 1.81 P75: 2.72 P99: 14.29 P99.9: 832.60 P99.99: 3078.58 ------------------------------------------------------ [ 0, 1 ] 18934 4.423% 4.423% # ( 1, 2 ] 240983 56.294% 60.717% ########### ( 2, 3 ] 84713 19.789% 80.506% #### ( 3, 4 ] 38465 8.985% 89.491% ## ( 4, 6 ] 29980 7.003% 96.495% # ( 6, 10 ] 9194 2.148% 98.643% ( 10, 15 ] 1782 0.416% 99.059% ( 15, 22 ] 215 0.050% 99.109% ( 22, 34 ] 52 0.012% 99.121% ( 34, 51 ] 254 0.059% 99.181% ( 51, 76 ] 74 0.017% 99.198% ( 76, 110 ] 164 0.038% 99.236% ( 110, 170 ] 736 0.172% 99.408% ( 170, 250 ] 659 0.154% 99.562% ( 250, 380 ] 683 0.160% 99.722% ( 380, 580 ] 527 0.123% 99.845% ( 580, 870 ] 272 0.064% 99.908% ( 870, 1300 ] 126 0.029% 99.938% ( 1300, 1900 ] 72 0.017% 99.954% ( 1900, 2900 ] 131 0.031% 99.985% ( 2900, 4400 ] 178 0.042% 100.027% ( 4400, 6600 ] 21 0.005% 100.032% ( 6600, 9900 ] 4 0.001% 100.032% ** Level 4 read latency histogram (micros): Count: 47806 Average: 8.7219 StdDev: 99.07 Min: 1 Median: 2.1917 Max: 4802 Percentiles: P50: 2.19 P75: 3.24 P99: 14.98 P99.9: 1455.82 P99.99: 3821.94 ------------------------------------------------------ [ 0, 1 ] 383 0.801% 0.801% ( 1, 2 ] 21002 43.932% 44.733% ######### ( 2, 3 ] 13134 27.474% 72.206% ##### ( 3, 4 ] 5538 11.584% 83.791% ## ( 4, 6 ] 5683 11.888% 95.678% ## ( 6, 10 ] 1262 2.640% 98.318% # ( 10, 15 ] 327 0.684% 99.002% ( 15, 22 ] 42 0.088% 99.090% ( 22, 34 ] 4 0.008% 99.098% ( 34, 51 ] 5 0.010% 99.109% ( 51, 76 ] 5 0.010% 99.119% ( 76, 110 ] 11 0.023% 99.142% ( 110, 170 ] 70 0.146% 99.289% ( 170, 250 ] 106 0.222% 99.511% ( 250, 380 ] 79 0.165% 99.676% ( 380, 580 ] 44 0.092% 99.768% ( 580, 870 ] 35 0.073% 99.841% ( 870, 1300 ] 23 0.048% 99.889% ( 1300, 1900 ] 20 0.042% 99.931% ( 1900, 2900 ] 19 0.040% 99.971% ( 2900, 4400 ] 15 0.031% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ** Level 5 read latency histogram (micros): Count: 155 Average: 575.5419 StdDev: 654.93 Min: 101 Median: 348.4286 Max: 4650 Percentiles: P50: 348.43 P75: 728.62 P99: 4125.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 76, 110 ] 3 1.935% 1.935% ( 110, 170 ] 15 9.677% 11.613% ## ( 170, 250 ] 33 21.290% 32.903% #### ( 250, 380 ] 35 22.581% 55.484% ##### ( 380, 580 ] 20 12.903% 68.387% ### ( 580, 870 ] 20 12.903% 81.290% ### ( 870, 1300 ] 21 13.548% 94.839% ### ( 1300, 1900 ] 3 1.935% 96.774% ( 1900, 2900 ] 1 0.645% 97.419% ( 2900, 4400 ] 3 1.935% 99.355% ( 4400, 6600 ] 1 0.645% 100.000% ** DB Stats ** Uptime(secs): 44.7 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 175.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.071 H:M:S, 44.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.171 H:M:S, 5.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-09:25:09 ... thread 0: (1000000,9000000) ops and (355371.5,189927.0) ops/second in (2.813957,47.386620) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.58 GB 214.0 6.7 0.0 6.7 15.2 8.5 0.0 1.8 130.3 295.0 52.72 48.53 156 0.338 6972K 7081 0.0 0.0 L1 18/0 1.38 GB 141.7 6.9 5.8 1.2 6.9 5.7 0.1 1.2 213.3 210.5 33.32 30.17 5 6.664 6867K 91K 0.0 0.0 L2 1/0 59.90 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.4 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 19/0 970.79 MB 1.0 3.6 2.0 1.6 3.6 2.0 2.4 1.8 186.3 185.7 19.73 16.50 13 1.517 2781K 3218 0.0 0.0 L4 156/0 9.65 GB 1.0 3.8 1.9 1.9 3.7 1.8 2.3 2.0 147.9 144.9 26.42 17.42 18 1.468 2905K 9285 0.0 0.0 L5 1106/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1316/8 104.44 GB 0.0 21.2 9.7 11.5 29.5 18.0 13.3 3.5 163.3 227.4 132.67 113.07 193 0.687 19M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.2 9.7 11.5 29.5 18.0 13.2 3.5 163.3 227.4 132.67 113.07 193 0.687 19M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.2 9.7 11.5 21.0 9.5 0.0 0.0 203.2 201.4 106.65 90.59 63 1.693 19M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 334.1 26.02 22.47 130 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.5 total, 47.4 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.47 GB write, 634.57 MB/s write, 21.16 GB read, 455.74 MB/s read, 132.7 seconds Interval compaction: 29.47 GB write, 636.73 MB/s write, 21.16 GB read, 457.29 MB/s read, 132.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 28, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3341170 Average: 2.6984 StdDev: 23.22 Min: 0 Median: 1.4311 Max: 8019 Percentiles: P50: 1.43 P75: 1.85 P99: 7.38 P99.9: 151.98 P99.99: 257.33 ------------------------------------------------------ [ 0, 1 ] 802696 24.024% 24.024% ##### ( 1, 2 ] 2013137 60.252% 84.277% ############ ( 2, 3 ] 281379 8.422% 92.698% ## ( 3, 4 ] 117924 3.529% 96.228% # ( 4, 6 ] 84502 2.529% 98.757% # ( 6, 10 ] 23575 0.706% 99.463% ( 10, 15 ] 5822 0.174% 99.637% ( 15, 22 ] 645 0.019% 99.656% ( 22, 34 ] 82 0.002% 99.659% ( 34, 51 ] 15 0.000% 99.659% ( 51, 76 ] 38 0.001% 99.660% ( 76, 110 ] 2886 0.086% 99.747% ( 110, 170 ] 7330 0.219% 99.966% ( 170, 250 ] 777 0.023% 99.989% ( 250, 380 ] 512 0.015% 100.004% ( 380, 580 ] 97 0.003% 100.007% ( 580, 870 ] 54 0.002% 100.009% ( 870, 1300 ] 47 0.001% 100.010% ( 1300, 1900 ] 35 0.001% 100.011% ( 1900, 2900 ] 32 0.001% 100.012% ( 2900, 4400 ] 47 0.001% 100.014% ( 4400, 6600 ] 16 0.000% 100.014% ( 6600, 9900 ] 2 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1348776 Average: 5.0371 StdDev: 78.59 Min: 0 Median: 1.9069 Max: 10646 Percentiles: P50: 1.91 P75: 2.86 P99: 9.45 P99.9: 88.90 P99.99: 171.74 ------------------------------------------------------ [ 0, 1 ] 46647 3.458% 3.458% # ( 1, 2 ] 692174 51.319% 54.777% ########## ( 2, 3 ] 315495 23.391% 78.168% ##### ( 3, 4 ] 127451 9.449% 87.618% ## ( 4, 6 ] 126884 9.407% 97.025% ## ( 6, 10 ] 30858 2.288% 99.313% ( 10, 15 ] 6706 0.497% 99.810% ( 15, 22 ] 872 0.065% 99.875% ( 22, 34 ] 104 0.008% 99.882% ( 34, 51 ] 44 0.003% 99.886% ( 51, 76 ] 26 0.002% 99.888% ( 76, 110 ] 438 0.032% 99.920% ( 110, 170 ] 930 0.069% 99.989% ( 170, 250 ] 558 0.041% 100.030% ( 250, 380 ] 469 0.035% 100.065% ( 380, 580 ] 335 0.025% 100.090% ( 580, 870 ] 173 0.013% 100.103% ( 870, 1300 ] 94 0.007% 100.110% ( 1300, 1900 ] 97 0.007% 100.117% ( 1900, 2900 ] 215 0.016% 100.133% ( 2900, 4400 ] 260 0.019% 100.152% ( 4400, 6600 ] 63 0.005% 100.157% ( 6600, 9900 ] 18 0.001% 100.158% ( 9900, 14000 ] 1 0.000% 100.158% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 428080 Average: 7.9787 StdDev: 102.55 Min: 0 Median: 1.8096 Max: 8876 Percentiles: P50: 1.81 P75: 2.72 P99: 14.29 P99.9: 832.60 P99.99: 3078.58 ------------------------------------------------------ [ 0, 1 ] 18934 4.423% 4.423% # ( 1, 2 ] 240983 56.294% 60.717% ########### ( 2, 3 ] 84713 19.789% 80.506% #### ( 3, 4 ] 38465 8.985% 89.491% ## ( 4, 6 ] 29980 7.003% 96.495% # ( 6, 10 ] 9194 2.148% 98.643% ( 10, 15 ] 1782 0.416% 99.059% ( 15, 22 ] 215 0.050% 99.109% ( 22, 34 ] 52 0.012% 99.121% ( 34, 51 ] 254 0.059% 99.181% ( 51, 76 ] 74 0.017% 99.198% ( 76, 110 ] 164 0.038% 99.236% ( 110, 170 ] 736 0.172% 99.408% ( 170, 250 ] 659 0.154% 99.562% ( 250, 380 ] 683 0.160% 99.722% ( 380, 580 ] 527 0.123% 99.845% ( 580, 870 ] 272 0.064% 99.908% ( 870, 1300 ] 126 0.029% 99.938% ( 1300, 1900 ] 72 0.017% 99.954% ( 1900, 2900 ] 131 0.031% 99.985% ( 2900, 4400 ] 178 0.042% 100.027% ( 4400, 6600 ] 21 0.005% 100.032% ( 6600, 9900 ] 4 0.001% 100.032% ** Level 4 read latency histogram (micros): Count: 47806 Average: 8.7219 StdDev: 99.07 Min: 1 Median: 2.1917 Max: 4802 Percentiles: P50: 2.19 P75: 3.24 P99: 14.98 P99.9: 1455.82 P99.99: 3821.94 ------------------------------------------------------ [ 0, 1 ] 383 0.801% 0.801% ( 1, 2 ] 21002 43.932% 44.733% ######### ( 2, 3 ] 13134 27.474% 72.206% ##### ( 3, 4 ] 5538 11.584% 83.791% ## ( 4, 6 ] 5683 11.888% 95.678% ## ( 6, 10 ] 1262 2.640% 98.318% # ( 10, 15 ] 327 0.684% 99.002% ( 15, 22 ] 42 0.088% 99.090% ( 22, 34 ] 4 0.008% 99.098% ( 34, 51 ] 5 0.010% 99.109% ( 51, 76 ] 5 0.010% 99.119% ( 76, 110 ] 11 0.023% 99.142% ( 110, 170 ] 70 0.146% 99.289% ( 170, 250 ] 106 0.222% 99.511% ( 250, 380 ] 79 0.165% 99.676% ( 380, 580 ] 44 0.092% 99.768% ( 580, 870 ] 35 0.073% 99.841% ( 870, 1300 ] 23 0.048% 99.889% ( 1300, 1900 ] 20 0.042% 99.931% ( 1900, 2900 ] 19 0.040% 99.971% ( 2900, 4400 ] 15 0.031% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ** Level 5 read latency histogram (micros): Count: 155 Average: 575.5419 StdDev: 654.93 Min: 101 Median: 348.4286 Max: 4650 Percentiles: P50: 348.43 P75: 728.62 P99: 4125.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 76, 110 ] 3 1.935% 1.935% ( 110, 170 ] 15 9.677% 11.613% ## ( 170, 250 ] 33 21.290% 32.903% #### ( 250, 380 ] 35 22.581% 55.484% ##### ( 380, 580 ] 20 12.903% 68.387% ### ( 580, 870 ] 20 12.903% 81.290% ### ( 870, 1300 ] 21 13.548% 94.839% ### ( 1300, 1900 ] 3 1.935% 96.774% ( 1900, 2900 ] 1 0.645% 97.419% ( 2900, 4400 ] 3 1.935% 99.355% ( 4400, 6600 ] 1 0.645% 100.000% ** DB Stats ** Uptime(secs): 47.5 total, 2.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 186.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.071 H:M:S, 42.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-09:25:14 ... thread 0: (1000000,10000000) ops and (199690.3,190860.2) ops/second in (5.007755,52.394375) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.69 GB 56.7 7.9 0.0 7.9 17.5 9.6 0.0 1.8 134.1 296.2 60.59 56.10 178 0.340 8251K 8344 0.0 0.0 L1 18/18 1.38 GB 0.0 6.9 5.8 1.2 6.9 5.7 0.1 1.2 213.3 210.5 33.32 30.17 5 6.664 6867K 91K 0.0 0.0 L2 1/0 59.90 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.4 1.8 230.9 230.8 0.48 0.46 1 0.483 113K 28 0.0 0.0 L3 19/0 970.79 MB 1.0 3.6 2.0 1.6 3.6 2.0 2.4 1.8 186.3 185.7 19.73 16.50 13 1.517 2781K 3218 0.0 0.0 L4 156/0 9.65 GB 1.0 3.8 1.9 1.9 3.7 1.8 2.3 2.0 147.9 144.9 26.42 17.42 18 1.468 2905K 9285 0.0 0.0 L5 1106/0 89.81 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1318/33 105.55 GB 0.0 22.4 9.7 12.7 31.8 19.1 13.3 3.3 163.2 231.7 140.54 120.64 215 0.654 20M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.4 9.7 12.7 31.8 19.1 13.2 3.3 163.2 231.7 140.54 120.64 215 0.654 20M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.4 9.7 12.7 22.2 9.5 0.0 0.0 205.7 204.0 111.47 95.32 68 1.639 20M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.6 9.6 0.0 0.0 0.0 338.0 29.07 25.33 147 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.6 total, 52.4 interval Flush(GB): cumulative 9.597, interval 9.597 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.80 GB write, 619.63 MB/s write, 22.39 GB read, 436.29 MB/s read, 140.5 seconds Interval compaction: 31.80 GB write, 621.53 MB/s write, 22.39 GB read, 437.63 MB/s read, 140.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 30, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3748934 Average: 2.6300 StdDev: 22.03 Min: 0 Median: 1.4278 Max: 8019 Percentiles: P50: 1.43 P75: 1.84 P99: 7.04 P99.9: 149.16 P99.99: 246.68 ------------------------------------------------------ [ 0, 1 ] 899638 23.997% 23.997% ##### ( 1, 2 ] 2278935 60.789% 84.786% ############ ( 2, 3 ] 309958 8.268% 93.054% ## ( 3, 4 ] 128053 3.416% 96.470% # ( 4, 6 ] 88240 2.354% 98.823% ( 6, 10 ] 25501 0.680% 99.504% ( 10, 15 ] 6187 0.165% 99.669% ( 15, 22 ] 701 0.019% 99.687% ( 22, 34 ] 87 0.002% 99.690% ( 34, 51 ] 17 0.000% 99.690% ( 51, 76 ] 41 0.001% 99.691% ( 76, 110 ] 2958 0.079% 99.770% ( 110, 170 ] 7463 0.199% 99.969% ( 170, 250 ] 816 0.022% 99.991% ( 250, 380 ] 523 0.014% 100.005% ( 380, 580 ] 103 0.003% 100.008% ( 580, 870 ] 62 0.002% 100.009% ( 870, 1300 ] 47 0.001% 100.011% ( 1300, 1900 ] 38 0.001% 100.012% ( 1900, 2900 ] 32 0.001% 100.012% ( 2900, 4400 ] 47 0.001% 100.014% ( 4400, 6600 ] 16 0.000% 100.014% ( 6600, 9900 ] 2 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1393444 Average: 4.9527 StdDev: 77.33 Min: 0 Median: 1.8877 Max: 10646 Percentiles: P50: 1.89 P75: 2.84 P99: 9.43 P99.9: 92.94 P99.99: 172.91 ------------------------------------------------------ [ 0, 1 ] 56642 4.065% 4.065% # ( 1, 2 ] 721075 51.748% 55.813% ########## ( 2, 3 ] 318688 22.871% 78.683% ##### ( 3, 4 ] 128570 9.227% 87.910% ## ( 4, 6 ] 127527 9.152% 97.062% ## ( 6, 10 ] 31472 2.259% 99.320% ( 10, 15 ] 6770 0.486% 99.806% ( 15, 22 ] 879 0.063% 99.869% ( 22, 34 ] 107 0.008% 99.877% ( 34, 51 ] 45 0.003% 99.880% ( 51, 76 ] 27 0.002% 99.882% ( 76, 110 ] 501 0.036% 99.918% ( 110, 170 ] 982 0.070% 99.989% ( 170, 250 ] 568 0.041% 100.029% ( 250, 380 ] 470 0.034% 100.063% ( 380, 580 ] 336 0.024% 100.087% ( 580, 870 ] 174 0.012% 100.100% ( 870, 1300 ] 94 0.007% 100.106% ( 1300, 1900 ] 97 0.007% 100.113% ( 1900, 2900 ] 215 0.015% 100.129% ( 2900, 4400 ] 260 0.019% 100.147% ( 4400, 6600 ] 63 0.005% 100.152% ( 6600, 9900 ] 18 0.001% 100.153% ( 9900, 14000 ] 1 0.000% 100.153% ** Level 2 read latency histogram (micros): Count: 28305 Average: 2.0308 StdDev: 4.82 Min: 1 Median: 1.3276 Max: 391 Percentiles: P50: 1.33 P75: 1.76 P99: 7.52 P99.9: 14.47 P99.99: 233.39 ------------------------------------------------------ [ 0, 1 ] 8767 30.973% 30.973% ###### ( 1, 2 ] 16440 58.082% 89.055% ############ ( 2, 3 ] 1756 6.204% 95.259% # ( 3, 4 ] 559 1.975% 97.234% ( 4, 6 ] 376 1.328% 98.562% ( 6, 10 ] 326 1.152% 99.714% ( 10, 15 ] 59 0.208% 99.922% ( 15, 22 ] 6 0.021% 99.943% ( 110, 170 ] 10 0.035% 99.979% ( 170, 250 ] 4 0.014% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 380, 580 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 428080 Average: 7.9787 StdDev: 102.55 Min: 0 Median: 1.8096 Max: 8876 Percentiles: P50: 1.81 P75: 2.72 P99: 14.29 P99.9: 832.60 P99.99: 3078.58 ------------------------------------------------------ [ 0, 1 ] 18934 4.423% 4.423% # ( 1, 2 ] 240983 56.294% 60.717% ########### ( 2, 3 ] 84713 19.789% 80.506% #### ( 3, 4 ] 38465 8.985% 89.491% ## ( 4, 6 ] 29980 7.003% 96.495% # ( 6, 10 ] 9194 2.148% 98.643% ( 10, 15 ] 1782 0.416% 99.059% ( 15, 22 ] 215 0.050% 99.109% ( 22, 34 ] 52 0.012% 99.121% ( 34, 51 ] 254 0.059% 99.181% ( 51, 76 ] 74 0.017% 99.198% ( 76, 110 ] 164 0.038% 99.236% ( 110, 170 ] 736 0.172% 99.408% ( 170, 250 ] 659 0.154% 99.562% ( 250, 380 ] 683 0.160% 99.722% ( 380, 580 ] 527 0.123% 99.845% ( 580, 870 ] 272 0.064% 99.908% ( 870, 1300 ] 126 0.029% 99.938% ( 1300, 1900 ] 72 0.017% 99.954% ( 1900, 2900 ] 131 0.031% 99.985% ( 2900, 4400 ] 178 0.042% 100.027% ( 4400, 6600 ] 21 0.005% 100.032% ( 6600, 9900 ] 4 0.001% 100.032% ** Level 4 read latency histogram (micros): Count: 47806 Average: 8.7219 StdDev: 99.07 Min: 1 Median: 2.1917 Max: 4802 Percentiles: P50: 2.19 P75: 3.24 P99: 14.98 P99.9: 1455.82 P99.99: 3821.94 ------------------------------------------------------ [ 0, 1 ] 383 0.801% 0.801% ( 1, 2 ] 21002 43.932% 44.733% ######### ( 2, 3 ] 13134 27.474% 72.206% ##### ( 3, 4 ] 5538 11.584% 83.791% ## ( 4, 6 ] 5683 11.888% 95.678% ## ( 6, 10 ] 1262 2.640% 98.318% # ( 10, 15 ] 327 0.684% 99.002% ( 15, 22 ] 42 0.088% 99.090% ( 22, 34 ] 4 0.008% 99.098% ( 34, 51 ] 5 0.010% 99.109% ( 51, 76 ] 5 0.010% 99.119% ( 76, 110 ] 11 0.023% 99.142% ( 110, 170 ] 70 0.146% 99.289% ( 170, 250 ] 106 0.222% 99.511% ( 250, 380 ] 79 0.165% 99.676% ( 380, 580 ] 44 0.092% 99.768% ( 580, 870 ] 35 0.073% 99.841% ( 870, 1300 ] 23 0.048% 99.889% ( 1300, 1900 ] 20 0.042% 99.931% ( 1900, 2900 ] 19 0.040% 99.971% ( 2900, 4400 ] 15 0.031% 100.002% ( 4400, 6600 ] 2 0.004% 100.006% ** Level 5 read latency histogram (micros): Count: 155 Average: 575.5419 StdDev: 654.93 Min: 101 Median: 348.4286 Max: 4650 Percentiles: P50: 348.43 P75: 728.62 P99: 4125.00 P99.9: 4650.00 P99.99: 4650.00 ------------------------------------------------------ ( 76, 110 ] 3 1.935% 1.935% ( 110, 170 ] 15 9.677% 11.613% ## ( 170, 250 ] 33 21.290% 32.903% #### ( 250, 380 ] 35 22.581% 55.484% ##### ( 380, 580 ] 20 12.903% 68.387% ### ( 580, 870 ] 20 12.903% 81.290% ### ( 870, 1300 ] 21 13.548% 94.839% ### ( 1300, 1900 ] 3 1.935% 96.774% ( 1900, 2900 ] 1 0.645% 97.419% ( 2900, 4400 ] 3 1.935% 99.355% ( 4400, 6600 ] 1 0.645% 100.000% ** DB Stats ** Uptime(secs): 52.6 total, 5.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 187.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.262 H:M:S, 42.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.191 H:M:S, 43.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.979 micros/op 167244 ops/sec 60.110 seconds 10052999 operations; 162.0 MB/s Microseconds per write: Count: 10052999 Average: 5.9793 StdDev: 297.68 Min: 0 Median: 1.8027 Max: 644215 Percentiles: P50: 1.80 P75: 3.14 P99: 9.96 P99.9: 1162.54 P99.99: 2717.30 ------------------------------------------------------ [ 0, 1 ] 1246032 12.395% 12.395% ## ( 1, 2 ] 4709938 46.851% 59.246% ######### ( 2, 3 ] 1395859 13.885% 73.131% ### ( 3, 4 ] 1372243 13.650% 86.781% ### ( 4, 6 ] 1056467 10.509% 97.290% ## ( 6, 10 ] 173720 1.728% 99.018% ( 10, 15 ] 49490 0.492% 99.510% ( 15, 22 ] 14431 0.144% 99.654% ( 22, 34 ] 3335 0.033% 99.687% ( 34, 51 ] 506 0.005% 99.692% ( 51, 76 ] 95 0.001% 99.693% ( 76, 110 ] 33 0.000% 99.693% ( 110, 170 ] 9159 0.091% 99.784% ( 170, 250 ] 772 0.008% 99.792% ( 250, 380 ] 271 0.003% 99.795% ( 380, 580 ] 39 0.000% 99.795% ( 580, 870 ] 22 0.000% 99.795% ( 870, 1300 ] 15484 0.154% 99.949% ( 1300, 1900 ] 39 0.000% 99.950% ( 1900, 2900 ] 4966 0.049% 99.999% ( 2900, 4400 ] 73 0.001% 100.000% ( 4400, 6600 ] 7 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 6 0.000% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 242195 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10052999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10374694968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 521 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29443977 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26789382198 rocksdb.compact.write.bytes COUNT : 26541435775 rocksdb.flush.write.bytes COUNT : 10371315327 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 59 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 308 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10287419392 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3775488 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25356320274 rocksdb.non.last.level.read.count COUNT : 6122618 rocksdb.block.checksum.compute.count COUNT : 6489669 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.464323 P95 : 5.043962 P99 : 9.233212 P100 : 644207.000000 COUNT : 10052999 SUM : 55275096 rocksdb.compaction.times.micros P50 : 1112258.064516 P95 : 5473333.333333 P99 : 16560000.000000 P100 : 18644733.000000 COUNT : 68 SUM : 111465594 rocksdb.compaction.times.cpu_micros P50 : 976571.428571 P95 : 4740000.000000 P99 : 16560000.000000 P100 : 17073624.000000 COUNT : 68 SUM : 95315491 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 526.391753 P95 : 1024.800000 P99 : 1279.360000 P100 : 3503.000000 COUNT : 148 SUM : 89723 rocksdb.compaction.outfile.sync.micros P50 : 795.303030 P95 : 5953.750000 P99 : 11396.500000 P100 : 23455.000000 COUNT : 327 SUM : 500330 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 93.894737 P95 : 367.000000 P99 : 2380.000000 P100 : 3934.000000 COUNT : 252 SUM : 42312 rocksdb.table.open.io.micros P50 : 821.929348 P95 : 5489.000000 P99 : 9665.117647 P100 : 17595.000000 COUNT : 521 SUM : 770617 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.617602 P95 : 7.858221 P99 : 12.482686 P100 : 15415.000000 COUNT : 6488106 SUM : 37870107 rocksdb.read.block.get.micros P50 : 323.569132 P95 : 1741.639344 P99 : 4058.000000 P100 : 11299.000000 COUNT : 1042 SUM : 568971 rocksdb.write.raw.block.micros P50 : 0.517203 P95 : 0.982685 P99 : 3.282257 P100 : 15697.000000 COUNT : 8940187 SUM : 19192320 rocksdb.numfiles.in.singlecompaction P50 : 3.419540 P95 : 8.850000 P99 : 21.463333 P100 : 33.000000 COUNT : 123 SUM : 541 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567285 P95 : 1196.734154 P99 : 2550.352629 P100 : 643999.000000 COUNT : 172737 SUM : 29464984 rocksdb.sst.read.micros P50 : 1.533752 P95 : 4.468986 P99 : 8.711225 P100 : 10646.000000 COUNT : 6122716 SUM : 21687477 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10052999 SUM : 10374694968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 191000.000000 P95 : 348800.000000 P99 : 645400.000000 P100 : 851580.000000 COUNT : 148 SUM : 29268352 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 320 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0