[2024-12-17 00:43:49.455654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-17 00:43:49.455821] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid954350 ] Set seed to 1734392629451678 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-17 00:43:49.562305] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-17 00:43:49.601576] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-17 00:43:49.601626] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 954350' to capture a snapshot of events at runtime. [2024-12-17 00:43:49.601638] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid954350 for offline analysis/debug. [2024-12-17 00:43:49.601663] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 17 00:43:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/17-00:43:56 ... thread 0: (1000000,1000000) ops and (335588.4,335588.4) ops/second in (2.979841,2.979841) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 566.94 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.0 2.51 2.24 12 0.209 0 0 0.0 0.0 L1 1/0 2.52 MB 0.3 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.5 246.3 1.02 0.99 1 1.022 255K 191 0.0 0.0 L2 3/1 298.05 MB 2.5 0.1 0.1 0.0 0.1 0.1 0.2 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 19/12 1007.34 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 205.1 205.2 0.30 0.26 1 0.304 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1187/19 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 98.3 302.0 4.33 3.95 15 0.289 432K 215 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.4 1.5 98.3 302.0 4.33 3.95 15 0.289 432K 215 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 233.4 233.2 1.82 1.71 3 0.608 432K 215 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.0 2.51 2.24 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 413.65 MB/s write, 0.42 GB read, 134.67 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 438.46 MB/s write, 0.42 GB read, 142.75 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 124389 Average: 1.9542 StdDev: 20.73 Min: 1 Median: 1.2390 Max: 4042 Percentiles: P50: 1.24 P75: 1.69 P99: 5.08 P99.9: 10.27 P99.99: 305.49 ------------------------------------------------------ [ 0, 1 ] 45740 36.772% 36.772% ####### ( 1, 2 ] 68849 55.350% 92.121% ########### ( 2, 3 ] 5490 4.414% 96.535% # ( 3, 4 ] 2313 1.859% 98.395% ( 4, 6 ] 1391 1.118% 99.513% ( 6, 10 ] 478 0.384% 99.897% ( 10, 15 ] 86 0.069% 99.966% ( 15, 22 ] 9 0.007% 99.973% ( 22, 34 ] 4 0.003% 99.977% ( 34, 51 ] 2 0.002% 99.978% ( 51, 76 ] 4 0.003% 99.982% ( 110, 170 ] 6 0.005% 99.986% ( 170, 250 ] 3 0.002% 99.989% ( 250, 380 ] 6 0.005% 99.994% ( 380, 580 ] 1 0.001% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 3 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 15 Average: 143.6000 StdDev: 248.51 Min: 0 Median: 1.8333 Max: 798 Percentiles: P50: 1.83 P75: 396.67 P99: 798.00 P99.9: 798.00 P99.99: 798.00 ------------------------------------------------------ [ 0, 1 ] 5 33.333% 33.333% ####### ( 1, 2 ] 3 20.000% 53.333% #### ( 2, 3 ] 2 13.333% 66.667% ### ( 3, 4 ] 1 6.667% 73.333% # ( 380, 580 ] 3 20.000% 93.333% #### ( 580, 870 ] 1 6.667% 100.000% # ** Level 2 read latency histogram (micros): Count: 28124 Average: 2.1315 StdDev: 14.32 Min: 0 Median: 1.1617 Max: 1838 Percentiles: P50: 1.16 P75: 1.66 P99: 7.27 P99.9: 75.85 P99.99: 607.20 ------------------------------------------------------ [ 0, 1 ] 11785 41.904% 41.904% ######## ( 1, 2 ] 14084 50.078% 91.982% ########## ( 2, 3 ] 1297 4.612% 96.594% # ( 3, 4 ] 348 1.237% 97.831% ( 4, 6 ] 259 0.921% 98.752% ( 6, 10 ] 219 0.779% 99.531% ( 10, 15 ] 50 0.178% 99.708% ( 15, 22 ] 6 0.021% 99.730% ( 22, 34 ] 2 0.007% 99.737% ( 34, 51 ] 26 0.092% 99.829% ( 51, 76 ] 20 0.071% 99.900% ( 76, 110 ] 6 0.021% 99.922% ( 110, 170 ] 4 0.014% 99.936% ( 170, 250 ] 10 0.036% 99.972% ( 250, 380 ] 2 0.007% 99.979% ( 380, 580 ] 3 0.011% 99.989% ( 580, 870 ] 2 0.007% 99.996% ( 1300, 1900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 41633 Average: 5.2504 StdDev: 80.78 Min: 1 Median: 1.6583 Max: 4809 Percentiles: P50: 1.66 P75: 2.36 P99: 9.82 P99.9: 358.53 P99.99: 1129.97 ------------------------------------------------------ [ 0, 1 ] 6296 15.123% 15.123% ### ( 1, 2 ] 22058 52.982% 68.105% ########### ( 2, 3 ] 7971 19.146% 87.250% #### ( 3, 4 ] 2057 4.941% 92.191% # ( 4, 6 ] 2073 4.979% 97.171% # ( 6, 10 ] 797 1.914% 99.085% ( 10, 15 ] 155 0.372% 99.457% ( 15, 22 ] 39 0.094% 99.551% ( 22, 34 ] 14 0.034% 99.584% ( 34, 51 ] 1 0.002% 99.587% ( 51, 76 ] 5 0.012% 99.599% ( 76, 110 ] 46 0.110% 99.709% ( 110, 170 ] 49 0.118% 99.827% ( 170, 250 ] 12 0.029% 99.856% ( 250, 380 ] 22 0.053% 99.909% ( 380, 580 ] 15 0.036% 99.945% ( 580, 870 ] 14 0.034% 99.978% ( 870, 1300 ] 8 0.019% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ( 1900, 2900 ] 9 0.022% 100.022% ( 2900, 4400 ] 7 0.017% 100.038% ( 4400, 6600 ] 5 0.012% 100.050% ** Level 4 read latency histogram (micros): Count: 20 Average: 1780.8500 StdDev: 1298.41 Min: 138 Median: 1300.0000 Max: 4239 Percentiles: P50: 1300.00 P75: 3150.00 P99: 4239.00 P99.9: 4239.00 P99.99: 4239.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 380, 580 ] 3 15.000% 20.000% ### ( 580, 870 ] 2 10.000% 30.000% ## ( 870, 1300 ] 4 20.000% 50.000% #### ( 1300, 1900 ] 4 20.000% 70.000% #### ( 2900, 4400 ] 6 30.000% 100.000% ###### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 311.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.383 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.383 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/17-00:43:59 ... thread 0: (1000000,2000000) ops and (330953.4,333254.8) ops/second in (3.021573,6.001414) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.54 GB 125.8 1.2 0.0 1.2 3.1 1.8 0.0 1.7 123.6 308.7 10.20 9.50 30 0.340 1279K 1555 0.0 0.0 L1 1/0 2.52 MB 0.3 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.5 246.3 1.02 0.99 1 1.022 255K 191 0.0 0.0 L2 2/1 169.29 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.2 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 19/11 1.05 GB 0.1 0.1 0.1 0.0 0.1 0.1 0.1 1.0 205.1 205.2 0.30 0.26 1 0.304 63K 0 0.0 0.0 L4 173/0 9.65 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 68.7 68.7 0.82 0.46 1 0.819 57K 0 0.0 0.0 L5 1040/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/16 97.98 GB 0.0 1.7 0.4 1.3 3.5 2.2 0.5 1.9 135.7 282.7 12.84 11.67 34 0.378 1768K 1770 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.4 1.3 3.5 2.2 0.5 1.9 135.7 282.7 12.84 11.67 34 0.378 1768K 1770 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.4 1.3 1.7 0.4 0.0 0.0 232.9 232.6 7.48 6.92 8 0.935 1768K 1770 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.6 5.36 4.75 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.54 GB write, 587.17 MB/s write, 1.70 GB read, 281.75 MB/s read, 12.8 seconds Interval compaction: 3.54 GB write, 604.66 MB/s write, 1.70 GB read, 290.15 MB/s read, 12.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 401436 Average: 2.1664 StdDev: 18.34 Min: 1 Median: 1.4194 Max: 4042 Percentiles: P50: 1.42 P75: 1.82 P99: 5.68 P99.9: 10.05 P99.99: 14.94 ------------------------------------------------------ [ 0, 1 ] 96735 24.097% 24.097% ##### ( 1, 2 ] 247910 61.756% 85.853% ############ ( 2, 3 ] 30369 7.565% 93.418% ## ( 3, 4 ] 14457 3.601% 97.019% # ( 4, 6 ] 9481 2.362% 99.381% ( 6, 10 ] 2079 0.518% 99.899% ( 10, 15 ] 369 0.092% 99.991% ( 15, 22 ] 32 0.008% 99.999% ( 22, 34 ] 7 0.002% 100.001% ( 34, 51 ] 7 0.002% 100.002% ( 51, 76 ] 10 0.002% 100.005% ( 76, 110 ] 1 0.000% 100.005% ( 110, 170 ] 10 0.002% 100.008% ( 170, 250 ] 9 0.002% 100.010% ( 250, 380 ] 13 0.003% 100.013% ( 380, 580 ] 5 0.001% 100.014% ( 580, 870 ] 4 0.001% 100.015% ( 870, 1300 ] 6 0.001% 100.017% ( 1300, 1900 ] 3 0.001% 100.018% ( 1900, 2900 ] 2 0.000% 100.018% ( 2900, 4400 ] 8 0.002% 100.020% ** Level 1 read latency histogram (micros): Count: 15 Average: 143.6000 StdDev: 248.51 Min: 0 Median: 1.8333 Max: 798 Percentiles: P50: 1.83 P75: 396.67 P99: 798.00 P99.9: 798.00 P99.99: 798.00 ------------------------------------------------------ [ 0, 1 ] 5 33.333% 33.333% ####### ( 1, 2 ] 3 20.000% 53.333% #### ( 2, 3 ] 2 13.333% 66.667% ### ( 3, 4 ] 1 6.667% 73.333% # ( 380, 580 ] 3 20.000% 93.333% #### ( 580, 870 ] 1 6.667% 100.000% # ** Level 2 read latency histogram (micros): Count: 28238 Average: 2.1345 StdDev: 14.29 Min: 0 Median: 1.1652 Max: 1838 Percentiles: P50: 1.17 P75: 1.66 P99: 7.27 P99.9: 75.70 P99.99: 605.55 ------------------------------------------------------ [ 0, 1 ] 11785 41.735% 41.735% ######## ( 1, 2 ] 14131 50.042% 91.777% ########## ( 2, 3 ] 1350 4.781% 96.558% # ( 3, 4 ] 353 1.250% 97.808% ( 4, 6 ] 267 0.946% 98.753% ( 6, 10 ] 219 0.776% 99.529% ( 10, 15 ] 51 0.181% 99.710% ( 15, 22 ] 6 0.021% 99.731% ( 22, 34 ] 2 0.007% 99.738% ( 34, 51 ] 26 0.092% 99.830% ( 51, 76 ] 20 0.071% 99.901% ( 76, 110 ] 6 0.021% 99.922% ( 110, 170 ] 4 0.014% 99.936% ( 170, 250 ] 10 0.035% 99.972% ( 250, 380 ] 2 0.007% 99.979% ( 380, 580 ] 3 0.011% 99.989% ( 580, 870 ] 2 0.007% 99.996% ( 1300, 1900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 233441 Average: 3.3114 StdDev: 36.70 Min: 1 Median: 1.5371 Max: 4809 Percentiles: P50: 1.54 P75: 1.96 P99: 9.14 P99.9: 214.26 P99.99: 776.26 ------------------------------------------------------ [ 0, 1 ] 42431 18.176% 18.176% #### ( 1, 2 ] 138323 59.254% 77.430% ############ ( 2, 3 ] 29218 12.516% 89.946% ### ( 3, 4 ] 9822 4.207% 94.154% # ( 4, 6 ] 8056 3.451% 97.605% # ( 6, 10 ] 4156 1.780% 99.385% ( 10, 15 ] 474 0.203% 99.588% ( 15, 22 ] 116 0.050% 99.638% ( 22, 34 ] 32 0.014% 99.652% ( 34, 51 ] 8 0.003% 99.655% ( 51, 76 ] 8 0.003% 99.659% ( 76, 110 ] 225 0.096% 99.755% ( 110, 170 ] 287 0.123% 99.878% ( 170, 250 ] 95 0.041% 99.919% ( 250, 380 ] 74 0.032% 99.950% ( 380, 580 ] 72 0.031% 99.981% ( 580, 870 ] 32 0.014% 99.995% ( 870, 1300 ] 15 0.006% 100.001% ( 1300, 1900 ] 1 0.000% 100.002% ( 1900, 2900 ] 9 0.004% 100.006% ( 2900, 4400 ] 7 0.003% 100.009% ( 4400, 6600 ] 5 0.002% 100.011% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.8557 StdDev: 551.67 Min: 1 Median: 1.5774 Max: 4239 Percentiles: P50: 1.58 P75: 2.22 P99: 3637.50 P99.9: 4239.00 P99.99: 4239.00 ------------------------------------------------------ [ 0, 1 ] 63 20.656% 20.656% #### ( 1, 2 ] 155 50.820% 71.475% ########## ( 2, 3 ] 48 15.738% 87.213% ### ( 3, 4 ] 9 2.951% 90.164% # ( 4, 6 ] 4 1.311% 91.475% ( 6, 10 ] 3 0.984% 92.459% ( 10, 15 ] 1 0.328% 92.787% ( 110, 170 ] 2 0.656% 93.443% ( 170, 250 ] 1 0.328% 93.770% ( 380, 580 ] 3 0.984% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 4 1.311% 96.721% ( 1300, 1900 ] 4 1.311% 98.033% ( 2900, 4400 ] 6 1.967% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.784 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.401 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-00:44:02 ... thread 0: (1000000,3000000) ops and (363955.5,342896.2) ops/second in (2.747589,8.749003) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.40 GB 188.8 1.8 0.0 1.8 4.5 2.7 0.0 1.7 123.6 311.0 14.78 13.77 45 0.328 1854K 2209 0.0 0.0 L1 1/0 2.52 MB 0.3 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.5 246.3 1.02 0.99 1 1.022 255K 191 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 20/0 990.98 MB 1.0 1.2 0.2 1.0 1.2 0.2 0.1 5.4 242.0 241.8 5.15 4.76 3 1.718 1266K 608 0.0 0.0 L4 173/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 68.7 68.7 0.82 0.46 1 0.819 57K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/8 98.84 GB 0.0 3.4 0.5 2.9 6.1 3.2 1.1 2.3 156.9 281.2 22.27 20.44 51 0.437 3547K 3032 0.0 0.0 Int 0/0 0.00 KB 0.0 3.4 0.5 2.9 6.1 3.2 1.1 2.3 156.9 281.2 22.27 20.44 51 0.437 3547K 3032 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.4 0.5 2.9 3.4 0.5 0.0 0.0 241.2 241.0 14.48 13.53 12 1.207 3547K 3032 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 355.9 7.79 6.91 39 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.12 GB write, 701.30 MB/s write, 3.41 GB read, 391.23 MB/s read, 22.3 seconds Interval compaction: 6.12 GB write, 715.63 MB/s write, 3.41 GB read, 399.23 MB/s read, 22.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 638159 Average: 2.1040 StdDev: 15.78 Min: 0 Median: 1.4001 Max: 4042 Percentiles: P50: 1.40 P75: 1.80 P99: 5.55 P99.9: 9.90 P99.99: 14.91 ------------------------------------------------------ [ 0, 1 ] 161100 25.244% 25.244% ##### ( 1, 2 ] 394841 61.872% 87.116% ############ ( 2, 3 ] 44105 6.911% 94.028% # ( 3, 4 ] 21422 3.357% 97.385% # ( 4, 6 ] 13276 2.080% 99.465% ( 6, 10 ] 2850 0.447% 99.911% ( 10, 15 ] 510 0.080% 99.991% ( 15, 22 ] 50 0.008% 99.999% ( 22, 34 ] 10 0.002% 100.001% ( 34, 51 ] 8 0.001% 100.002% ( 51, 76 ] 15 0.002% 100.004% ( 76, 110 ] 1 0.000% 100.005% ( 110, 170 ] 15 0.002% 100.007% ( 170, 250 ] 17 0.003% 100.010% ( 250, 380 ] 20 0.003% 100.013% ( 380, 580 ] 6 0.001% 100.014% ( 580, 870 ] 8 0.001% 100.015% ( 870, 1300 ] 7 0.001% 100.016% ( 1300, 1900 ] 3 0.000% 100.016% ( 1900, 2900 ] 6 0.001% 100.017% ( 2900, 4400 ] 8 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 30600 Average: 2.3133 StdDev: 6.42 Min: 0 Median: 1.5621 Max: 798 Percentiles: P50: 1.56 P75: 1.93 P99: 5.78 P99.9: 11.38 P99.99: 442.67 ------------------------------------------------------ [ 0, 1 ] 3757 12.278% 12.278% ## ( 1, 2 ] 20534 67.105% 79.382% ############# ( 2, 3 ] 3619 11.827% 91.209% ## ( 3, 4 ] 1354 4.425% 95.634% # ( 4, 6 ] 1159 3.788% 99.422% # ( 6, 10 ] 137 0.448% 99.869% ( 10, 15 ] 34 0.111% 99.980% ( 15, 22 ] 1 0.003% 99.984% ( 51, 76 ] 1 0.003% 99.987% ( 380, 580 ] 3 0.010% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 272345 Average: 3.1893 StdDev: 34.49 Min: 0 Median: 1.5227 Max: 4809 Percentiles: P50: 1.52 P75: 1.94 P99: 8.94 P99.9: 205.15 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 50311 18.473% 18.473% #### ( 1, 2 ] 164272 60.318% 78.791% ############ ( 2, 3 ] 31945 11.730% 90.520% ## ( 3, 4 ] 11061 4.061% 94.582% # ( 4, 6 ] 8705 3.196% 97.778% # ( 6, 10 ] 4533 1.664% 99.443% ( 10, 15 ] 512 0.188% 99.631% ( 15, 22 ] 119 0.044% 99.674% ( 22, 34 ] 33 0.012% 99.686% ( 34, 51 ] 8 0.003% 99.689% ( 51, 76 ] 9 0.003% 99.693% ( 76, 110 ] 226 0.083% 99.776% ( 110, 170 ] 289 0.106% 99.882% ( 170, 250 ] 113 0.041% 99.923% ( 250, 380 ] 76 0.028% 99.951% ( 380, 580 ] 80 0.029% 99.981% ( 580, 870 ] 34 0.012% 99.993% ( 870, 1300 ] 21 0.008% 100.001% ( 1300, 1900 ] 1 0.000% 100.001% ( 1900, 2900 ] 9 0.003% 100.004% ( 2900, 4400 ] 7 0.003% 100.007% ( 4400, 6600 ] 5 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.8557 StdDev: 551.67 Min: 1 Median: 1.5774 Max: 4239 Percentiles: P50: 1.58 P75: 2.22 P99: 3637.50 P99.9: 4239.00 P99.99: 4239.00 ------------------------------------------------------ [ 0, 1 ] 63 20.656% 20.656% #### ( 1, 2 ] 155 50.820% 71.475% ########## ( 2, 3 ] 48 15.738% 87.213% ### ( 3, 4 ] 9 2.951% 90.164% # ( 4, 6 ] 4 1.311% 91.475% ( 6, 10 ] 3 0.984% 92.459% ( 10, 15 ] 1 0.328% 92.787% ( 110, 170 ] 2 0.656% 93.443% ( 170, 250 ] 1 0.328% 93.770% ( 380, 580 ] 3 0.984% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 4 1.311% 96.721% ( 1300, 1900 ] 4 1.311% 98.033% ( 2900, 4400 ] 6 1.967% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 956.9000 StdDev: 1159.32 Min: 103 Median: 250.0000 Max: 3522 Percentiles: P50: 250.00 P75: 1300.00 P99: 3522.00 P99.9: 3522.00 P99.99: 3522.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 4 20.000% 30.000% #### ( 170, 250 ] 4 20.000% 50.000% #### ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 8.9 total, 2.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 330.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.957 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.173 H:M:S, 6.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-00:44:05 ... thread 0: (1000000,4000000) ops and (339688.6,342088.6) ops/second in (2.943873,11.692876) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.38 GB 314.6 2.9 0.0 2.9 6.6 3.7 0.0 1.8 136.0 309.4 21.77 20.41 63 0.346 3006K 3383 0.0 0.0 L1 1/0 2.52 MB 0.3 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.5 246.3 1.02 0.99 1 1.022 255K 191 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 20/0 990.98 MB 1.0 1.2 0.2 1.0 1.2 0.2 0.1 5.4 242.0 241.8 5.15 4.76 3 1.718 1266K 608 0.0 0.0 L4 173/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 68.7 68.7 0.82 0.46 1 0.819 57K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 99.82 GB 0.0 4.5 0.5 4.0 8.2 4.2 1.1 2.2 158.1 287.1 29.27 27.08 69 0.424 4699K 4206 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 0.5 4.0 8.2 4.2 1.1 2.2 158.1 287.1 29.27 27.08 69 0.424 4699K 4206 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 0.5 4.0 4.5 0.5 0.0 0.0 247.0 246.8 18.73 17.70 16 1.171 4699K 4206 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 358.8 10.53 9.38 53 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.9 total, 11.7 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.21 GB write, 707.71 MB/s write, 4.52 GB read, 389.74 MB/s read, 29.3 seconds Interval compaction: 8.21 GB write, 718.53 MB/s write, 4.52 GB read, 395.70 MB/s read, 29.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 880212 Average: 2.0402 StdDev: 14.95 Min: 0 Median: 1.3618 Max: 4042 Percentiles: P50: 1.36 P75: 1.77 P99: 5.40 P99.9: 9.88 P99.99: 15.40 ------------------------------------------------------ [ 0, 1 ] 245704 27.914% 27.914% ###### ( 1, 2 ] 537248 61.036% 88.950% ############ ( 2, 3 ] 52515 5.966% 94.917% # ( 3, 4 ] 25293 2.874% 97.790% # ( 4, 6 ] 15200 1.727% 99.517% ( 6, 10 ] 3475 0.395% 99.912% ( 10, 15 ] 686 0.078% 99.990% ( 15, 22 ] 69 0.008% 99.998% ( 22, 34 ] 12 0.001% 99.999% ( 34, 51 ] 11 0.001% 100.000% ( 51, 76 ] 17 0.002% 100.002% ( 76, 110 ] 1 0.000% 100.002% ( 110, 170 ] 24 0.003% 100.005% ( 170, 250 ] 20 0.002% 100.007% ( 250, 380 ] 26 0.003% 100.010% ( 380, 580 ] 9 0.001% 100.011% ( 580, 870 ] 13 0.001% 100.013% ( 870, 1300 ] 12 0.001% 100.014% ( 1300, 1900 ] 6 0.001% 100.015% ( 1900, 2900 ] 7 0.001% 100.015% ( 2900, 4400 ] 9 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 30600 Average: 2.3133 StdDev: 6.42 Min: 0 Median: 1.5621 Max: 798 Percentiles: P50: 1.56 P75: 1.93 P99: 5.78 P99.9: 11.38 P99.99: 442.67 ------------------------------------------------------ [ 0, 1 ] 3757 12.278% 12.278% ## ( 1, 2 ] 20534 67.105% 79.382% ############# ( 2, 3 ] 3619 11.827% 91.209% ## ( 3, 4 ] 1354 4.425% 95.634% # ( 4, 6 ] 1159 3.788% 99.422% # ( 6, 10 ] 137 0.448% 99.869% ( 10, 15 ] 34 0.111% 99.980% ( 15, 22 ] 1 0.003% 99.984% ( 51, 76 ] 1 0.003% 99.987% ( 380, 580 ] 3 0.010% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 272345 Average: 3.1893 StdDev: 34.49 Min: 0 Median: 1.5227 Max: 4809 Percentiles: P50: 1.52 P75: 1.94 P99: 8.94 P99.9: 205.15 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 50311 18.473% 18.473% #### ( 1, 2 ] 164272 60.318% 78.791% ############ ( 2, 3 ] 31945 11.730% 90.520% ## ( 3, 4 ] 11061 4.061% 94.582% # ( 4, 6 ] 8705 3.196% 97.778% # ( 6, 10 ] 4533 1.664% 99.443% ( 10, 15 ] 512 0.188% 99.631% ( 15, 22 ] 119 0.044% 99.674% ( 22, 34 ] 33 0.012% 99.686% ( 34, 51 ] 8 0.003% 99.689% ( 51, 76 ] 9 0.003% 99.693% ( 76, 110 ] 226 0.083% 99.776% ( 110, 170 ] 289 0.106% 99.882% ( 170, 250 ] 113 0.041% 99.923% ( 250, 380 ] 76 0.028% 99.951% ( 380, 580 ] 80 0.029% 99.981% ( 580, 870 ] 34 0.012% 99.993% ( 870, 1300 ] 21 0.008% 100.001% ( 1300, 1900 ] 1 0.000% 100.001% ( 1900, 2900 ] 9 0.003% 100.004% ( 2900, 4400 ] 7 0.003% 100.007% ( 4400, 6600 ] 5 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.8557 StdDev: 551.67 Min: 1 Median: 1.5774 Max: 4239 Percentiles: P50: 1.58 P75: 2.22 P99: 3637.50 P99.9: 4239.00 P99.99: 4239.00 ------------------------------------------------------ [ 0, 1 ] 63 20.656% 20.656% #### ( 1, 2 ] 155 50.820% 71.475% ########## ( 2, 3 ] 48 15.738% 87.213% ### ( 3, 4 ] 9 2.951% 90.164% # ( 4, 6 ] 4 1.311% 91.475% ( 6, 10 ] 3 0.984% 92.459% ( 10, 15 ] 1 0.328% 92.787% ( 110, 170 ] 2 0.656% 93.443% ( 170, 250 ] 1 0.328% 93.770% ( 380, 580 ] 3 0.984% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 4 1.311% 96.721% ( 1300, 1900 ] 4 1.311% 98.033% ( 2900, 4400 ] 6 1.967% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 956.9000 StdDev: 1159.32 Min: 103 Median: 250.0000 Max: 3522 Percentiles: P50: 250.00 P75: 1300.00 P99: 3522.00 P99.9: 3522.00 P99.99: 3522.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 4 20.000% 30.000% #### ( 170, 250 ] 4 20.000% 50.000% #### ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 11.9 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 331.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.335 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/17-00:44:10 ... thread 0: (1000000,5000000) ops and (223013.0,309082.3) ops/second in (4.484044,16.176920) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 4.42 GB 25.2 4.2 0.0 4.2 9.0 4.7 0.0 1.9 145.7 308.1 29.83 28.06 84 0.355 4413K 4818 0.0 0.0 L1 1/1 2.52 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.5 246.3 1.02 0.99 1 1.022 255K 191 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.2 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 20/0 990.98 MB 1.0 1.2 0.2 1.0 1.2 0.2 0.1 5.4 242.0 241.8 5.15 4.76 3 1.718 1266K 608 0.0 0.0 L4 173/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 68.7 68.7 0.82 0.46 1 0.819 57K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/18 100.87 GB 0.0 5.9 0.5 5.3 10.6 5.3 1.1 2.2 161.1 290.9 37.33 34.73 90 0.415 6106K 5641 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 0.5 5.3 10.6 5.3 1.1 2.2 161.1 290.9 37.33 34.73 90 0.415 6106K 5641 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 0.5 5.3 5.9 0.5 0.0 0.0 251.8 251.6 23.88 22.77 21 1.137 6106K 5641 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.7 13.45 11.97 69 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.2 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.60 GB write, 663.82 MB/s write, 5.87 GB read, 367.63 MB/s read, 37.3 seconds Interval compaction: 10.60 GB write, 671.16 MB/s write, 5.87 GB read, 371.69 MB/s read, 37.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 20, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1286114 Average: 2.0340 StdDev: 13.45 Min: 0 Median: 1.3511 Max: 4042 Percentiles: P50: 1.35 P75: 1.76 P99: 5.31 P99.9: 10.92 P99.99: 118.22 ------------------------------------------------------ [ 0, 1 ] 365608 28.427% 28.427% ###### ( 1, 2 ] 790174 61.439% 89.866% ############ ( 2, 3 ] 71286 5.543% 95.409% # ( 3, 4 ] 33837 2.631% 98.040% # ( 4, 6 ] 18819 1.463% 99.503% ( 6, 10 ] 4911 0.382% 99.885% ( 10, 15 ] 1045 0.081% 99.966% ( 15, 22 ] 106 0.008% 99.974% ( 22, 34 ] 15 0.001% 99.976% ( 34, 51 ] 13 0.001% 99.977% ( 51, 76 ] 30 0.002% 99.979% ( 76, 110 ] 114 0.009% 99.988% ( 110, 170 ] 200 0.016% 100.003% ( 170, 250 ] 46 0.004% 100.007% ( 250, 380 ] 33 0.003% 100.010% ( 380, 580 ] 20 0.002% 100.011% ( 580, 870 ] 28 0.002% 100.013% ( 870, 1300 ] 13 0.001% 100.014% ( 1300, 1900 ] 9 0.001% 100.015% ( 1900, 2900 ] 9 0.001% 100.016% ( 2900, 4400 ] 9 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 30601 Average: 2.3193 StdDev: 6.50 Min: 0 Median: 1.5622 Max: 798 Percentiles: P50: 1.56 P75: 1.93 P99: 5.78 P99.9: 11.53 P99.99: 442.66 ------------------------------------------------------ [ 0, 1 ] 3757 12.277% 12.277% ## ( 1, 2 ] 20534 67.102% 79.380% ############# ( 2, 3 ] 3619 11.826% 91.206% ## ( 3, 4 ] 1354 4.425% 95.631% # ( 4, 6 ] 1159 3.787% 99.418% # ( 6, 10 ] 137 0.448% 99.866% ( 10, 15 ] 34 0.111% 99.977% ( 15, 22 ] 1 0.003% 99.980% ( 51, 76 ] 1 0.003% 99.984% ( 170, 250 ] 1 0.003% 99.987% ( 380, 580 ] 3 0.010% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 272345 Average: 3.1893 StdDev: 34.49 Min: 0 Median: 1.5227 Max: 4809 Percentiles: P50: 1.52 P75: 1.94 P99: 8.94 P99.9: 205.15 P99.99: 799.76 ------------------------------------------------------ [ 0, 1 ] 50311 18.473% 18.473% #### ( 1, 2 ] 164272 60.318% 78.791% ############ ( 2, 3 ] 31945 11.730% 90.520% ## ( 3, 4 ] 11061 4.061% 94.582% # ( 4, 6 ] 8705 3.196% 97.778% # ( 6, 10 ] 4533 1.664% 99.443% ( 10, 15 ] 512 0.188% 99.631% ( 15, 22 ] 119 0.044% 99.674% ( 22, 34 ] 33 0.012% 99.686% ( 34, 51 ] 8 0.003% 99.689% ( 51, 76 ] 9 0.003% 99.693% ( 76, 110 ] 226 0.083% 99.776% ( 110, 170 ] 289 0.106% 99.882% ( 170, 250 ] 113 0.041% 99.923% ( 250, 380 ] 76 0.028% 99.951% ( 380, 580 ] 80 0.029% 99.981% ( 580, 870 ] 34 0.012% 99.993% ( 870, 1300 ] 21 0.008% 100.001% ( 1300, 1900 ] 1 0.000% 100.001% ( 1900, 2900 ] 9 0.003% 100.004% ( 2900, 4400 ] 7 0.003% 100.007% ( 4400, 6600 ] 5 0.002% 100.009% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.8557 StdDev: 551.67 Min: 1 Median: 1.5774 Max: 4239 Percentiles: P50: 1.58 P75: 2.22 P99: 3637.50 P99.9: 4239.00 P99.99: 4239.00 ------------------------------------------------------ [ 0, 1 ] 63 20.656% 20.656% #### ( 1, 2 ] 155 50.820% 71.475% ########## ( 2, 3 ] 48 15.738% 87.213% ### ( 3, 4 ] 9 2.951% 90.164% # ( 4, 6 ] 4 1.311% 91.475% ( 6, 10 ] 3 0.984% 92.459% ( 10, 15 ] 1 0.328% 92.787% ( 110, 170 ] 2 0.656% 93.443% ( 170, 250 ] 1 0.328% 93.770% ( 380, 580 ] 3 0.984% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 4 1.311% 96.721% ( 1300, 1900 ] 4 1.311% 98.033% ( 2900, 4400 ] 6 1.967% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 956.9000 StdDev: 1159.32 Min: 103 Median: 250.0000 Max: 3522 Percentiles: P50: 250.00 P75: 1300.00 P99: 3522.00 P99.9: 3522.00 P99.99: 3522.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 4 20.000% 30.000% #### ( 170, 250 ] 4 20.000% 50.000% #### ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 16.4 total, 4.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 300.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.165 H:M:S, 19.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 219.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.830 H:M:S, 40.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/17-00:44:29 ... thread 0: (1000000,6000000) ops and (51224.5,168072.8) ops/second in (19.521905,35.698825) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.11 GB 50.4 4.7 0.0 4.7 10.3 5.6 0.0 1.8 140.7 306.9 34.47 32.28 99 0.348 4925K 5300 0.0 0.0 L1 5/5 270.59 MB 0.0 4.4 4.4 0.1 4.3 4.3 0.1 1.0 223.9 219.6 20.24 18.44 2 10.122 4603K 87K 0.0 0.0 L2 31/17 3.77 GB 17.0 0.1 0.1 0.0 0.1 0.1 4.1 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 21/3 1.03 GB 0.8 1.3 0.3 1.0 1.3 0.3 0.1 4.4 238.5 238.3 5.53 5.10 4 1.383 1271K 608 0.0 0.0 L4 173/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 68.7 68.7 0.82 0.46 1 0.819 57K 0 0.0 0.0 L5 1044/0 85.94 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/29 101.64 GB 0.0 10.6 4.8 5.8 16.1 10.3 4.9 2.9 176.6 268.2 61.56 56.74 107 0.575 10M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.6 4.8 5.8 16.1 10.3 4.9 2.9 176.6 268.2 61.56 56.74 107 0.575 10M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.6 4.8 5.8 10.5 4.7 0.0 0.0 239.3 237.2 45.43 42.46 25 1.817 10M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 355.5 16.13 14.28 82 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.9 total, 35.7 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.12 GB write, 460.15 MB/s write, 10.62 GB read, 302.99 MB/s read, 61.6 seconds Interval compaction: 16.12 GB write, 462.46 MB/s write, 10.62 GB read, 304.50 MB/s read, 61.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 22, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2500121 Average: 2.5824 StdDev: 15.87 Min: 0 Median: 1.3242 Max: 4042 Percentiles: P50: 1.32 P75: 1.75 P99: 7.14 P99.9: 150.90 P99.99: 389.31 ------------------------------------------------------ [ 0, 1 ] 769388 30.774% 30.774% ###### ( 1, 2 ] 1482584 59.300% 90.075% ############ ( 2, 3 ] 117977 4.719% 94.793% # ( 3, 4 ] 57816 2.313% 97.106% ( 4, 6 ] 43163 1.726% 98.832% ( 6, 10 ] 14672 0.587% 99.419% ( 10, 15 ] 2266 0.091% 99.510% ( 15, 22 ] 440 0.018% 99.527% ( 22, 34 ] 25 0.001% 99.528% ( 34, 51 ] 18 0.001% 99.529% ( 51, 76 ] 91 0.004% 99.533% ( 76, 110 ] 6362 0.254% 99.787% ( 110, 170 ] 4135 0.165% 99.953% ( 170, 250 ] 531 0.021% 99.974% ( 250, 380 ] 386 0.015% 99.989% ( 380, 580 ] 365 0.015% 100.004% ( 580, 870 ] 133 0.005% 100.009% ( 870, 1300 ] 34 0.001% 100.011% ( 1300, 1900 ] 14 0.001% 100.011% ( 1900, 2900 ] 15 0.001% 100.012% ( 2900, 4400 ] 12 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 351474 Average: 3.3825 StdDev: 24.92 Min: 0 Median: 1.7714 Max: 4640 Percentiles: P50: 1.77 P75: 2.65 P99: 8.13 P99.9: 14.51 P99.99: 104.75 ------------------------------------------------------ [ 0, 1 ] 16679 4.745% 4.745% # ( 1, 2 ] 206207 58.669% 63.415% ############ ( 2, 3 ] 62277 17.719% 81.133% #### ( 3, 4 ] 30666 8.725% 89.858% ## ( 4, 6 ] 29451 8.379% 98.238% ## ( 6, 10 ] 5033 1.432% 99.670% ( 10, 15 ] 899 0.256% 99.925% ( 15, 22 ] 121 0.034% 99.960% ( 22, 34 ] 7 0.002% 99.962% ( 34, 51 ] 2 0.001% 99.962% ( 51, 76 ] 4 0.001% 99.964% ( 76, 110 ] 111 0.032% 99.995% ( 110, 170 ] 96 0.027% 100.022% ( 170, 250 ] 72 0.020% 100.043% ( 250, 380 ] 91 0.026% 100.069% ( 380, 580 ] 114 0.032% 100.101% ( 580, 870 ] 61 0.017% 100.119% ( 870, 1300 ] 33 0.009% 100.128% ( 1300, 1900 ] 14 0.004% 100.132% ( 1900, 2900 ] 5 0.001% 100.133% ( 2900, 4400 ] 2 0.001% 100.134% ( 4400, 6600 ] 1 0.000% 100.134% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 285879 Average: 3.4328 StdDev: 35.99 Min: 0 Median: 1.5352 Max: 4809 Percentiles: P50: 1.54 P75: 1.95 P99: 9.12 P99.9: 302.39 P99.99: 858.27 ------------------------------------------------------ [ 0, 1 ] 50984 17.834% 17.834% #### ( 1, 2 ] 171830 60.106% 77.940% ############ ( 2, 3 ] 34376 12.025% 89.965% ## ( 3, 4 ] 12202 4.268% 94.233% # ( 4, 6 ] 9879 3.456% 97.689% # ( 6, 10 ] 4813 1.684% 99.372% ( 10, 15 ] 587 0.205% 99.577% ( 15, 22 ] 126 0.044% 99.622% ( 22, 34 ] 33 0.012% 99.633% ( 34, 51 ] 8 0.003% 99.636% ( 51, 76 ] 9 0.003% 99.639% ( 76, 110 ] 238 0.083% 99.722% ( 110, 170 ] 325 0.114% 99.836% ( 170, 250 ] 140 0.049% 99.885% ( 250, 380 ] 107 0.037% 99.922% ( 380, 580 ] 132 0.046% 99.969% ( 580, 870 ] 64 0.022% 99.991% ( 870, 1300 ] 24 0.008% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 11 0.004% 100.004% ( 2900, 4400 ] 7 0.002% 100.006% ( 4400, 6600 ] 5 0.002% 100.008% ** Level 4 read latency histogram (micros): Count: 305 Average: 119.8557 StdDev: 551.67 Min: 1 Median: 1.5774 Max: 4239 Percentiles: P50: 1.58 P75: 2.22 P99: 3637.50 P99.9: 4239.00 P99.99: 4239.00 ------------------------------------------------------ [ 0, 1 ] 63 20.656% 20.656% #### ( 1, 2 ] 155 50.820% 71.475% ########## ( 2, 3 ] 48 15.738% 87.213% ### ( 3, 4 ] 9 2.951% 90.164% # ( 4, 6 ] 4 1.311% 91.475% ( 6, 10 ] 3 0.984% 92.459% ( 10, 15 ] 1 0.328% 92.787% ( 110, 170 ] 2 0.656% 93.443% ( 170, 250 ] 1 0.328% 93.770% ( 380, 580 ] 3 0.984% 94.754% ( 580, 870 ] 2 0.656% 95.410% ( 870, 1300 ] 4 1.311% 96.721% ( 1300, 1900 ] 4 1.311% 98.033% ( 2900, 4400 ] 6 1.967% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 956.9000 StdDev: 1159.32 Min: 103 Median: 250.0000 Max: 3522 Percentiles: P50: 250.00 P75: 1300.00 P99: 3522.00 P99.9: 3522.00 P99.99: 3522.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 110, 170 ] 4 20.000% 30.000% #### ( 170, 250 ] 4 20.000% 50.000% #### ( 380, 580 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 1 5.000% 80.000% # ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 35.9 total, 19.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 164.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.504 H:M:S, 54.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 50.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:16.339 H:M:S, 83.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/17-00:44:33 ... thread 0: (1000000,7000000) ops and (241029.6,175668.9) ops/second in (4.148868,39.847693) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.48 GB 119.6 5.4 0.0 5.4 11.9 6.6 0.0 1.8 133.8 298.2 40.97 37.51 114 0.359 5564K 6017 0.0 0.0 L1 12/0 839.04 MB 83.9 5.3 5.0 0.3 5.2 4.9 0.1 1.0 215.3 211.7 25.24 22.51 3 8.412 5242K 87K 0.0 0.0 L2 14/12 1.64 GB 2.6 0.1 0.1 0.0 0.1 0.1 4.1 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 36/10 2.09 GB 1.5 3.8 2.5 1.3 3.7 2.5 0.1 1.5 206.7 206.3 18.59 16.37 8 2.324 3007K 1908 0.0 0.0 L4 178/6 9.67 GB 1.0 0.5 0.5 0.0 0.5 0.5 1.0 1.0 110.0 109.9 4.33 2.43 7 0.618 481K 205 0.0 0.0 L5 1056/0 86.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/32 102.62 GB 0.0 15.0 8.0 7.0 21.5 14.4 6.7 3.3 171.2 245.3 89.62 79.29 133 0.674 14M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.0 8.0 7.0 21.5 14.4 6.7 3.3 171.2 245.3 89.62 79.29 133 0.674 14M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.0 8.0 7.0 14.9 7.9 0.0 0.0 220.5 219.0 69.58 62.30 38 1.831 14M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 336.4 20.03 16.99 95 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.0 total, 39.8 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.46 GB write, 549.11 MB/s write, 14.98 GB read, 383.30 MB/s read, 89.6 seconds Interval compaction: 21.46 GB write, 551.57 MB/s write, 14.98 GB read, 385.02 MB/s read, 89.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 36, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2796738 Average: 2.6745 StdDev: 18.43 Min: 0 Median: 1.3683 Max: 6711 Percentiles: P50: 1.37 P75: 1.79 P99: 7.45 P99.9: 150.25 P99.99: 422.64 ------------------------------------------------------ [ 0, 1 ] 790831 28.277% 28.277% ###### ( 1, 2 ] 1649427 58.977% 87.254% ############ ( 2, 3 ] 165101 5.903% 93.157% # ( 3, 4 ] 84795 3.032% 96.189% # ( 4, 6 ] 71632 2.561% 98.750% # ( 6, 10 ] 19260 0.689% 99.439% ( 10, 15 ] 3050 0.109% 99.548% ( 15, 22 ] 537 0.019% 99.567% ( 22, 34 ] 32 0.001% 99.568% ( 34, 51 ] 20 0.001% 99.569% ( 51, 76 ] 91 0.003% 99.572% ( 76, 110 ] 6365 0.228% 99.800% ( 110, 170 ] 4174 0.149% 99.949% ( 170, 250 ] 594 0.021% 99.970% ( 250, 380 ] 460 0.016% 99.987% ( 380, 580 ] 419 0.015% 100.002% ( 580, 870 ] 191 0.007% 100.009% ( 870, 1300 ] 65 0.002% 100.011% ( 1300, 1900 ] 32 0.001% 100.012% ( 1900, 2900 ] 23 0.001% 100.013% ( 2900, 4400 ] 20 0.001% 100.014% ( 6600, 9900 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 943337 Average: 5.5051 StdDev: 77.42 Min: 0 Median: 1.8397 Max: 9765 Percentiles: P50: 1.84 P75: 2.84 P99: 9.43 P99.9: 146.13 P99.99: 379.57 ------------------------------------------------------ [ 0, 1 ] 32859 3.483% 3.483% # ( 1, 2 ] 522562 55.395% 58.878% ########### ( 2, 3 ] 181641 19.255% 78.133% #### ( 3, 4 ] 87984 9.327% 87.460% ## ( 4, 6 ] 90965 9.643% 97.103% ## ( 6, 10 ] 20853 2.211% 99.314% ( 10, 15 ] 4583 0.486% 99.800% ( 15, 22 ] 557 0.059% 99.859% ( 22, 34 ] 30 0.003% 99.862% ( 34, 51 ] 11 0.001% 99.863% ( 51, 76 ] 6 0.001% 99.864% ( 76, 110 ] 159 0.017% 99.881% ( 110, 170 ] 305 0.032% 99.913% ( 170, 250 ] 324 0.034% 99.947% ( 250, 380 ] 405 0.043% 99.990% ( 380, 580 ] 482 0.051% 100.041% ( 580, 870 ] 393 0.042% 100.083% ( 870, 1300 ] 232 0.025% 100.107% ( 1300, 1900 ] 162 0.017% 100.125% ( 1900, 2900 ] 193 0.020% 100.145% ( 2900, 4400 ] 147 0.016% 100.161% ( 4400, 6600 ] 35 0.004% 100.164% ( 6600, 9900 ] 13 0.001% 100.166% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 543302 Average: 5.9298 StdDev: 84.67 Min: 0 Median: 1.7130 Max: 8893 Percentiles: P50: 1.71 P75: 2.56 P99: 9.65 P99.9: 507.60 P99.99: 1130.61 ------------------------------------------------------ [ 0, 1 ] 56757 10.447% 10.447% ## ( 1, 2 ] 301411 55.478% 65.924% ########### ( 2, 3 ] 87948 16.188% 82.112% ### ( 3, 4 ] 40101 7.381% 89.493% # ( 4, 6 ] 41762 7.687% 97.180% ## ( 6, 10 ] 10843 1.996% 99.175% ( 10, 15 ] 2181 0.401% 99.577% ( 15, 22 ] 319 0.059% 99.636% ( 22, 34 ] 42 0.008% 99.643% ( 34, 51 ] 12 0.002% 99.646% ( 51, 76 ] 11 0.002% 99.648% ( 76, 110 ] 260 0.048% 99.695% ( 110, 170 ] 405 0.075% 99.770% ( 170, 250 ] 272 0.050% 99.820% ( 250, 380 ] 235 0.043% 99.863% ( 380, 580 ] 313 0.058% 99.921% ( 580, 870 ] 269 0.050% 99.970% ( 870, 1300 ] 176 0.032% 100.003% ( 1300, 1900 ] 106 0.020% 100.022% ( 1900, 2900 ] 122 0.022% 100.045% ( 2900, 4400 ] 122 0.022% 100.067% ( 4400, 6600 ] 33 0.006% 100.073% ( 6600, 9900 ] 3 0.001% 100.074% ** Level 4 read latency histogram (micros): Count: 2939 Average: 461.9279 StdDev: 1024.36 Min: 1 Median: 2.7375 Max: 9769 Percentiles: P50: 2.74 P75: 297.45 P99: 4382.91 P99.9: 7475.33 P99.99: 9657.53 ------------------------------------------------------ [ 0, 1 ] 84 2.858% 2.858% # ( 1, 2 ] 971 33.038% 35.897% ####### ( 2, 3 ] 562 19.122% 55.019% #### ( 3, 4 ] 252 8.574% 63.593% ## ( 4, 6 ] 190 6.465% 70.058% # ( 6, 10 ] 49 1.667% 71.725% ( 10, 15 ] 20 0.681% 72.406% ( 15, 22 ] 6 0.204% 72.610% ( 22, 34 ] 1 0.034% 72.644% ( 110, 170 ] 18 0.612% 73.256% ( 170, 250 ] 33 1.123% 74.379% ( 250, 380 ] 50 1.701% 76.080% ( 380, 580 ] 83 2.824% 78.904% # ( 580, 870 ] 114 3.879% 82.783% # ( 870, 1300 ] 105 3.573% 86.356% # ( 1300, 1900 ] 110 3.743% 90.099% # ( 1900, 2900 ] 141 4.798% 94.896% # ( 2900, 4400 ] 122 4.151% 99.047% # ( 4400, 6600 ] 24 0.817% 99.864% ( 6600, 9900 ] 4 0.136% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1681.4250 StdDev: 1681.84 Min: 103 Median: 783.0000 Max: 7280 Percentiles: P50: 783.00 P75: 3076.47 P99: 7260.00 P99.9: 7280.00 P99.99: 7280.00 ------------------------------------------------------ ( 76, 110 ] 2 2.500% 2.500% # ( 110, 170 ] 6 7.500% 10.000% ## ( 170, 250 ] 5 6.250% 16.250% # ( 250, 380 ] 6 7.500% 23.750% ## ( 380, 580 ] 14 17.500% 41.250% #### ( 580, 870 ] 10 12.500% 53.750% ### ( 870, 1300 ] 4 5.000% 58.750% # ( 1300, 1900 ] 5 6.250% 65.000% # ( 1900, 2900 ] 6 7.500% 72.500% ## ( 2900, 4400 ] 17 21.250% 93.750% #### ( 4400, 6600 ] 4 5.000% 98.750% # ( 6600, 9900 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 40.0 total, 4.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 172.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.909 H:M:S, 52.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 237.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.405 H:M:S, 33.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/17-00:44:38 ... thread 0: (1000000,8000000) ops and (197456.7,178125.7) ops/second in (5.064402,44.912095) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.46 GB 69.2 6.3 0.0 6.3 13.9 7.6 0.0 1.8 130.3 285.8 49.79 44.25 129 0.386 6588K 7301 0.0 0.0 L1 12/12 839.04 MB 0.0 5.3 5.0 0.3 5.2 4.9 0.1 1.0 215.3 211.7 25.24 22.51 3 8.412 5242K 87K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.1 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 17/0 977.61 MB 1.0 5.9 4.1 1.8 5.9 4.1 0.1 1.4 186.9 186.6 32.35 26.41 13 2.488 5246K 6969 0.0 0.0 L4 184/0 9.49 GB 1.0 3.2 3.2 0.0 3.2 3.2 1.0 1.0 120.4 120.4 27.22 15.67 47 0.579 3299K 675 0.0 0.0 L5 1092/0 89.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1319/24 103.59 GB 0.0 20.9 12.3 8.5 28.3 19.8 9.7 3.7 158.1 214.6 135.10 109.31 193 0.700 20M 102K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.9 12.3 8.5 28.3 19.8 9.7 3.7 158.1 214.6 135.10 109.31 193 0.700 20M 102K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.9 12.3 8.5 20.7 12.2 0.0 0.0 193.3 192.3 110.51 89.57 86 1.285 20M 102K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 315.1 24.59 19.74 107 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.1 total, 44.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.32 GB write, 643.00 MB/s write, 20.86 GB read, 473.65 MB/s read, 135.1 seconds Interval compaction: 28.32 GB write, 645.56 MB/s write, 20.86 GB read, 475.53 MB/s read, 135.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 70, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 70, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3149825 Average: 2.8360 StdDev: 24.98 Min: 0 Median: 1.4082 Max: 7673 Percentiles: P50: 1.41 P75: 1.83 P99: 7.84 P99.9: 150.79 P99.99: 496.38 ------------------------------------------------------ [ 0, 1 ] 819914 26.030% 26.030% ##### ( 1, 2 ] 1849652 58.722% 84.753% ############ ( 2, 3 ] 220940 7.014% 91.767% # ( 3, 4 ] 113095 3.591% 95.358% # ( 4, 6 ] 102949 3.268% 98.626% # ( 6, 10 ] 25620 0.813% 99.439% ( 10, 15 ] 4434 0.141% 99.580% ( 15, 22 ] 660 0.021% 99.601% ( 22, 34 ] 37 0.001% 99.602% ( 34, 51 ] 23 0.001% 99.603% ( 51, 76 ] 92 0.003% 99.606% ( 76, 110 ] 6382 0.203% 99.809% ( 110, 170 ] 4232 0.134% 99.943% ( 170, 250 ] 660 0.021% 99.964% ( 250, 380 ] 518 0.016% 99.980% ( 380, 580 ] 519 0.016% 99.997% ( 580, 870 ] 283 0.009% 100.006% ( 870, 1300 ] 144 0.005% 100.010% ( 1300, 1900 ] 71 0.002% 100.013% ( 1900, 2900 ] 56 0.002% 100.014% ( 2900, 4400 ] 47 0.001% 100.016% ( 4400, 6600 ] 4 0.000% 100.016% ( 6600, 9900 ] 2 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1194100 Average: 5.9828 StdDev: 86.42 Min: 0 Median: 1.8381 Max: 10659 Percentiles: P50: 1.84 P75: 2.84 P99: 9.57 P99.9: 271.04 P99.99: 583.97 ------------------------------------------------------ [ 0, 1 ] 42570 3.565% 3.565% # ( 1, 2 ] 661604 55.406% 58.971% ########### ( 2, 3 ] 226623 18.979% 77.950% #### ( 3, 4 ] 111019 9.297% 87.247% ## ( 4, 6 ] 116044 9.718% 96.965% ## ( 6, 10 ] 27202 2.278% 99.243% ( 10, 15 ] 6012 0.503% 99.747% ( 15, 22 ] 724 0.061% 99.807% ( 22, 34 ] 37 0.003% 99.810% ( 34, 51 ] 13 0.001% 99.811% ( 51, 76 ] 9 0.001% 99.812% ( 76, 110 ] 192 0.016% 99.828% ( 110, 170 ] 376 0.031% 99.860% ( 170, 250 ] 399 0.033% 99.893% ( 250, 380 ] 506 0.042% 99.936% ( 380, 580 ] 643 0.054% 99.989% ( 580, 870 ] 555 0.046% 100.036% ( 870, 1300 ] 375 0.031% 100.067% ( 1300, 1900 ] 252 0.021% 100.088% ( 1900, 2900 ] 281 0.024% 100.112% ( 2900, 4400 ] 234 0.020% 100.131% ( 4400, 6600 ] 55 0.005% 100.136% ( 6600, 9900 ] 23 0.002% 100.138% ( 9900, 14000 ] 1 0.000% 100.138% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1249548 Average: 6.3923 StdDev: 94.85 Min: 0 Median: 1.8362 Max: 13356 Percentiles: P50: 1.84 P75: 2.86 P99: 9.49 P99.9: 219.07 P99.99: 580.51 ------------------------------------------------------ [ 0, 1 ] 70964 5.679% 5.679% # ( 1, 2 ] 662303 53.003% 58.683% ########### ( 2, 3 ] 236996 18.967% 77.649% #### ( 3, 4 ] 115992 9.283% 86.932% ## ( 4, 6 ] 127733 10.222% 97.154% ## ( 6, 10 ] 26468 2.118% 99.272% ( 10, 15 ] 6044 0.484% 99.756% ( 15, 22 ] 721 0.058% 99.814% ( 22, 34 ] 68 0.005% 99.819% ( 34, 51 ] 25 0.002% 99.821% ( 51, 76 ] 15 0.001% 99.822% ( 76, 110 ] 278 0.022% 99.845% ( 110, 170 ] 459 0.037% 99.881% ( 170, 250 ] 379 0.030% 99.912% ( 250, 380 ] 412 0.033% 99.945% ( 380, 580 ] 565 0.045% 99.990% ( 580, 870 ] 589 0.047% 100.037% ( 870, 1300 ] 419 0.034% 100.071% ( 1300, 1900 ] 321 0.026% 100.096% ( 1900, 2900 ] 337 0.027% 100.123% ( 2900, 4400 ] 319 0.026% 100.149% ( 4400, 6600 ] 92 0.007% 100.156% ( 6600, 9900 ] 18 0.001% 100.158% ( 9900, 14000 ] 1 0.000% 100.158% ** Level 4 read latency histogram (micros): Count: 12164 Average: 400.2364 StdDev: 957.59 Min: 1 Median: 2.7060 Max: 10227 Percentiles: P50: 2.71 P75: 124.52 P99: 4357.44 P99.9: 8426.35 P99.99: 9871.44 ------------------------------------------------------ [ 0, 1 ] 234 1.924% 1.924% ( 1, 2 ] 4114 33.821% 35.745% ####### ( 2, 3 ] 2456 20.191% 55.936% #### ( 3, 4 ] 1121 9.216% 65.151% ## ( 4, 6 ] 833 6.848% 71.999% # ( 6, 10 ] 228 1.874% 73.874% ( 10, 15 ] 82 0.674% 74.548% ( 15, 22 ] 24 0.197% 74.745% ( 22, 34 ] 4 0.033% 74.778% ( 34, 51 ] 3 0.025% 74.803% ( 76, 110 ] 9 0.074% 74.877% ( 110, 170 ] 62 0.510% 75.386% ( 170, 250 ] 139 1.143% 76.529% ( 250, 380 ] 185 1.521% 78.050% ( 380, 580 ] 315 2.590% 80.640% # ( 580, 870 ] 452 3.716% 84.355% # ( 870, 1300 ] 523 4.300% 88.655% # ( 1300, 1900 ] 455 3.741% 92.396% # ( 1900, 2900 ] 439 3.609% 96.005% # ( 2900, 4400 ] 375 3.083% 99.087% # ( 4400, 6600 ] 85 0.699% 99.786% ( 6600, 9900 ] 25 0.206% 99.992% ( 9900, 14000 ] 1 0.008% 100.000% ** Level 5 read latency histogram (micros): Count: 260 Average: 1509.8808 StdDev: 1532.95 Min: 79 Median: 765.6000 Max: 7280 Percentiles: P50: 765.60 P75: 2700.00 P99: 6348.57 P99.9: 7280.00 P99.99: 7280.00 ------------------------------------------------------ ( 76, 110 ] 11 4.231% 4.231% # ( 110, 170 ] 31 11.923% 16.154% ## ( 170, 250 ] 20 7.692% 23.846% ## ( 250, 380 ] 17 6.538% 30.385% # ( 380, 580 ] 35 13.462% 43.846% ### ( 580, 870 ] 25 9.615% 53.462% ## ( 870, 1300 ] 16 6.154% 59.615% # ( 1300, 1900 ] 16 6.154% 65.769% # ( 1900, 2900 ] 30 11.538% 77.308% ## ( 2900, 4400 ] 44 16.923% 94.231% ### ( 4400, 6600 ] 14 5.385% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 45.1 total, 5.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 174.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.017 H:M:S, 51.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 194.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.108 H:M:S, 41.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-00:44:41 ... thread 0: (1000000,9000000) ops and (310346.5,186976.9) ops/second in (3.222205,48.134300) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.44 GB 169.9 7.1 0.0 7.1 15.7 8.5 0.0 1.8 130.8 287.5 55.85 49.94 146 0.383 7419K 8197 0.0 0.0 L1 12/12 839.04 MB 0.0 5.3 5.0 0.3 5.2 4.9 0.1 1.0 215.3 211.7 25.24 22.51 3 8.412 5242K 87K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.1 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 17/0 977.61 MB 1.0 5.9 4.1 1.8 5.9 4.1 0.1 1.4 186.9 186.6 32.35 26.41 13 2.488 5246K 6969 0.0 0.0 L4 184/0 9.49 GB 1.0 3.2 3.2 0.0 3.2 3.2 1.0 1.0 120.4 120.4 27.22 15.67 47 0.579 3299K 675 0.0 0.0 L5 1092/0 89.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1324/24 104.58 GB 0.0 21.7 12.3 9.3 30.1 20.8 9.7 3.5 157.1 218.3 141.15 114.99 210 0.672 21M 103K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.7 12.3 9.3 30.1 20.8 9.7 3.5 157.1 218.3 141.15 114.99 210 0.672 21M 103K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.7 12.3 9.3 21.5 12.2 0.0 0.0 195.1 194.1 113.65 92.64 89 1.277 21M 103K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 318.3 27.51 22.35 121 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.3 total, 48.1 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.10 GB write, 637.91 MB/s write, 21.66 GB read, 459.01 MB/s read, 141.2 seconds Interval compaction: 30.10 GB write, 640.28 MB/s write, 21.66 GB read, 460.71 MB/s read, 141.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 74, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 74, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3501833 Average: 2.7768 StdDev: 23.95 Min: 0 Median: 1.4144 Max: 7673 Percentiles: P50: 1.41 P75: 1.83 P99: 7.60 P99.9: 145.91 P99.99: 443.74 ------------------------------------------------------ [ 0, 1 ] 886581 25.318% 25.318% ##### ( 1, 2 ] 2085538 59.556% 84.873% ############ ( 2, 3 ] 248766 7.104% 91.977% # ( 3, 4 ] 124507 3.555% 95.533% # ( 4, 6 ] 110200 3.147% 98.680% # ( 6, 10 ] 28102 0.802% 99.482% ( 10, 15 ] 4792 0.137% 99.619% ( 15, 22 ] 677 0.019% 99.638% ( 22, 34 ] 40 0.001% 99.639% ( 34, 51 ] 25 0.001% 99.640% ( 51, 76 ] 96 0.003% 99.643% ( 76, 110 ] 6425 0.183% 99.826% ( 110, 170 ] 4314 0.123% 99.949% ( 170, 250 ] 704 0.020% 99.970% ( 250, 380 ] 545 0.016% 99.985% ( 380, 580 ] 536 0.015% 100.000% ( 580, 870 ] 293 0.008% 100.009% ( 870, 1300 ] 148 0.004% 100.013% ( 1300, 1900 ] 73 0.002% 100.015% ( 1900, 2900 ] 57 0.002% 100.017% ( 2900, 4400 ] 48 0.001% 100.018% ( 4400, 6600 ] 4 0.000% 100.018% ( 6600, 9900 ] 2 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1248264 Average: 5.8521 StdDev: 84.59 Min: 0 Median: 1.8205 Max: 10659 Percentiles: P50: 1.82 P75: 2.81 P99: 9.55 P99.9: 267.09 P99.99: 585.25 ------------------------------------------------------ [ 0, 1 ] 51238 4.105% 4.105% # ( 1, 2 ] 698202 55.934% 60.039% ########### ( 2, 3 ] 231369 18.535% 78.574% #### ( 3, 4 ] 112751 9.033% 87.606% ## ( 4, 6 ] 117326 9.399% 97.006% ## ( 6, 10 ] 28024 2.245% 99.251% ( 10, 15 ] 6063 0.486% 99.736% ( 15, 22 ] 730 0.058% 99.795% ( 22, 34 ] 39 0.003% 99.798% ( 34, 51 ] 13 0.001% 99.799% ( 51, 76 ] 15 0.001% 99.800% ( 76, 110 ] 324 0.026% 99.826% ( 110, 170 ] 431 0.035% 99.861% ( 170, 250 ] 422 0.034% 99.894% ( 250, 380 ] 523 0.042% 99.936% ( 380, 580 ] 659 0.053% 99.989% ( 580, 870 ] 562 0.045% 100.034% ( 870, 1300 ] 376 0.030% 100.064% ( 1300, 1900 ] 252 0.020% 100.085% ( 1900, 2900 ] 281 0.023% 100.107% ( 2900, 4400 ] 234 0.019% 100.126% ( 4400, 6600 ] 55 0.004% 100.130% ( 6600, 9900 ] 23 0.002% 100.132% ( 9900, 14000 ] 1 0.000% 100.132% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1249548 Average: 6.3923 StdDev: 94.85 Min: 0 Median: 1.8362 Max: 13356 Percentiles: P50: 1.84 P75: 2.86 P99: 9.49 P99.9: 219.07 P99.99: 580.51 ------------------------------------------------------ [ 0, 1 ] 70964 5.679% 5.679% # ( 1, 2 ] 662303 53.003% 58.683% ########### ( 2, 3 ] 236996 18.967% 77.649% #### ( 3, 4 ] 115992 9.283% 86.932% ## ( 4, 6 ] 127733 10.222% 97.154% ## ( 6, 10 ] 26468 2.118% 99.272% ( 10, 15 ] 6044 0.484% 99.756% ( 15, 22 ] 721 0.058% 99.814% ( 22, 34 ] 68 0.005% 99.819% ( 34, 51 ] 25 0.002% 99.821% ( 51, 76 ] 15 0.001% 99.822% ( 76, 110 ] 278 0.022% 99.845% ( 110, 170 ] 459 0.037% 99.881% ( 170, 250 ] 379 0.030% 99.912% ( 250, 380 ] 412 0.033% 99.945% ( 380, 580 ] 565 0.045% 99.990% ( 580, 870 ] 589 0.047% 100.037% ( 870, 1300 ] 419 0.034% 100.071% ( 1300, 1900 ] 321 0.026% 100.096% ( 1900, 2900 ] 337 0.027% 100.123% ( 2900, 4400 ] 319 0.026% 100.149% ( 4400, 6600 ] 92 0.007% 100.156% ( 6600, 9900 ] 18 0.001% 100.158% ( 9900, 14000 ] 1 0.000% 100.158% ** Level 4 read latency histogram (micros): Count: 12164 Average: 400.2364 StdDev: 957.59 Min: 1 Median: 2.7060 Max: 10227 Percentiles: P50: 2.71 P75: 124.52 P99: 4357.44 P99.9: 8426.35 P99.99: 9871.44 ------------------------------------------------------ [ 0, 1 ] 234 1.924% 1.924% ( 1, 2 ] 4114 33.821% 35.745% ####### ( 2, 3 ] 2456 20.191% 55.936% #### ( 3, 4 ] 1121 9.216% 65.151% ## ( 4, 6 ] 833 6.848% 71.999% # ( 6, 10 ] 228 1.874% 73.874% ( 10, 15 ] 82 0.674% 74.548% ( 15, 22 ] 24 0.197% 74.745% ( 22, 34 ] 4 0.033% 74.778% ( 34, 51 ] 3 0.025% 74.803% ( 76, 110 ] 9 0.074% 74.877% ( 110, 170 ] 62 0.510% 75.386% ( 170, 250 ] 139 1.143% 76.529% ( 250, 380 ] 185 1.521% 78.050% ( 380, 580 ] 315 2.590% 80.640% # ( 580, 870 ] 452 3.716% 84.355% # ( 870, 1300 ] 523 4.300% 88.655% # ( 1300, 1900 ] 455 3.741% 92.396% # ( 1900, 2900 ] 439 3.609% 96.005% # ( 2900, 4400 ] 375 3.083% 99.087% # ( 4400, 6600 ] 85 0.699% 99.786% ( 6600, 9900 ] 25 0.206% 99.992% ( 9900, 14000 ] 1 0.008% 100.000% ** Level 5 read latency histogram (micros): Count: 260 Average: 1509.8808 StdDev: 1532.95 Min: 79 Median: 765.6000 Max: 7280 Percentiles: P50: 765.60 P75: 2700.00 P99: 6348.57 P99.9: 7280.00 P99.99: 7280.00 ------------------------------------------------------ ( 76, 110 ] 11 4.231% 4.231% # ( 110, 170 ] 31 11.923% 16.154% ## ( 170, 250 ] 20 7.692% 23.846% ## ( 250, 380 ] 17 6.538% 30.385% # ( 380, 580 ] 35 13.462% 43.846% ### ( 580, 870 ] 25 9.615% 53.462% ## ( 870, 1300 ] 16 6.154% 59.615% # ( 1300, 1900 ] 16 6.154% 65.769% # ( 1900, 2900 ] 30 11.538% 77.308% ## ( 2900, 4400 ] 44 16.923% 94.231% ### ( 4400, 6600 ] 14 5.385% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 48.3 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 183.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:23.608 H:M:S, 48.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.592 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/17-00:44:46 ... thread 0: (1000000,10000000) ops and (200546.3,188250.6) ops/second in (4.986380,53.120680) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.89 GB 18.9 7.9 0.0 7.9 17.4 9.5 0.0 1.8 131.6 288.6 61.75 55.44 163 0.379 8251K 9044 0.0 0.0 L1 22/22 1.95 GB 0.0 7.6 6.5 1.1 7.5 6.3 0.1 1.2 211.5 208.4 36.80 32.79 4 9.201 7628K 110K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.1 0.1 0.0 0.1 0.1 4.5 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 19/2 1.09 GB 0.9 6.1 4.2 1.9 6.1 4.2 0.3 1.4 187.7 187.4 33.17 27.17 14 2.369 5429K 7755 0.0 0.0 L4 185/0 9.55 GB 1.0 3.2 3.2 0.0 3.2 3.2 1.1 1.0 120.4 120.4 27.22 15.67 47 0.579 3299K 675 0.0 0.0 L5 1092/0 89.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1335/39 105.48 GB 0.0 24.9 13.9 11.1 34.3 23.2 10.2 3.6 160.1 220.1 159.44 131.54 229 0.696 24M 127K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.9 13.9 11.1 34.3 23.2 10.2 3.6 160.1 220.1 159.44 131.54 229 0.696 24M 127K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.9 13.9 11.1 24.8 13.7 0.0 0.0 197.7 196.6 129.11 106.70 94 1.373 24M 127K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 319.9 30.33 24.84 135 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.3 total, 53.1 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.27 GB write, 658.33 MB/s write, 24.93 GB read, 478.90 MB/s read, 159.4 seconds Interval compaction: 34.27 GB write, 660.55 MB/s write, 24.93 GB read, 480.51 MB/s read, 159.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 20, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 20, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 76, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 20, total-stops: 76, interval: 96 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3900677 Average: 2.7389 StdDev: 23.28 Min: 0 Median: 1.4195 Max: 7673 Percentiles: P50: 1.42 P75: 1.83 P99: 7.40 P99.9: 142.95 P99.99: 432.02 ------------------------------------------------------ [ 0, 1 ] 964274 24.721% 24.721% ##### ( 1, 2 ] 2350776 60.266% 84.987% ############ ( 2, 3 ] 278882 7.150% 92.136% # ( 3, 4 ] 138260 3.545% 95.681% # ( 4, 6 ] 118714 3.043% 98.724% # ( 6, 10 ] 30831 0.790% 99.514% ( 10, 15 ] 5253 0.135% 99.649% ( 15, 22 ] 713 0.018% 99.667% ( 22, 34 ] 42 0.001% 99.668% ( 34, 51 ] 26 0.001% 99.669% ( 51, 76 ] 98 0.003% 99.672% ( 76, 110 ] 6488 0.166% 99.838% ( 110, 170 ] 4409 0.113% 99.951% ( 170, 250 ] 759 0.019% 99.970% ( 250, 380 ] 611 0.016% 99.986% ( 380, 580 ] 588 0.015% 100.001% ( 580, 870 ] 322 0.008% 100.009% ( 870, 1300 ] 163 0.004% 100.014% ( 1300, 1900 ] 76 0.002% 100.016% ( 1900, 2900 ] 65 0.002% 100.017% ( 2900, 4400 ] 48 0.001% 100.018% ( 4400, 6600 ] 4 0.000% 100.019% ( 6600, 9900 ] 2 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1392331 Average: 5.5338 StdDev: 80.31 Min: 0 Median: 1.7776 Max: 10659 Percentiles: P50: 1.78 P75: 2.71 P99: 9.47 P99.9: 252.98 P99.99: 591.52 ------------------------------------------------------ [ 0, 1 ] 78857 5.664% 5.664% # ( 1, 2 ] 793879 57.018% 62.682% ########### ( 2, 3 ] 241812 17.367% 80.049% ### ( 3, 4 ] 117098 8.410% 88.459% ## ( 4, 6 ] 120400 8.647% 97.107% ## ( 6, 10 ] 30354 2.180% 99.287% ( 10, 15 ] 6158 0.442% 99.729% ( 15, 22 ] 745 0.054% 99.783% ( 22, 34 ] 41 0.003% 99.785% ( 34, 51 ] 15 0.001% 99.787% ( 51, 76 ] 23 0.002% 99.788% ( 76, 110 ] 550 0.040% 99.828% ( 110, 170 ] 531 0.038% 99.866% ( 170, 250 ] 464 0.033% 99.899% ( 250, 380 ] 553 0.040% 99.939% ( 380, 580 ] 690 0.050% 99.988% ( 580, 870 ] 573 0.041% 100.030% ( 870, 1300 ] 388 0.028% 100.057% ( 1300, 1900 ] 256 0.018% 100.076% ( 1900, 2900 ] 281 0.020% 100.096% ( 2900, 4400 ] 234 0.017% 100.113% ( 4400, 6600 ] 55 0.004% 100.117% ( 6600, 9900 ] 23 0.002% 100.118% ( 9900, 14000 ] 1 0.000% 100.119% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1301932 Average: 6.2534 StdDev: 92.99 Min: 0 Median: 1.8211 Max: 13356 Percentiles: P50: 1.82 P75: 2.83 P99: 9.46 P99.9: 218.56 P99.99: 584.27 ------------------------------------------------------ [ 0, 1 ] 77851 5.980% 5.980% # ( 1, 2 ] 698000 53.613% 59.592% ########### ( 2, 3 ] 242030 18.590% 78.182% #### ( 3, 4 ] 118062 9.068% 87.251% ## ( 4, 6 ] 129310 9.932% 97.183% ## ( 6, 10 ] 27358 2.101% 99.284% ( 10, 15 ] 6124 0.470% 99.754% ( 15, 22 ] 728 0.056% 99.810% ( 22, 34 ] 70 0.005% 99.816% ( 34, 51 ] 26 0.002% 99.818% ( 51, 76 ] 15 0.001% 99.819% ( 76, 110 ] 296 0.023% 99.842% ( 110, 170 ] 514 0.039% 99.881% ( 170, 250 ] 407 0.031% 99.912% ( 250, 380 ] 430 0.033% 99.945% ( 380, 580 ] 573 0.044% 99.989% ( 580, 870 ] 598 0.046% 100.035% ( 870, 1300 ] 423 0.032% 100.068% ( 1300, 1900 ] 321 0.025% 100.092% ( 1900, 2900 ] 337 0.026% 100.118% ( 2900, 4400 ] 319 0.025% 100.143% ( 4400, 6600 ] 92 0.007% 100.150% ( 6600, 9900 ] 18 0.001% 100.151% ( 9900, 14000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 12164 Average: 400.2364 StdDev: 957.59 Min: 1 Median: 2.7060 Max: 10227 Percentiles: P50: 2.71 P75: 124.52 P99: 4357.44 P99.9: 8426.35 P99.99: 9871.44 ------------------------------------------------------ [ 0, 1 ] 234 1.924% 1.924% ( 1, 2 ] 4114 33.821% 35.745% ####### ( 2, 3 ] 2456 20.191% 55.936% #### ( 3, 4 ] 1121 9.216% 65.151% ## ( 4, 6 ] 833 6.848% 71.999% # ( 6, 10 ] 228 1.874% 73.874% ( 10, 15 ] 82 0.674% 74.548% ( 15, 22 ] 24 0.197% 74.745% ( 22, 34 ] 4 0.033% 74.778% ( 34, 51 ] 3 0.025% 74.803% ( 76, 110 ] 9 0.074% 74.877% ( 110, 170 ] 62 0.510% 75.386% ( 170, 250 ] 139 1.143% 76.529% ( 250, 380 ] 185 1.521% 78.050% ( 380, 580 ] 315 2.590% 80.640% # ( 580, 870 ] 452 3.716% 84.355% # ( 870, 1300 ] 523 4.300% 88.655% # ( 1300, 1900 ] 455 3.741% 92.396% # ( 1900, 2900 ] 439 3.609% 96.005% # ( 2900, 4400 ] 375 3.083% 99.087% # ( 4400, 6600 ] 85 0.699% 99.786% ( 6600, 9900 ] 25 0.206% 99.992% ( 9900, 14000 ] 1 0.008% 100.000% ** Level 5 read latency histogram (micros): Count: 260 Average: 1509.8808 StdDev: 1532.95 Min: 79 Median: 765.6000 Max: 7280 Percentiles: P50: 765.60 P75: 2700.00 P99: 6348.57 P99.9: 7280.00 P99.99: 7280.00 ------------------------------------------------------ ( 76, 110 ] 11 4.231% 4.231% # ( 110, 170 ] 31 11.923% 16.154% ## ( 170, 250 ] 20 7.692% 23.846% ## ( 250, 380 ] 17 6.538% 30.385% # ( 380, 580 ] 35 13.462% 43.846% ### ( 580, 870 ] 25 9.615% 53.462% ## ( 870, 1300 ] 16 6.154% 59.615% # ( 1300, 1900 ] 16 6.154% 65.769% # ( 1900, 2900 ] 30 11.538% 77.308% ## ( 2900, 4400 ] 44 16.923% 94.231% ### ( 4400, 6600 ] 14 5.385% 99.615% # ( 6600, 9900 ] 1 0.385% 100.000% ** DB Stats ** Uptime(secs): 53.3 total, 5.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 184.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.884 H:M:S, 48.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.276 H:M:S, 45.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/17-00:44:50 ... thread 0: (1000000,11000000) ops and (293253.0,194584.5) ops/second in (3.410025,56.530705) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.87 GB 119.6 9.0 0.0 9.0 19.4 10.4 0.0 1.9 133.5 288.7 68.91 62.11 182 0.379 9338K 10K 0.0 0.0 L1 22/22 1.95 GB 0.0 7.6 6.5 1.1 7.5 6.3 0.1 1.2 211.5 208.4 36.80 32.79 4 9.201 7628K 110K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.5 1.8 223.6 223.6 0.50 0.47 1 0.497 112K 24 0.0 0.0 L3 17/0 967.93 MB 1.0 6.4 4.3 2.1 6.4 4.3 0.3 1.5 189.4 189.0 34.64 28.59 15 2.309 5770K 10K 0.0 0.0 L4 185/0 9.45 GB 1.0 3.5 3.4 0.0 3.5 3.4 1.1 1.0 123.3 123.2 28.88 16.98 51 0.566 3584K 801 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/36 106.46 GB 0.0 26.6 14.3 12.3 36.9 24.6 10.6 3.5 160.3 222.6 169.73 140.94 253 0.671 26M 131K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.6 14.3 12.3 36.9 24.6 10.6 3.5 160.3 222.6 169.73 140.94 253 0.671 26M 131K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.6 14.3 12.3 26.4 14.1 0.0 0.0 199.5 198.5 136.40 113.51 103 1.324 26M 131K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 321.3 33.33 27.43 150 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.7 total, 56.5 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.90 GB write, 666.22 MB/s write, 26.58 GB read, 479.87 MB/s read, 169.7 seconds Interval compaction: 36.90 GB write, 668.33 MB/s write, 26.58 GB read, 481.39 MB/s read, 169.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 78, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 78, interval: 103 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4246885 Average: 2.7262 StdDev: 23.70 Min: 0 Median: 1.4286 Max: 7673 Percentiles: P50: 1.43 P75: 1.84 P99: 7.29 P99.9: 138.08 P99.99: 399.52 ------------------------------------------------------ [ 0, 1 ] 1018625 23.985% 23.985% ##### ( 1, 2 ] 2577816 60.699% 84.684% ############ ( 2, 3 ] 312898 7.368% 92.052% # ( 3, 4 ] 153570 3.616% 95.668% # ( 4, 6 ] 130657 3.077% 98.745% # ( 6, 10 ] 33667 0.793% 99.537% ( 10, 15 ] 5887 0.139% 99.676% ( 15, 22 ] 762 0.018% 99.694% ( 22, 34 ] 47 0.001% 99.695% ( 34, 51 ] 29 0.001% 99.696% ( 51, 76 ] 104 0.002% 99.698% ( 76, 110 ] 6507 0.153% 99.851% ( 110, 170 ] 4426 0.104% 99.955% ( 170, 250 ] 781 0.018% 99.974% ( 250, 380 ] 626 0.015% 99.989% ( 380, 580 ] 618 0.015% 100.003% ( 580, 870 ] 338 0.008% 100.011% ( 870, 1300 ] 180 0.004% 100.015% ( 1300, 1900 ] 81 0.002% 100.017% ( 1900, 2900 ] 76 0.002% 100.019% ( 2900, 4400 ] 56 0.001% 100.020% ( 4400, 6600 ] 6 0.000% 100.021% ( 6600, 9900 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1471509 Average: 5.3975 StdDev: 78.20 Min: 0 Median: 1.7624 Max: 10659 Percentiles: P50: 1.76 P75: 2.67 P99: 9.46 P99.9: 248.17 P99.99: 593.83 ------------------------------------------------------ [ 0, 1 ] 91253 6.201% 6.201% # ( 1, 2 ] 845306 57.445% 63.646% ########### ( 2, 3 ] 249211 16.936% 80.582% ### ( 3, 4 ] 120352 8.179% 88.761% ## ( 4, 6 ] 123195 8.372% 97.133% ## ( 6, 10 ] 31738 2.157% 99.290% ( 10, 15 ] 6340 0.431% 99.720% ( 15, 22 ] 763 0.052% 99.772% ( 22, 34 ] 43 0.003% 99.775% ( 34, 51 ] 15 0.001% 99.776% ( 51, 76 ] 25 0.002% 99.778% ( 76, 110 ] 663 0.045% 99.823% ( 110, 170 ] 641 0.044% 99.867% ( 170, 250 ] 504 0.034% 99.901% ( 250, 380 ] 578 0.039% 99.940% ( 380, 580 ] 707 0.048% 99.988% ( 580, 870 ] 584 0.040% 100.028% ( 870, 1300 ] 390 0.027% 100.054% ( 1300, 1900 ] 256 0.017% 100.072% ( 1900, 2900 ] 281 0.019% 100.091% ( 2900, 4400 ] 234 0.016% 100.107% ( 4400, 6600 ] 55 0.004% 100.110% ( 6600, 9900 ] 23 0.002% 100.112% ( 9900, 14000 ] 1 0.000% 100.112% ** Level 2 read latency histogram (micros): Count: 40500 Average: 2.0824 StdDev: 11.94 Min: 0 Median: 1.2549 Max: 1838 Percentiles: P50: 1.25 P75: 1.71 P99: 5.88 P99.9: 60.38 P99.99: 510.00 ------------------------------------------------------ [ 0, 1 ] 14594 36.035% 36.035% ####### ( 1, 2 ] 22187 54.783% 90.817% ########### ( 2, 3 ] 2114 5.220% 96.037% # ( 3, 4 ] 768 1.896% 97.933% ( 4, 6 ] 459 1.133% 99.067% ( 6, 10 ] 243 0.600% 99.667% ( 10, 15 ] 53 0.131% 99.798% ( 15, 22 ] 6 0.015% 99.812% ( 22, 34 ] 2 0.005% 99.817% ( 34, 51 ] 26 0.064% 99.881% ( 51, 76 ] 20 0.049% 99.931% ( 76, 110 ] 6 0.015% 99.946% ( 110, 170 ] 4 0.010% 99.956% ( 170, 250 ] 10 0.025% 99.980% ( 250, 380 ] 2 0.005% 99.985% ( 380, 580 ] 3 0.007% 99.993% ( 580, 870 ] 2 0.005% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1399007 Average: 6.0855 StdDev: 90.01 Min: 0 Median: 1.8216 Max: 13356 Percentiles: P50: 1.82 P75: 2.83 P99: 9.49 P99.9: 198.34 P99.99: 547.25 ------------------------------------------------------ [ 0, 1 ] 81085 5.796% 5.796% # ( 1, 2 ] 752712 53.803% 59.599% ########### ( 2, 3 ] 260052 18.588% 78.188% #### ( 3, 4 ] 126735 9.059% 87.246% ## ( 4, 6 ] 138607 9.908% 97.154% ## ( 6, 10 ] 29619 2.117% 99.271% ( 10, 15 ] 6741 0.482% 99.753% ( 15, 22 ] 804 0.057% 99.810% ( 22, 34 ] 79 0.006% 99.816% ( 34, 51 ] 26 0.002% 99.818% ( 51, 76 ] 17 0.001% 99.819% ( 76, 110 ] 349 0.025% 99.844% ( 110, 170 ] 618 0.044% 99.888% ( 170, 250 ] 463 0.033% 99.921% ( 250, 380 ] 455 0.033% 99.954% ( 380, 580 ] 604 0.043% 99.997% ( 580, 870 ] 617 0.044% 100.041% ( 870, 1300 ] 427 0.031% 100.072% ( 1300, 1900 ] 331 0.024% 100.095% ( 1900, 2900 ] 339 0.024% 100.120% ( 2900, 4400 ] 320 0.023% 100.142% ( 4400, 6600 ] 92 0.007% 100.149% ( 6600, 9900 ] 18 0.001% 100.150% ( 9900, 14000 ] 1 0.000% 100.150% ** Level 4 read latency histogram (micros): Count: 13256 Average: 378.5151 StdDev: 925.54 Min: 1 Median: 2.6932 Max: 10227 Percentiles: P50: 2.69 P75: 104.33 P99: 4313.99 P99.9: 8282.21 P99.99: 9857.02 ------------------------------------------------------ [ 0, 1 ] 259 1.954% 1.954% ( 1, 2 ] 4507 34.000% 35.954% ####### ( 2, 3 ] 2686 20.263% 56.216% #### ( 3, 4 ] 1208 9.113% 65.329% ## ( 4, 6 ] 897 6.767% 72.096% # ( 6, 10 ] 249 1.878% 73.974% ( 10, 15 ] 88 0.664% 74.638% ( 15, 22 ] 26 0.196% 74.834% ( 22, 34 ] 4 0.030% 74.864% ( 34, 51 ] 3 0.023% 74.887% ( 76, 110 ] 18 0.136% 75.023% ( 110, 170 ] 101 0.762% 75.785% ( 170, 250 ] 179 1.350% 77.135% ( 250, 380 ] 227 1.712% 78.847% ( 380, 580 ] 355 2.678% 81.525% # ( 580, 870 ] 494 3.727% 85.252% # ( 870, 1300 ] 556 4.194% 89.446% # ( 1300, 1900 ] 464 3.500% 92.947% # ( 1900, 2900 ] 448 3.380% 96.326% # ( 2900, 4400 ] 376 2.836% 99.163% # ( 4400, 6600 ] 85 0.641% 99.804% ( 6600, 9900 ] 25 0.189% 99.992% ( 9900, 14000 ] 1 0.008% 100.000% ** Level 5 read latency histogram (micros): Count: 280 Average: 1461.0214 StdDev: 1512.21 Min: 79 Median: 742.4000 Max: 7280 Percentiles: P50: 742.40 P75: 2566.67 P99: 6317.14 P99.9: 7280.00 P99.99: 7280.00 ------------------------------------------------------ ( 76, 110 ] 14 5.000% 5.000% # ( 110, 170 ] 35 12.500% 17.500% ### ( 170, 250 ] 23 8.214% 25.714% ## ( 250, 380 ] 18 6.429% 32.143% # ( 380, 580 ] 36 12.857% 45.000% ### ( 580, 870 ] 25 8.929% 53.929% ## ( 870, 1300 ] 19 6.786% 60.714% # ( 1300, 1900 ] 20 7.143% 67.857% # ( 1900, 2900 ] 30 10.714% 78.571% ## ( 2900, 4400 ] 45 16.071% 94.643% ### ( 4400, 6600 ] 14 5.000% 99.643% # ( 6600, 9900 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 56.7 total, 3.4 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 190.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.571 H:M:S, 46.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.687 H:M:S, 20.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.435 micros/op 183987 ops/sec 60.102 seconds 11057999 operations; 178.3 MB/s Microseconds per write: Count: 11057999 Average: 5.4351 StdDev: 431.32 Min: 0 Median: 1.7294 Max: 672010 Percentiles: P50: 1.73 P75: 2.73 P99: 9.11 P99.9: 1095.51 P99.99: 2712.87 ------------------------------------------------------ [ 0, 1 ] 1561971 14.125% 14.125% ### ( 1, 2 ] 5438941 49.186% 63.311% ########## ( 2, 3 ] 1771163 16.017% 79.328% ### ( 3, 4 ] 1498881 13.555% 92.883% ### ( 4, 6 ] 578289 5.230% 98.112% # ( 6, 10 ] 126221 1.141% 99.254% ( 10, 15 ] 41803 0.378% 99.632% ( 15, 22 ] 10019 0.091% 99.722% ( 22, 34 ] 2189 0.020% 99.742% ( 34, 51 ] 253 0.002% 99.744% ( 51, 76 ] 36 0.000% 99.745% ( 76, 110 ] 7585 0.069% 99.813% ( 110, 170 ] 3063 0.028% 99.841% ( 170, 250 ] 346 0.003% 99.844% ( 250, 380 ] 170 0.002% 99.846% ( 380, 580 ] 26 0.000% 99.846% ( 580, 870 ] 43 0.000% 99.846% ( 870, 1300 ] 11330 0.102% 99.949% ( 1300, 1900 ] 43 0.000% 99.949% ( 1900, 2900 ] 5562 0.050% 99.999% ( 2900, 4400 ] 23 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 5 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 170949 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11057999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11411854968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 605 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29814139 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30741046783 rocksdb.compact.write.bytes COUNT : 30570498044 rocksdb.flush.write.bytes COUNT : 11361735093 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 64 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 332 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270175744 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4423680 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30846922137 rocksdb.non.last.level.read.count COUNT : 7448926 rocksdb.block.checksum.compute.count COUNT : 7447780 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.378900 P95 : 3.900921 P99 : 7.550837 P100 : 672007.000000 COUNT : 11057999 SUM : 55045834 rocksdb.compaction.times.micros P50 : 807272.727273 P95 : 4230000.000000 P99 : 13832000.000000 P100 : 19222038.000000 COUNT : 104 SUM : 137347471 rocksdb.compaction.times.cpu_micros P50 : 380000.000000 P95 : 3786666.666667 P99 : 13832000.000000 P100 : 17452460.000000 COUNT : 104 SUM : 114436639 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 709.647059 P95 : 2633.333333 P99 : 9042.000000 P100 : 14061.000000 COUNT : 152 SUM : 154692 rocksdb.compaction.outfile.sync.micros P50 : 1049.536082 P95 : 19285.714286 P99 : 43370.000000 P100 : 73745.000000 COUNT : 395 SUM : 1597853 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 124.464286 P95 : 1637.500000 P99 : 3975.000000 P100 : 5073.000000 COUNT : 285 SUM : 100805 rocksdb.table.open.io.micros P50 : 1381.000000 P95 : 8679.000000 P99 : 13126.052632 P100 : 15902.000000 COUNT : 605 SUM : 1332849 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.612518 P95 : 8.081513 P99 : 12.302752 P100 : 14345.000000 COUNT : 7445973 SUM : 49358885 rocksdb.read.block.get.micros P50 : 433.465347 P95 : 3698.076923 P99 : 5538.260870 P100 : 7427.000000 COUNT : 1210 SUM : 1077548 rocksdb.write.raw.block.micros P50 : 0.513768 P95 : 0.976159 P99 : 3.022744 P100 : 15196.000000 COUNT : 10155939 SUM : 21108764 rocksdb.numfiles.in.singlecompaction P50 : 3.025000 P95 : 6.950000 P99 : 20.565000 P100 : 32.000000 COUNT : 141 SUM : 514 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564030 P95 : 1228.039073 P99 : 2636.195711 P100 : 671824.000000 COUNT : 149785 SUM : 29829343 rocksdb.sst.read.micros P50 : 1.556286 P95 : 4.878919 P99 : 8.990749 P100 : 13356.000000 COUNT : 7449039 SUM : 34231842 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11057999 SUM : 11411854968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211165.048544 P95 : 433200.000000 P99 : 749800.000000 P100 : 848818.000000 COUNT : 152 SUM : 33690517 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 372 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0