[2024-12-08 08:39:10.204284] Starting SPDK v25.01-pre git sha1 a2f5e1c2d / DPDK 24.03.0 initialization... [2024-12-08 08:39:10.204433] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1694830 ] Set seed to 1733643550200948 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-08 08:39:10.320974] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-08 08:39:10.427830] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-08 08:39:10.427878] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1694830' to capture a snapshot of events at runtime. [2024-12-08 08:39:10.427889] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-08 08:39:10.427899] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-08 08:39:10.427907] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1694830 for offline analysis/debug. [2024-12-08 08:39:10.429303] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 8 08:39:18 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/08-08:39:21 ... thread 0: (1000000,1000000) ops and (357448.9,357448.9) ops/second in (2.797603,2.797603) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.03 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.0 2.31 2.06 12 0.193 0 0 0.0 0.0 L1 3/3 188.89 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 260.4 260.3 0.73 0.69 1 0.726 191K 85 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 11/0 993.34 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1028/0 85.45 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1168/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 88.3 317.7 3.57 3.26 14 0.255 319K 128 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.3 1.4 88.3 317.7 3.57 3.26 14 0.255 319K 128 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 251.1 250.9 1.25 1.20 2 0.627 319K 128 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.0 2.31 2.06 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 378.76 MB/s write, 0.31 GB read, 105.22 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 405.10 MB/s write, 0.31 GB read, 112.54 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 117354 Average: 1.9662 StdDev: 21.49 Min: 0 Median: 1.2531 Max: 4403 Percentiles: P50: 1.25 P75: 1.68 P99: 4.99 P99.9: 11.37 P99.99: 393.22 ------------------------------------------------------ [ 0, 1 ] 41341 35.228% 35.228% ####### ( 1, 2 ] 68488 58.360% 93.588% ############ ( 2, 3 ] 4062 3.461% 97.049% # ( 3, 4 ] 1716 1.462% 98.511% ( 4, 6 ] 1161 0.989% 99.501% ( 6, 10 ] 445 0.379% 99.880% ( 10, 15 ] 90 0.077% 99.957% ( 15, 22 ] 26 0.022% 99.979% ( 22, 34 ] 1 0.001% 99.980% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 1 0.001% 99.981% ( 110, 170 ] 6 0.005% 99.986% ( 170, 250 ] 4 0.003% 99.990% ( 250, 380 ] 1 0.001% 99.991% ( 380, 580 ] 4 0.003% 99.994% ( 580, 870 ] 3 0.003% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ( 4400, 6600 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 23342 Average: 2.5526 StdDev: 69.58 Min: 1 Median: 1.2916 Max: 8538 Percentiles: P50: 1.29 P75: 1.70 P99: 4.37 P99.9: 11.41 P99.99: 1156.29 ------------------------------------------------------ [ 0, 1 ] 7514 32.191% 32.191% ###### ( 1, 2 ] 14256 61.074% 93.265% ############ ( 2, 3 ] 982 4.207% 97.472% # ( 3, 4 ] 322 1.379% 98.852% ( 4, 6 ] 187 0.801% 99.653% ( 6, 10 ] 54 0.231% 99.884% ( 10, 15 ] 13 0.056% 99.940% ( 15, 22 ] 4 0.017% 99.957% ( 22, 34 ] 1 0.004% 99.961% ( 110, 170 ] 1 0.004% 99.966% ( 170, 250 ] 1 0.004% 99.970% ( 250, 380 ] 2 0.009% 99.979% ( 380, 580 ] 2 0.009% 99.987% ( 870, 1300 ] 1 0.004% 99.991% ( 4400, 6600 ] 1 0.004% 99.996% ( 6600, 9900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 7241 Average: 2.5988 StdDev: 8.73 Min: 0 Median: 1.6677 Max: 650 Percentiles: P50: 1.67 P75: 2.24 P99: 7.33 P99.9: 12.88 P99.99: 650.00 ------------------------------------------------------ [ 0, 1 ] 553 7.637% 7.637% ## ( 1, 2 ] 4594 63.444% 71.081% ############# ( 2, 3 ] 1198 16.545% 87.626% ### ( 3, 4 ] 414 5.717% 93.343% # ( 4, 6 ] 381 5.262% 98.605% # ( 6, 10 ] 89 1.229% 99.834% ( 10, 15 ] 10 0.138% 99.972% ( 22, 34 ] 1 0.014% 99.986% ( 250, 380 ] 1 0.014% 100.000% ( 580, 870 ] 1 0.014% 100.014% ** Level 3 read latency histogram (micros): Count: 50 Average: 2910.5200 StdDev: 2696.45 Min: 63 Median: 1900.0000 Max: 9196 Percentiles: P50: 1900.00 P75: 5408.33 P99: 9196.00 P99.9: 9196.00 P99.99: 9196.00 ------------------------------------------------------ ( 51, 76 ] 1 2.000% 2.000% ( 76, 110 ] 1 2.000% 4.000% ( 110, 170 ] 1 2.000% 6.000% ( 250, 380 ] 4 8.000% 14.000% ## ( 380, 580 ] 7 14.000% 28.000% ### ( 580, 870 ] 8 16.000% 44.000% ### ( 870, 1300 ] 2 4.000% 48.000% # ( 1300, 1900 ] 1 2.000% 50.000% ( 1900, 2900 ] 3 6.000% 56.000% # ( 2900, 4400 ] 4 8.000% 64.000% ## ( 4400, 6600 ] 12 24.000% 88.000% ##### ( 6600, 9900 ] 6 12.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 25 Average: 3978.6800 StdDev: 1816.44 Min: 459 Median: 3983.3333 Max: 8020 Percentiles: P50: 3983.33 P75: 5431.25 P99: 8020.00 P99.9: 8020.00 P99.99: 8020.00 ------------------------------------------------------ ( 380, 580 ] 1 4.000% 4.000% # ( 580, 870 ] 1 4.000% 8.000% # ( 870, 1300 ] 1 4.000% 12.000% # ( 1300, 1900 ] 1 4.000% 16.000% # ( 1900, 2900 ] 2 8.000% 24.000% ## ( 2900, 4400 ] 9 36.000% 60.000% ####### ( 4400, 6600 ] 8 32.000% 92.000% ###### ( 6600, 9900 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.183 H:M:S, 6.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.183 H:M:S, 6.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/08-08:39:24 ... thread 0: (1000000,2000000) ops and (308929.1,331422.6) ops/second in (3.236989,6.034592) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 1.29 GB 25.2 0.8 0.0 0.8 2.6 1.8 0.0 1.4 96.7 319.6 8.47 7.80 29 0.292 831K 866 0.0 0.0 L1 1/1 4.49 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 244.9 244.6 2.57 2.49 2 1.286 639K 815 0.0 0.0 L2 2/0 50.61 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 13/0 636.45 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.5 1.0 211.8 211.9 0.59 0.53 1 0.589 126K 0 0.0 0.0 L4 169/0 9.52 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 109.5 109.5 1.02 0.67 1 1.022 113K 0 0.0 0.0 L5 1040/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1234/7 97.98 GB 0.0 1.8 0.7 1.0 3.6 2.6 3.0 2.0 137.4 280.6 13.19 12.00 34 0.388 1839K 1724 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.0 3.6 2.6 2.9 2.0 137.4 280.6 13.19 12.00 34 0.388 1839K 1724 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.0 1.8 0.7 0.0 0.0 232.3 232.1 7.80 7.22 8 0.975 1839K 1724 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.8 5.39 4.77 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.61 GB write, 593.79 MB/s write, 1.77 GB read, 290.75 MB/s read, 13.2 seconds Interval compaction: 3.61 GB write, 612.93 MB/s write, 1.77 GB read, 300.12 MB/s read, 13.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 390753 Average: 2.0932 StdDev: 15.31 Min: 0 Median: 1.4093 Max: 4403 Percentiles: P50: 1.41 P75: 1.80 P99: 5.38 P99.9: 9.91 P99.99: 20.27 ------------------------------------------------------ [ 0, 1 ] 94107 24.084% 24.084% ##### ( 1, 2 ] 247403 63.314% 87.398% ############# ( 2, 3 ] 31750 8.125% 95.523% ## ( 3, 4 ] 9160 2.344% 97.867% ( 4, 6 ] 6428 1.645% 99.512% ( 6, 10 ] 1552 0.397% 99.910% ( 10, 15 ] 275 0.070% 99.980% ( 15, 22 ] 53 0.014% 99.994% ( 22, 34 ] 5 0.001% 99.995% ( 34, 51 ] 3 0.001% 99.996% ( 51, 76 ] 5 0.001% 99.997% ( 110, 170 ] 10 0.003% 99.999% ( 170, 250 ] 10 0.003% 100.002% ( 250, 380 ] 6 0.002% 100.004% ( 380, 580 ] 8 0.002% 100.006% ( 580, 870 ] 10 0.003% 100.008% ( 870, 1300 ] 3 0.001% 100.009% ( 1300, 1900 ] 4 0.001% 100.010% ( 1900, 2900 ] 2 0.001% 100.010% ( 2900, 4400 ] 4 0.001% 100.012% ( 4400, 6600 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 47998 Average: 2.5867 StdDev: 49.88 Min: 1 Median: 1.4877 Max: 8538 Percentiles: P50: 1.49 P75: 1.88 P99: 5.55 P99.9: 11.76 P99.99: 1106.52 ------------------------------------------------------ [ 0, 1 ] 9107 18.974% 18.974% #### ( 1, 2 ] 30538 63.623% 82.597% ############# ( 2, 3 ] 5549 11.561% 94.158% ## ( 3, 4 ] 1431 2.981% 97.139% # ( 4, 6 ] 1154 2.404% 99.544% ( 6, 10 ] 158 0.329% 99.873% ( 10, 15 ] 37 0.077% 99.950% ( 15, 22 ] 5 0.010% 99.960% ( 22, 34 ] 2 0.004% 99.965% ( 110, 170 ] 2 0.004% 99.969% ( 170, 250 ] 1 0.002% 99.971% ( 250, 380 ] 3 0.006% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 870, 1300 ] 4 0.008% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31661 Average: 2.4451 StdDev: 4.28 Min: 0 Median: 1.6531 Max: 650 Percentiles: P50: 1.65 P75: 2.14 P99: 6.05 P99.9: 9.96 P99.99: 14.97 ------------------------------------------------------ [ 0, 1 ] 2286 7.220% 7.220% # ( 1, 2 ] 20738 65.500% 72.720% ############# ( 2, 3 ] 5078 16.039% 88.759% ### ( 3, 4 ] 1707 5.391% 94.151% # ( 4, 6 ] 1532 4.839% 98.989% # ( 6, 10 ] 291 0.919% 99.908% ( 10, 15 ] 26 0.082% 99.991% ( 22, 34 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28506 Average: 7.8890 StdDev: 166.16 Min: 1 Median: 1.9714 Max: 9196 Percentiles: P50: 1.97 P75: 2.65 P99: 8.59 P99.9: 940.81 P99.99: 8332.17 ------------------------------------------------------ [ 0, 1 ] 763 2.677% 2.677% # ( 1, 2 ] 13887 48.716% 51.393% ########## ( 2, 3 ] 10315 36.185% 87.578% ####### ( 3, 4 ] 1457 5.111% 92.689% # ( 4, 6 ] 1535 5.385% 98.074% # ( 6, 10 ] 407 1.428% 99.502% ( 10, 15 ] 85 0.298% 99.800% ( 15, 22 ] 4 0.014% 99.814% ( 22, 34 ] 1 0.004% 99.818% ( 51, 76 ] 1 0.004% 99.821% ( 76, 110 ] 1 0.004% 99.825% ( 110, 170 ] 1 0.004% 99.828% ( 250, 380 ] 5 0.018% 99.846% ( 380, 580 ] 7 0.025% 99.870% ( 580, 870 ] 8 0.028% 99.898% ( 870, 1300 ] 3 0.011% 99.909% ( 1300, 1900 ] 1 0.004% 99.912% ( 1900, 2900 ] 3 0.011% 99.923% ( 2900, 4400 ] 4 0.014% 99.937% ( 4400, 6600 ] 12 0.042% 99.979% ( 6600, 9900 ] 6 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.4613 StdDev: 1198.59 Min: 1 Median: 2.1129 Max: 8020 Percentiles: P50: 2.11 P75: 3.90 P99: 6297.50 P99.9: 8020.00 P99.99: 8020.00 ------------------------------------------------------ [ 0, 1 ] 48 15.484% 15.484% ### ( 1, 2 ] 100 32.258% 47.742% ###### ( 2, 3 ] 62 20.000% 67.742% #### ( 3, 4 ] 25 8.065% 75.806% ## ( 4, 6 ] 19 6.129% 81.935% # ( 6, 10 ] 16 5.161% 87.097% # ( 10, 15 ] 9 2.903% 90.000% # ( 51, 76 ] 2 0.645% 90.645% ( 110, 170 ] 2 0.645% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 1 0.323% 92.903% ( 1300, 1900 ] 1 0.323% 93.226% ( 1900, 2900 ] 2 0.645% 93.871% ( 2900, 4400 ] 9 2.903% 96.774% # ( 4400, 6600 ] 8 2.581% 99.355% # ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 939.8333 StdDev: 1180.41 Min: 91 Median: 361.4286 Max: 5675 Percentiles: P50: 361.43 P75: 1420.00 P99: 5280.00 P99.9: 5675.00 P99.99: 5675.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 14 23.333% 31.667% ##### ( 170, 250 ] 5 8.333% 40.000% ## ( 250, 380 ] 7 11.667% 51.667% ## ( 380, 580 ] 5 8.333% 60.000% ## ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.2 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 315.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.745 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.562 H:M:S, 17.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/08-08:39:27 ... thread 0: (1000000,3000000) ops and (347225.8,336528.0) ops/second in (2.879970,8.914562) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.21 GB 62.9 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.2 317.2 13.30 12.30 45 0.296 1407K 1532 0.0 0.0 L1 1/1 4.49 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 244.9 244.6 2.57 2.49 2 1.286 639K 815 0.0 0.0 L2 2/0 50.61 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 13/0 636.45 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.5 1.0 211.8 211.9 0.59 0.53 1 0.589 126K 0 0.0 0.0 L4 169/0 9.52 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 109.5 109.5 1.02 0.67 1 1.022 113K 0 0.0 0.0 L5 1040/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/15 98.90 GB 0.0 2.3 0.7 1.6 5.1 3.5 3.0 1.8 132.0 289.3 18.01 16.49 50 0.360 2414K 2390 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.7 1.6 5.1 3.5 2.9 1.8 132.0 289.3 18.01 16.49 50 0.360 2414K 2390 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.7 1.6 2.3 0.7 0.0 0.0 239.0 238.7 9.95 9.34 10 0.995 2414K 2390 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 351.7 8.06 7.15 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.09 GB write, 571.95 MB/s write, 2.32 GB read, 261.07 MB/s read, 18.0 seconds Interval compaction: 5.09 GB write, 584.44 MB/s write, 2.32 GB read, 266.76 MB/s read, 18.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 787475 Average: 2.1856 StdDev: 12.38 Min: 0 Median: 1.4996 Max: 4403 Percentiles: P50: 1.50 P75: 1.88 P99: 5.49 P99.9: 9.62 P99.99: 13.87 ------------------------------------------------------ [ 0, 1 ] 136449 17.327% 17.327% ### ( 1, 2 ] 514998 65.399% 82.726% ############# ( 2, 3 ] 92375 11.731% 94.457% ## ( 3, 4 ] 23380 2.969% 97.426% # ( 4, 6 ] 16664 2.116% 99.542% ( 6, 10 ] 3123 0.397% 99.938% ( 10, 15 ] 528 0.067% 100.005% ( 15, 22 ] 75 0.010% 100.015% ( 22, 34 ] 8 0.001% 100.016% ( 34, 51 ] 6 0.001% 100.017% ( 51, 76 ] 9 0.001% 100.018% ( 76, 110 ] 1 0.000% 100.018% ( 110, 170 ] 15 0.002% 100.020% ( 170, 250 ] 17 0.002% 100.022% ( 250, 380 ] 9 0.001% 100.023% ( 380, 580 ] 19 0.002% 100.026% ( 580, 870 ] 12 0.002% 100.027% ( 870, 1300 ] 4 0.001% 100.028% ( 1300, 1900 ] 4 0.001% 100.028% ( 1900, 2900 ] 4 0.001% 100.029% ( 2900, 4400 ] 5 0.001% 100.029% ( 4400, 6600 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 47998 Average: 2.5867 StdDev: 49.88 Min: 1 Median: 1.4877 Max: 8538 Percentiles: P50: 1.49 P75: 1.88 P99: 5.55 P99.9: 11.76 P99.99: 1106.52 ------------------------------------------------------ [ 0, 1 ] 9107 18.974% 18.974% #### ( 1, 2 ] 30538 63.623% 82.597% ############# ( 2, 3 ] 5549 11.561% 94.158% ## ( 3, 4 ] 1431 2.981% 97.139% # ( 4, 6 ] 1154 2.404% 99.544% ( 6, 10 ] 158 0.329% 99.873% ( 10, 15 ] 37 0.077% 99.950% ( 15, 22 ] 5 0.010% 99.960% ( 22, 34 ] 2 0.004% 99.965% ( 110, 170 ] 2 0.004% 99.969% ( 170, 250 ] 1 0.002% 99.971% ( 250, 380 ] 3 0.006% 99.977% ( 380, 580 ] 4 0.008% 99.985% ( 870, 1300 ] 4 0.008% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31661 Average: 2.4451 StdDev: 4.28 Min: 0 Median: 1.6531 Max: 650 Percentiles: P50: 1.65 P75: 2.14 P99: 6.05 P99.9: 9.96 P99.99: 14.97 ------------------------------------------------------ [ 0, 1 ] 2286 7.220% 7.220% # ( 1, 2 ] 20738 65.500% 72.720% ############# ( 2, 3 ] 5078 16.039% 88.759% ### ( 3, 4 ] 1707 5.391% 94.151% # ( 4, 6 ] 1532 4.839% 98.989% # ( 6, 10 ] 291 0.919% 99.908% ( 10, 15 ] 26 0.082% 99.991% ( 22, 34 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28506 Average: 7.8890 StdDev: 166.16 Min: 1 Median: 1.9714 Max: 9196 Percentiles: P50: 1.97 P75: 2.65 P99: 8.59 P99.9: 940.81 P99.99: 8332.17 ------------------------------------------------------ [ 0, 1 ] 763 2.677% 2.677% # ( 1, 2 ] 13887 48.716% 51.393% ########## ( 2, 3 ] 10315 36.185% 87.578% ####### ( 3, 4 ] 1457 5.111% 92.689% # ( 4, 6 ] 1535 5.385% 98.074% # ( 6, 10 ] 407 1.428% 99.502% ( 10, 15 ] 85 0.298% 99.800% ( 15, 22 ] 4 0.014% 99.814% ( 22, 34 ] 1 0.004% 99.818% ( 51, 76 ] 1 0.004% 99.821% ( 76, 110 ] 1 0.004% 99.825% ( 110, 170 ] 1 0.004% 99.828% ( 250, 380 ] 5 0.018% 99.846% ( 380, 580 ] 7 0.025% 99.870% ( 580, 870 ] 8 0.028% 99.898% ( 870, 1300 ] 3 0.011% 99.909% ( 1300, 1900 ] 1 0.004% 99.912% ( 1900, 2900 ] 3 0.011% 99.923% ( 2900, 4400 ] 4 0.014% 99.937% ( 4400, 6600 ] 12 0.042% 99.979% ( 6600, 9900 ] 6 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.4613 StdDev: 1198.59 Min: 1 Median: 2.1129 Max: 8020 Percentiles: P50: 2.11 P75: 3.90 P99: 6297.50 P99.9: 8020.00 P99.99: 8020.00 ------------------------------------------------------ [ 0, 1 ] 48 15.484% 15.484% ### ( 1, 2 ] 100 32.258% 47.742% ###### ( 2, 3 ] 62 20.000% 67.742% #### ( 3, 4 ] 25 8.065% 75.806% ## ( 4, 6 ] 19 6.129% 81.935% # ( 6, 10 ] 16 5.161% 87.097% # ( 10, 15 ] 9 2.903% 90.000% # ( 51, 76 ] 2 0.645% 90.645% ( 110, 170 ] 2 0.645% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 1 0.323% 92.903% ( 1300, 1900 ] 1 0.323% 93.226% ( 1900, 2900 ] 2 0.645% 93.871% ( 2900, 4400 ] 9 2.903% 96.774% # ( 4400, 6600 ] 8 2.581% 99.355% # ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 939.8333 StdDev: 1180.41 Min: 91 Median: 361.4286 Max: 5675 Percentiles: P50: 361.43 P75: 1420.00 P99: 5280.00 P99.9: 5675.00 P99.99: 5675.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 14 23.333% 31.667% ##### ( 170, 250 ] 5 8.333% 40.000% ## ( 250, 380 ] 7 11.667% 51.667% ## ( 380, 580 ] 5 8.333% 60.000% ## ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 9.1 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.957 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 341.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.212 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/08-08:39:30 ... thread 0: (1000000,4000000) ops and (328280.2,334427.5) ops/second in (3.046178,11.960740) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.09 GB 182.5 2.5 0.0 2.5 6.1 3.7 0.0 1.7 124.1 310.0 20.31 18.92 62 0.328 2558K 2704 0.0 0.0 L1 9/0 1.04 GB 107.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 236.8 236.0 7.20 7.01 3 2.399 1730K 5476 0.0 0.0 L2 2/0 50.61 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 13/0 636.45 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.5 1.0 211.8 211.9 0.59 0.53 1 0.589 126K 0 0.0 0.0 L4 169/0 9.52 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 109.5 109.5 1.02 0.67 1 1.022 113K 0 0.0 0.0 L5 1040/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/4 99.82 GB 0.0 4.5 1.8 2.7 8.2 5.5 3.0 2.2 154.7 281.9 29.65 27.63 68 0.436 4657K 8223 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.8 2.7 8.2 5.5 2.9 2.2 154.7 281.9 29.65 27.63 68 0.436 4657K 8223 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.8 2.7 4.5 1.8 0.0 0.0 242.4 241.9 18.93 18.10 15 1.262 4657K 8223 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.4 10.73 9.53 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.16 GB write, 687.53 MB/s write, 4.48 GB read, 377.32 MB/s read, 29.7 seconds Interval compaction: 8.16 GB write, 698.72 MB/s write, 4.48 GB read, 383.45 MB/s read, 29.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1091733 Average: 2.1691 StdDev: 12.37 Min: 0 Median: 1.4898 Max: 4403 Percentiles: P50: 1.49 P75: 1.87 P99: 5.43 P99.9: 9.60 P99.99: 14.04 ------------------------------------------------------ [ 0, 1 ] 194930 17.855% 17.855% #### ( 1, 2 ] 716515 65.631% 83.486% ############# ( 2, 3 ] 123175 11.283% 94.769% ## ( 3, 4 ] 30824 2.823% 97.592% # ( 4, 6 ] 21505 1.970% 99.562% ( 6, 10 ] 4104 0.376% 99.938% ( 10, 15 ] 707 0.065% 100.002% ( 15, 22 ] 92 0.008% 100.011% ( 22, 34 ] 14 0.001% 100.012% ( 34, 51 ] 10 0.001% 100.013% ( 51, 76 ] 13 0.001% 100.014% ( 76, 110 ] 1 0.000% 100.014% ( 110, 170 ] 18 0.002% 100.016% ( 170, 250 ] 25 0.002% 100.018% ( 250, 380 ] 11 0.001% 100.019% ( 380, 580 ] 24 0.002% 100.022% ( 580, 870 ] 17 0.002% 100.023% ( 870, 1300 ] 8 0.001% 100.024% ( 1300, 1900 ] 8 0.001% 100.025% ( 1900, 2900 ] 5 0.000% 100.025% ( 2900, 4400 ] 7 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 49183 Average: 2.9019 StdDev: 53.52 Min: 1 Median: 1.4867 Max: 8538 Percentiles: P50: 1.49 P75: 1.88 P99: 5.57 P99.9: 14.05 P99.99: 1789.80 ------------------------------------------------------ [ 0, 1 ] 9335 18.980% 18.980% #### ( 1, 2 ] 31345 63.731% 82.712% ############# ( 2, 3 ] 5635 11.457% 94.169% ## ( 3, 4 ] 1459 2.966% 97.135% # ( 4, 6 ] 1166 2.371% 99.506% ( 6, 10 ] 163 0.331% 99.837% ( 10, 15 ] 38 0.077% 99.915% ( 15, 22 ] 5 0.010% 99.925% ( 22, 34 ] 2 0.004% 99.929% ( 110, 170 ] 3 0.006% 99.935% ( 170, 250 ] 1 0.002% 99.937% ( 250, 380 ] 4 0.008% 99.945% ( 380, 580 ] 11 0.022% 99.967% ( 580, 870 ] 1 0.002% 99.970% ( 870, 1300 ] 6 0.012% 99.982% ( 1300, 1900 ] 5 0.010% 99.992% ( 1900, 2900 ] 2 0.004% 99.996% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31661 Average: 2.4451 StdDev: 4.28 Min: 0 Median: 1.6531 Max: 650 Percentiles: P50: 1.65 P75: 2.14 P99: 6.05 P99.9: 9.96 P99.99: 14.97 ------------------------------------------------------ [ 0, 1 ] 2286 7.220% 7.220% # ( 1, 2 ] 20738 65.500% 72.720% ############# ( 2, 3 ] 5078 16.039% 88.759% ### ( 3, 4 ] 1707 5.391% 94.151% # ( 4, 6 ] 1532 4.839% 98.989% # ( 6, 10 ] 291 0.919% 99.908% ( 10, 15 ] 26 0.082% 99.991% ( 22, 34 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28506 Average: 7.8890 StdDev: 166.16 Min: 1 Median: 1.9714 Max: 9196 Percentiles: P50: 1.97 P75: 2.65 P99: 8.59 P99.9: 940.81 P99.99: 8332.17 ------------------------------------------------------ [ 0, 1 ] 763 2.677% 2.677% # ( 1, 2 ] 13887 48.716% 51.393% ########## ( 2, 3 ] 10315 36.185% 87.578% ####### ( 3, 4 ] 1457 5.111% 92.689% # ( 4, 6 ] 1535 5.385% 98.074% # ( 6, 10 ] 407 1.428% 99.502% ( 10, 15 ] 85 0.298% 99.800% ( 15, 22 ] 4 0.014% 99.814% ( 22, 34 ] 1 0.004% 99.818% ( 51, 76 ] 1 0.004% 99.821% ( 76, 110 ] 1 0.004% 99.825% ( 110, 170 ] 1 0.004% 99.828% ( 250, 380 ] 5 0.018% 99.846% ( 380, 580 ] 7 0.025% 99.870% ( 580, 870 ] 8 0.028% 99.898% ( 870, 1300 ] 3 0.011% 99.909% ( 1300, 1900 ] 1 0.004% 99.912% ( 1900, 2900 ] 3 0.011% 99.923% ( 2900, 4400 ] 4 0.014% 99.937% ( 4400, 6600 ] 12 0.042% 99.979% ( 6600, 9900 ] 6 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.4613 StdDev: 1198.59 Min: 1 Median: 2.1129 Max: 8020 Percentiles: P50: 2.11 P75: 3.90 P99: 6297.50 P99.9: 8020.00 P99.99: 8020.00 ------------------------------------------------------ [ 0, 1 ] 48 15.484% 15.484% ### ( 1, 2 ] 100 32.258% 47.742% ###### ( 2, 3 ] 62 20.000% 67.742% #### ( 3, 4 ] 25 8.065% 75.806% ## ( 4, 6 ] 19 6.129% 81.935% # ( 6, 10 ] 16 5.161% 87.097% # ( 10, 15 ] 9 2.903% 90.000% # ( 51, 76 ] 2 0.645% 90.645% ( 110, 170 ] 2 0.645% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 1 0.323% 92.903% ( 1300, 1900 ] 1 0.323% 93.226% ( 1900, 2900 ] 2 0.645% 93.871% ( 2900, 4400 ] 9 2.903% 96.774% # ( 4400, 6600 ] 8 2.581% 99.355% # ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 939.8333 StdDev: 1180.41 Min: 91 Median: 361.4286 Max: 5675 Percentiles: P50: 361.43 P75: 1420.00 P99: 5280.00 P99.9: 5675.00 P99.99: 5675.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 14 23.333% 31.667% ##### ( 170, 250 ] 5 8.333% 40.000% ## ( 250, 380 ] 7 11.667% 51.667% ## ( 380, 580 ] 5 8.333% 60.000% ## ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.350 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/08-08:39:33 ... thread 0: (1000000,5000000) ops and (334486.6,334439.3) ops/second in (2.989656,14.950396) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 3.07 GB 6.3 3.6 0.0 3.6 8.2 4.7 0.0 1.8 133.7 308.8 27.32 25.56 80 0.342 3709K 3937 0.0 0.0 L1 9/9 1.04 GB 0.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 236.8 236.0 7.20 7.01 3 2.399 1730K 5476 0.0 0.0 L2 2/0 50.61 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 13/0 636.45 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.5 1.0 211.8 211.9 0.59 0.53 1 0.589 126K 0 0.0 0.0 L4 169/0 9.52 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 109.5 109.5 1.02 0.67 1 1.022 113K 0 0.0 0.0 L5 1040/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/22 100.80 GB 0.0 5.6 1.8 3.8 10.3 6.4 3.0 2.2 156.0 286.4 36.66 34.27 86 0.426 5808K 9456 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 1.8 3.8 10.3 6.4 2.9 2.2 156.0 286.4 36.66 34.27 86 0.426 5808K 9456 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 1.8 3.8 5.6 1.8 0.0 0.0 246.7 246.3 23.19 22.30 19 1.220 5808K 9456 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.4 13.47 11.98 67 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 15.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.25 GB write, 693.15 MB/s write, 5.59 GB read, 377.70 MB/s read, 36.7 seconds Interval compaction: 10.25 GB write, 702.17 MB/s write, 5.59 GB read, 382.62 MB/s read, 36.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1345644 Average: 2.1639 StdDev: 12.53 Min: 0 Median: 1.4735 Max: 4403 Percentiles: P50: 1.47 P75: 1.85 P99: 5.38 P99.9: 9.78 P99.99: 15.86 ------------------------------------------------------ [ 0, 1 ] 255015 18.951% 18.951% #### ( 1, 2 ] 882347 65.571% 84.522% ############# ( 2, 3 ] 142023 10.554% 95.076% ## ( 3, 4 ] 36098 2.683% 97.759% # ( 4, 6 ] 24185 1.797% 99.556% ( 6, 10 ] 4896 0.364% 99.920% ( 10, 15 ] 930 0.069% 99.989% ( 15, 22 ] 126 0.009% 99.998% ( 22, 34 ] 17 0.001% 99.999% ( 34, 51 ] 13 0.001% 100.000% ( 51, 76 ] 17 0.001% 100.002% ( 76, 110 ] 21 0.002% 100.003% ( 110, 170 ] 92 0.007% 100.010% ( 170, 250 ] 49 0.004% 100.014% ( 250, 380 ] 23 0.002% 100.015% ( 380, 580 ] 38 0.003% 100.018% ( 580, 870 ] 26 0.002% 100.020% ( 870, 1300 ] 15 0.001% 100.021% ( 1300, 1900 ] 9 0.001% 100.022% ( 1900, 2900 ] 7 0.001% 100.023% ( 2900, 4400 ] 8 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 50250 Average: 3.0983 StdDev: 53.44 Min: 1 Median: 1.4924 Max: 8538 Percentiles: P50: 1.49 P75: 1.89 P99: 5.71 P99.9: 150.86 P99.99: 1777.00 ------------------------------------------------------ [ 0, 1 ] 9454 18.814% 18.814% #### ( 1, 2 ] 31825 63.333% 82.147% ############# ( 2, 3 ] 5768 11.479% 93.626% ## ( 3, 4 ] 1680 3.343% 96.969% # ( 4, 6 ] 1191 2.370% 99.339% ( 6, 10 ] 177 0.352% 99.692% ( 10, 15 ] 47 0.094% 99.785% ( 15, 22 ] 7 0.014% 99.799% ( 22, 34 ] 2 0.004% 99.803% ( 76, 110 ] 29 0.058% 99.861% ( 110, 170 ] 29 0.058% 99.918% ( 170, 250 ] 4 0.008% 99.926% ( 250, 380 ] 6 0.012% 99.938% ( 380, 580 ] 14 0.028% 99.966% ( 580, 870 ] 1 0.002% 99.968% ( 870, 1300 ] 7 0.014% 99.982% ( 1300, 1900 ] 5 0.010% 99.992% ( 1900, 2900 ] 2 0.004% 99.996% ( 4400, 6600 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 31661 Average: 2.4451 StdDev: 4.28 Min: 0 Median: 1.6531 Max: 650 Percentiles: P50: 1.65 P75: 2.14 P99: 6.05 P99.9: 9.96 P99.99: 14.97 ------------------------------------------------------ [ 0, 1 ] 2286 7.220% 7.220% # ( 1, 2 ] 20738 65.500% 72.720% ############# ( 2, 3 ] 5078 16.039% 88.759% ### ( 3, 4 ] 1707 5.391% 94.151% # ( 4, 6 ] 1532 4.839% 98.989% # ( 6, 10 ] 291 0.919% 99.908% ( 10, 15 ] 26 0.082% 99.991% ( 22, 34 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28506 Average: 7.8890 StdDev: 166.16 Min: 1 Median: 1.9714 Max: 9196 Percentiles: P50: 1.97 P75: 2.65 P99: 8.59 P99.9: 940.81 P99.99: 8332.17 ------------------------------------------------------ [ 0, 1 ] 763 2.677% 2.677% # ( 1, 2 ] 13887 48.716% 51.393% ########## ( 2, 3 ] 10315 36.185% 87.578% ####### ( 3, 4 ] 1457 5.111% 92.689% # ( 4, 6 ] 1535 5.385% 98.074% # ( 6, 10 ] 407 1.428% 99.502% ( 10, 15 ] 85 0.298% 99.800% ( 15, 22 ] 4 0.014% 99.814% ( 22, 34 ] 1 0.004% 99.818% ( 51, 76 ] 1 0.004% 99.821% ( 76, 110 ] 1 0.004% 99.825% ( 110, 170 ] 1 0.004% 99.828% ( 250, 380 ] 5 0.018% 99.846% ( 380, 580 ] 7 0.025% 99.870% ( 580, 870 ] 8 0.028% 99.898% ( 870, 1300 ] 3 0.011% 99.909% ( 1300, 1900 ] 1 0.004% 99.912% ( 1900, 2900 ] 3 0.011% 99.923% ( 2900, 4400 ] 4 0.014% 99.937% ( 4400, 6600 ] 12 0.042% 99.979% ( 6600, 9900 ] 6 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.4613 StdDev: 1198.59 Min: 1 Median: 2.1129 Max: 8020 Percentiles: P50: 2.11 P75: 3.90 P99: 6297.50 P99.9: 8020.00 P99.99: 8020.00 ------------------------------------------------------ [ 0, 1 ] 48 15.484% 15.484% ### ( 1, 2 ] 100 32.258% 47.742% ###### ( 2, 3 ] 62 20.000% 67.742% #### ( 3, 4 ] 25 8.065% 75.806% ## ( 4, 6 ] 19 6.129% 81.935% # ( 6, 10 ] 16 5.161% 87.097% # ( 10, 15 ] 9 2.903% 90.000% # ( 51, 76 ] 2 0.645% 90.645% ( 110, 170 ] 2 0.645% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 1 0.323% 92.903% ( 1300, 1900 ] 1 0.323% 93.226% ( 1900, 2900 ] 2 0.645% 93.871% ( 2900, 4400 ] 9 2.903% 96.774% # ( 4400, 6600 ] 8 2.581% 99.355% # ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 939.8333 StdDev: 1180.41 Min: 91 Median: 361.4286 Max: 5675 Percentiles: P50: 361.43 P75: 1420.00 P99: 5280.00 P99.9: 5675.00 P99.99: 5675.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 14 23.333% 31.667% ##### ( 170, 250 ] 5 8.333% 40.000% ## ( 250, 380 ] 7 11.667% 51.667% ## ( 380, 580 ] 5 8.333% 60.000% ## ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 15.1 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 324.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.721 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.371 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/08-08:39:39 ... thread 0: (1000000,6000000) ops and (185622.5,295019.0) ops/second in (5.387277,20.337673) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 4.12 GB 113.3 4.6 0.0 4.6 10.3 5.7 0.0 1.8 137.1 307.0 34.46 32.28 100 0.345 4797K 5026 0.0 0.0 L1 9/9 1.04 GB 0.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 236.8 236.0 7.20 7.01 3 2.399 1730K 5476 0.0 0.0 L2 2/0 50.61 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 13/0 636.45 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.5 1.0 211.8 211.9 0.59 0.53 1 0.589 126K 0 0.0 0.0 L4 169/0 9.52 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 109.5 109.5 1.02 0.67 1 1.022 113K 0 0.0 0.0 L5 1040/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/22 101.85 GB 0.0 6.6 1.8 4.9 12.3 7.5 3.0 2.2 155.1 288.6 43.79 40.99 106 0.413 6896K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 1.8 4.9 12.3 7.5 2.9 2.2 155.1 288.6 43.79 40.99 106 0.413 6896K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 1.8 4.9 6.6 1.8 0.0 0.0 249.3 248.9 27.24 26.28 23 1.184 6896K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.0 16.55 14.71 83 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.5 total, 20.3 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.34 GB write, 615.55 MB/s write, 6.63 GB read, 330.77 MB/s read, 43.8 seconds Interval compaction: 12.34 GB write, 621.44 MB/s write, 6.63 GB read, 333.93 MB/s read, 43.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 18, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1849323 Average: 2.1879 StdDev: 12.57 Min: 0 Median: 1.4843 Max: 4403 Percentiles: P50: 1.48 P75: 1.86 P99: 5.42 P99.9: 9.98 P99.99: 20.22 ------------------------------------------------------ [ 0, 1 ] 328554 17.766% 17.766% #### ( 1, 2 ] 1230846 66.557% 84.323% ############# ( 2, 3 ] 199672 10.797% 95.120% ## ( 3, 4 ] 49152 2.658% 97.778% # ( 4, 6 ] 31779 1.718% 99.496% ( 6, 10 ] 7507 0.406% 99.902% ( 10, 15 ] 1509 0.082% 99.984% ( 15, 22 ] 161 0.009% 99.992% ( 22, 34 ] 20 0.001% 99.993% ( 34, 51 ] 14 0.001% 99.994% ( 51, 76 ] 21 0.001% 99.995% ( 76, 110 ] 55 0.003% 99.998% ( 110, 170 ] 163 0.009% 100.007% ( 170, 250 ] 86 0.005% 100.012% ( 250, 380 ] 37 0.002% 100.014% ( 380, 580 ] 53 0.003% 100.017% ( 580, 870 ] 40 0.002% 100.019% ( 870, 1300 ] 26 0.001% 100.020% ( 1300, 1900 ] 12 0.001% 100.021% ( 1900, 2900 ] 7 0.000% 100.021% ( 2900, 4400 ] 12 0.001% 100.022% ( 4400, 6600 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 130230 Average: 2.6644 StdDev: 33.65 Min: 1 Median: 1.5072 Max: 8538 Percentiles: P50: 1.51 P75: 1.89 P99: 7.37 P99.9: 110.62 P99.99: 1052.87 ------------------------------------------------------ [ 0, 1 ] 21475 16.490% 16.490% ### ( 1, 2 ] 86035 66.064% 82.554% ############# ( 2, 3 ] 14802 11.366% 93.920% ## ( 3, 4 ] 3553 2.728% 96.648% # ( 4, 6 ] 2596 1.993% 98.642% ( 6, 10 ] 1365 1.048% 99.690% ( 10, 15 ] 157 0.121% 99.810% ( 15, 22 ] 18 0.014% 99.824% ( 22, 34 ] 2 0.002% 99.826% ( 76, 110 ] 96 0.074% 99.899% ( 110, 170 ] 74 0.057% 99.956% ( 170, 250 ] 9 0.007% 99.963% ( 250, 380 ] 12 0.009% 99.972% ( 380, 580 ] 17 0.013% 99.985% ( 580, 870 ] 3 0.002% 99.988% ( 870, 1300 ] 7 0.005% 99.993% ( 1300, 1900 ] 5 0.004% 99.997% ( 1900, 2900 ] 2 0.002% 99.998% ( 4400, 6600 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31661 Average: 2.4451 StdDev: 4.28 Min: 0 Median: 1.6531 Max: 650 Percentiles: P50: 1.65 P75: 2.14 P99: 6.05 P99.9: 9.96 P99.99: 14.97 ------------------------------------------------------ [ 0, 1 ] 2286 7.220% 7.220% # ( 1, 2 ] 20738 65.500% 72.720% ############# ( 2, 3 ] 5078 16.039% 88.759% ### ( 3, 4 ] 1707 5.391% 94.151% # ( 4, 6 ] 1532 4.839% 98.989% # ( 6, 10 ] 291 0.919% 99.908% ( 10, 15 ] 26 0.082% 99.991% ( 22, 34 ] 1 0.003% 99.994% ( 250, 380 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28506 Average: 7.8890 StdDev: 166.16 Min: 1 Median: 1.9714 Max: 9196 Percentiles: P50: 1.97 P75: 2.65 P99: 8.59 P99.9: 940.81 P99.99: 8332.17 ------------------------------------------------------ [ 0, 1 ] 763 2.677% 2.677% # ( 1, 2 ] 13887 48.716% 51.393% ########## ( 2, 3 ] 10315 36.185% 87.578% ####### ( 3, 4 ] 1457 5.111% 92.689% # ( 4, 6 ] 1535 5.385% 98.074% # ( 6, 10 ] 407 1.428% 99.502% ( 10, 15 ] 85 0.298% 99.800% ( 15, 22 ] 4 0.014% 99.814% ( 22, 34 ] 1 0.004% 99.818% ( 51, 76 ] 1 0.004% 99.821% ( 76, 110 ] 1 0.004% 99.825% ( 110, 170 ] 1 0.004% 99.828% ( 250, 380 ] 5 0.018% 99.846% ( 380, 580 ] 7 0.025% 99.870% ( 580, 870 ] 8 0.028% 99.898% ( 870, 1300 ] 3 0.011% 99.909% ( 1300, 1900 ] 1 0.004% 99.912% ( 1900, 2900 ] 3 0.011% 99.923% ( 2900, 4400 ] 4 0.014% 99.937% ( 4400, 6600 ] 12 0.042% 99.979% ( 6600, 9900 ] 6 0.021% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 326.4613 StdDev: 1198.59 Min: 1 Median: 2.1129 Max: 8020 Percentiles: P50: 2.11 P75: 3.90 P99: 6297.50 P99.9: 8020.00 P99.99: 8020.00 ------------------------------------------------------ [ 0, 1 ] 48 15.484% 15.484% ### ( 1, 2 ] 100 32.258% 47.742% ###### ( 2, 3 ] 62 20.000% 67.742% #### ( 3, 4 ] 25 8.065% 75.806% ## ( 4, 6 ] 19 6.129% 81.935% # ( 6, 10 ] 16 5.161% 87.097% # ( 10, 15 ] 9 2.903% 90.000% # ( 51, 76 ] 2 0.645% 90.645% ( 110, 170 ] 2 0.645% 91.290% ( 170, 250 ] 2 0.645% 91.935% ( 380, 580 ] 1 0.323% 92.258% ( 580, 870 ] 1 0.323% 92.581% ( 870, 1300 ] 1 0.323% 92.903% ( 1300, 1900 ] 1 0.323% 93.226% ( 1900, 2900 ] 2 0.645% 93.871% ( 2900, 4400 ] 9 2.903% 96.774% # ( 4400, 6600 ] 8 2.581% 99.355% # ( 6600, 9900 ] 2 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 939.8333 StdDev: 1180.41 Min: 91 Median: 361.4286 Max: 5675 Percentiles: P50: 361.43 P75: 1420.00 P99: 5280.00 P99.9: 5675.00 P99.99: 5675.00 ------------------------------------------------------ ( 76, 110 ] 5 8.333% 8.333% ## ( 110, 170 ] 14 23.333% 31.667% ##### ( 170, 250 ] 5 8.333% 40.000% ## ( 250, 380 ] 7 11.667% 51.667% ## ( 380, 580 ] 5 8.333% 60.000% ## ( 580, 870 ] 5 8.333% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 20.5 total, 5.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 287.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.303 H:M:S, 21.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 182.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.582 H:M:S, 47.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/08-08:39:57 ... thread 0: (1000000,7000000) ops and (54622.9,181135.9) ops/second in (18.307351,38.645024) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 2.02 GB 37.8 6.7 0.0 6.7 13.3 6.6 0.0 2.0 149.2 296.8 46.01 42.77 118 0.390 6970K 13K 0.0 0.0 L1 14/13 1.46 GB 0.0 5.7 4.5 1.2 5.6 4.4 0.1 1.3 222.5 219.3 26.33 24.87 4 6.581 5948K 83K 0.0 0.0 L2 14/11 1.76 GB 3.9 0.1 0.1 0.1 0.1 0.1 3.1 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 22/2 1.11 GB 0.9 1.4 0.9 0.5 1.4 0.9 0.5 1.6 185.3 184.8 8.00 6.70 6 1.333 1504K 3944 0.0 0.0 L4 169/0 9.53 GB 1.0 0.3 0.3 0.0 0.3 0.3 0.8 1.0 152.0 151.9 2.18 1.71 4 0.544 334K 167 0.0 0.0 L5 1044/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/30 102.68 GB 0.0 14.3 5.8 8.5 20.9 12.3 5.9 3.1 176.6 257.3 83.03 76.54 133 0.624 14M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.3 5.8 8.5 20.9 12.3 5.8 3.1 176.6 257.3 83.03 76.54 133 0.624 14M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.3 5.8 8.5 14.2 5.7 0.0 0.0 231.9 230.3 63.23 59.33 36 1.756 14M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 343.5 19.81 17.22 97 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.8 total, 38.6 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.86 GB write, 550.02 MB/s write, 14.32 GB read, 377.46 MB/s read, 83.0 seconds Interval compaction: 20.86 GB write, 552.79 MB/s write, 14.32 GB read, 379.36 MB/s read, 83.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 18, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 21, interval: 50 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3176383 Average: 2.6162 StdDev: 16.08 Min: 0 Median: 1.5161 Max: 4403 Percentiles: P50: 1.52 P75: 1.90 P99: 6.42 P99.9: 135.18 P99.99: 296.22 ------------------------------------------------------ [ 0, 1 ] 517606 16.295% 16.295% ### ( 1, 2 ] 2074250 65.302% 81.598% ############# ( 2, 3 ] 376689 11.859% 93.457% ## ( 3, 4 ] 97088 3.057% 96.513% # ( 4, 6 ] 76498 2.408% 98.922% ( 6, 10 ] 23690 0.746% 99.667% ( 10, 15 ] 3269 0.103% 99.770% ( 15, 22 ] 495 0.016% 99.786% ( 22, 34 ] 36 0.001% 99.787% ( 34, 51 ] 17 0.001% 99.788% ( 51, 76 ] 24 0.001% 99.788% ( 76, 110 ] 2129 0.067% 99.855% ( 110, 170 ] 3376 0.106% 99.962% ( 170, 250 ] 739 0.023% 99.985% ( 250, 380 ] 451 0.014% 99.999% ( 380, 580 ] 389 0.012% 100.011% ( 580, 870 ] 176 0.006% 100.017% ( 870, 1300 ] 65 0.002% 100.019% ( 1300, 1900 ] 32 0.001% 100.020% ( 1900, 2900 ] 20 0.001% 100.021% ( 2900, 4400 ] 17 0.001% 100.021% ( 4400, 6600 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 927248 Average: 3.4577 StdDev: 26.72 Min: 1 Median: 1.7400 Max: 8538 Percentiles: P50: 1.74 P75: 2.49 P99: 8.93 P99.9: 128.83 P99.99: 242.11 ------------------------------------------------------ [ 0, 1 ] 69811 7.529% 7.529% ## ( 1, 2 ] 532184 57.394% 64.923% ########### ( 2, 3 ] 188947 20.377% 85.300% #### ( 3, 4 ] 58712 6.332% 91.632% # ( 4, 6 ] 55533 5.989% 97.621% # ( 6, 10 ] 17483 1.885% 99.506% ( 10, 15 ] 2441 0.263% 99.770% ( 15, 22 ] 364 0.039% 99.809% ( 22, 34 ] 15 0.002% 99.810% ( 34, 51 ] 3 0.000% 99.811% ( 51, 76 ] 9 0.001% 99.812% ( 76, 110 ] 579 0.062% 99.874% ( 110, 170 ] 767 0.083% 99.957% ( 170, 250 ] 342 0.037% 99.994% ( 250, 380 ] 336 0.036% 100.030% ( 380, 580 ] 263 0.028% 100.058% ( 580, 870 ] 189 0.020% 100.079% ( 870, 1300 ] 90 0.010% 100.088% ( 1300, 1900 ] 35 0.004% 100.092% ( 1900, 2900 ] 21 0.002% 100.094% ( 2900, 4400 ] 4 0.000% 100.095% ( 4400, 6600 ] 1 0.000% 100.095% ( 6600, 9900 ] 1 0.000% 100.095% ** Level 2 read latency histogram (micros): Count: 31984 Average: 3.2122 StdDev: 19.33 Min: 0 Median: 1.6591 Max: 961 Percentiles: P50: 1.66 P75: 2.17 P99: 7.00 P99.9: 342.96 P99.99: 799.16 ------------------------------------------------------ [ 0, 1 ] 2286 7.147% 7.147% # ( 1, 2 ] 20794 65.014% 72.161% ############# ( 2, 3 ] 5217 16.311% 88.472% ### ( 3, 4 ] 1729 5.406% 93.878% # ( 4, 6 ] 1564 4.890% 98.768% # ( 6, 10 ] 298 0.932% 99.700% ( 10, 15 ] 29 0.091% 99.791% ( 22, 34 ] 1 0.003% 99.794% ( 110, 170 ] 2 0.006% 99.800% ( 170, 250 ] 17 0.053% 99.853% ( 250, 380 ] 21 0.066% 99.919% ( 380, 580 ] 16 0.050% 99.969% ( 580, 870 ] 9 0.028% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 134258 Average: 7.3817 StdDev: 98.77 Min: 1 Median: 2.0360 Max: 9196 Percentiles: P50: 2.04 P75: 2.86 P99: 9.90 P99.9: 863.20 P99.99: 2142.36 ------------------------------------------------------ [ 0, 1 ] 1561 1.163% 1.163% ( 1, 2 ] 64108 47.750% 48.913% ########## ( 2, 3 ] 40605 30.244% 79.157% ###### ( 3, 4 ] 11880 8.849% 88.005% ## ( 4, 6 ] 12038 8.966% 96.972% ## ( 6, 10 ] 2790 2.078% 99.050% ( 10, 15 ] 466 0.347% 99.397% ( 15, 22 ] 62 0.046% 99.443% ( 22, 34 ] 7 0.005% 99.448% ( 34, 51 ] 2 0.001% 99.450% ( 51, 76 ] 1 0.001% 99.450% ( 76, 110 ] 7 0.005% 99.456% ( 110, 170 ] 60 0.045% 99.500% ( 170, 250 ] 94 0.070% 99.570% ( 250, 380 ] 139 0.104% 99.674% ( 380, 580 ] 168 0.125% 99.799% ( 580, 870 ] 139 0.104% 99.902% ( 870, 1300 ] 79 0.059% 99.961% ( 1300, 1900 ] 33 0.025% 99.986% ( 1900, 2900 ] 23 0.017% 100.003% ( 2900, 4400 ] 13 0.010% 100.013% ( 4400, 6600 ] 13 0.010% 100.022% ( 6600, 9900 ] 6 0.004% 100.027% ** Level 4 read latency histogram (micros): Count: 1796 Average: 95.5668 StdDev: 528.82 Min: 1 Median: 2.0220 Max: 8020 Percentiles: P50: 2.02 P75: 3.59 P99: 3206.00 P99.9: 6936.60 P99.99: 8020.00 ------------------------------------------------------ [ 0, 1 ] 70 3.898% 3.898% # ( 1, 2 ] 820 45.657% 49.555% ######### ( 2, 3 ] 363 20.212% 69.766% #### ( 3, 4 ] 159 8.853% 78.619% ## ( 4, 6 ] 89 4.955% 83.575% # ( 6, 10 ] 51 2.840% 86.414% # ( 10, 15 ] 11 0.612% 87.027% ( 15, 22 ] 1 0.056% 87.082% ( 22, 34 ] 2 0.111% 87.194% ( 51, 76 ] 2 0.111% 87.305% ( 76, 110 ] 5 0.278% 87.584% ( 110, 170 ] 48 2.673% 90.256% # ( 170, 250 ] 53 2.951% 93.207% # ( 250, 380 ] 39 2.171% 95.379% ( 380, 580 ] 33 1.837% 97.216% ( 580, 870 ] 18 1.002% 98.218% ( 870, 1300 ] 7 0.390% 98.608% ( 1300, 1900 ] 3 0.167% 98.775% ( 1900, 2900 ] 2 0.111% 98.886% ( 2900, 4400 ] 10 0.557% 99.443% ( 4400, 6600 ] 8 0.445% 99.889% ( 6600, 9900 ] 2 0.111% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 931.3625 StdDev: 1143.76 Min: 91 Median: 331.2500 Max: 5675 Percentiles: P50: 331.25 P75: 1471.43 P99: 4840.00 P99.9: 5675.00 P99.99: 5675.00 ------------------------------------------------------ ( 76, 110 ] 6 7.500% 7.500% ## ( 110, 170 ] 20 25.000% 32.500% ##### ( 170, 250 ] 9 11.250% 43.750% ## ( 250, 380 ] 8 10.000% 53.750% ## ( 380, 580 ] 5 6.250% 60.000% # ( 580, 870 ] 6 7.500% 67.500% ## ( 870, 1300 ] 4 5.000% 72.500% # ( 1300, 1900 ] 7 8.750% 81.250% ## ( 1900, 2900 ] 9 11.250% 92.500% ## ( 2900, 4400 ] 5 6.250% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 38.8 total, 18.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 177.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.161 H:M:S, 49.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 53.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:14.858 H:M:S, 81.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/08-08:40:02 ... thread 0: (1000000,8000000) ops and (205448.7,183855.6) ops/second in (4.867396,43.512420) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 2.94 GB 100.7 7.3 0.0 7.3 14.8 7.6 0.0 2.0 141.0 287.7 52.72 47.61 132 0.399 7546K 13K 0.0 0.0 L1 14/13 1.46 GB 0.0 5.7 4.5 1.2 5.6 4.4 0.1 1.3 222.5 219.3 26.33 24.87 4 6.581 5948K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.1 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 19/0 961.73 MB 1.0 3.6 2.7 0.9 3.6 2.7 0.5 1.3 181.2 180.6 20.51 16.76 11 1.865 3775K 12K 0.0 0.0 L4 173/0 9.42 GB 1.0 2.3 2.2 0.1 2.3 2.2 0.8 1.0 122.4 122.3 19.22 11.36 32 0.600 2363K 1664 0.0 0.0 L5 1068/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/21 103.59 GB 0.0 19.0 9.5 9.6 26.5 16.9 7.9 3.5 163.3 227.3 119.30 101.10 180 0.663 19M 110K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.0 9.5 9.6 26.5 16.9 7.8 3.5 163.3 227.3 119.30 101.10 180 0.663 19M 110K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.0 9.5 9.6 18.9 9.4 0.0 0.0 204.2 203.0 95.41 81.30 71 1.344 19M 110K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 324.3 23.89 19.80 109 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.7 total, 43.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.48 GB write, 620.49 MB/s write, 19.03 GB read, 445.78 MB/s read, 119.3 seconds Interval compaction: 26.48 GB write, 623.26 MB/s write, 19.03 GB read, 447.78 MB/s read, 119.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 41, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3421491 Average: 2.7297 StdDev: 22.06 Min: 0 Median: 1.5360 Max: 7376 Percentiles: P50: 1.54 P75: 1.92 P99: 6.81 P99.9: 135.47 P99.99: 353.85 ------------------------------------------------------ [ 0, 1 ] 529001 15.461% 15.461% ### ( 1, 2 ] 2204927 64.443% 79.905% ############# ( 2, 3 ] 436703 12.764% 92.668% ### ( 3, 4 ] 114224 3.338% 96.007% # ( 4, 6 ] 96664 2.825% 98.832% # ( 6, 10 ] 28425 0.831% 99.663% ( 10, 15 ] 3909 0.114% 99.777% ( 15, 22 ] 568 0.017% 99.793% ( 22, 34 ] 39 0.001% 99.795% ( 34, 51 ] 19 0.001% 99.795% ( 51, 76 ] 26 0.001% 99.796% ( 76, 110 ] 2131 0.062% 99.858% ( 110, 170 ] 3381 0.099% 99.957% ( 170, 250 ] 756 0.022% 99.979% ( 250, 380 ] 473 0.014% 99.993% ( 380, 580 ] 436 0.013% 100.006% ( 580, 870 ] 242 0.007% 100.013% ( 870, 1300 ] 127 0.004% 100.016% ( 1300, 1900 ] 48 0.001% 100.018% ( 1900, 2900 ] 47 0.001% 100.019% ( 2900, 4400 ] 38 0.001% 100.020% ( 4400, 6600 ] 8 0.000% 100.020% ( 6600, 9900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1245248 Average: 4.2621 StdDev: 56.84 Min: 1 Median: 1.7914 Max: 9378 Percentiles: P50: 1.79 P75: 2.61 P99: 9.17 P99.9: 154.03 P99.99: 399.72 ------------------------------------------------------ [ 0, 1 ] 77576 6.230% 6.230% # ( 1, 2 ] 688732 55.309% 61.539% ########### ( 2, 3 ] 273948 21.999% 83.538% #### ( 3, 4 ] 85881 6.897% 90.435% # ( 4, 6 ] 85896 6.898% 97.333% # ( 6, 10 ] 26209 2.105% 99.437% ( 10, 15 ] 3896 0.313% 99.750% ( 15, 22 ] 525 0.042% 99.792% ( 22, 34 ] 23 0.002% 99.794% ( 34, 51 ] 6 0.000% 99.795% ( 51, 76 ] 13 0.001% 99.796% ( 76, 110 ] 649 0.052% 99.848% ( 110, 170 ] 884 0.071% 99.919% ( 170, 250 ] 420 0.034% 99.953% ( 250, 380 ] 429 0.034% 99.987% ( 380, 580 ] 370 0.030% 100.017% ( 580, 870 ] 316 0.025% 100.042% ( 870, 1300 ] 171 0.014% 100.056% ( 1300, 1900 ] 104 0.008% 100.064% ( 1900, 2900 ] 104 0.008% 100.073% ( 2900, 4400 ] 105 0.008% 100.081% ( 4400, 6600 ] 28 0.002% 100.083% ( 6600, 9900 ] 9 0.001% 100.084% ** Level 2 read latency histogram (micros): Count: 31984 Average: 3.2122 StdDev: 19.33 Min: 0 Median: 1.6591 Max: 961 Percentiles: P50: 1.66 P75: 2.17 P99: 7.00 P99.9: 342.96 P99.99: 799.16 ------------------------------------------------------ [ 0, 1 ] 2286 7.147% 7.147% # ( 1, 2 ] 20794 65.014% 72.161% ############# ( 2, 3 ] 5217 16.311% 88.472% ### ( 3, 4 ] 1729 5.406% 93.878% # ( 4, 6 ] 1564 4.890% 98.768% # ( 6, 10 ] 298 0.932% 99.700% ( 10, 15 ] 29 0.091% 99.791% ( 22, 34 ] 1 0.003% 99.794% ( 110, 170 ] 2 0.006% 99.800% ( 170, 250 ] 17 0.053% 99.853% ( 250, 380 ] 21 0.066% 99.919% ( 380, 580 ] 16 0.050% 99.969% ( 580, 870 ] 9 0.028% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 697556 Average: 7.6092 StdDev: 104.93 Min: 1 Median: 2.2279 Max: 9196 Percentiles: P50: 2.23 P75: 3.12 P99: 9.56 P99.9: 274.14 P99.99: 568.24 ------------------------------------------------------ [ 0, 1 ] 3673 0.527% 0.527% ( 1, 2 ] 296256 42.471% 42.997% ######## ( 2, 3 ] 214360 30.730% 73.727% ###### ( 3, 4 ] 75062 10.761% 84.488% ## ( 4, 6 ] 85475 12.253% 96.741% ## ( 6, 10 ] 17677 2.534% 99.276% # ( 10, 15 ] 3470 0.497% 99.773% ( 15, 22 ] 437 0.063% 99.836% ( 22, 34 ] 22 0.003% 99.839% ( 34, 51 ] 11 0.002% 99.840% ( 51, 76 ] 15 0.002% 99.843% ( 76, 110 ] 15 0.002% 99.845% ( 110, 170 ] 120 0.017% 99.862% ( 170, 250 ] 209 0.030% 99.892% ( 250, 380 ] 304 0.044% 99.935% ( 380, 580 ] 404 0.058% 99.993% ( 580, 870 ] 473 0.068% 100.061% ( 870, 1300 ] 360 0.052% 100.113% ( 1300, 1900 ] 229 0.033% 100.146% ( 1900, 2900 ] 241 0.035% 100.180% ( 2900, 4400 ] 221 0.032% 100.212% ( 4400, 6600 ] 54 0.008% 100.220% ( 6600, 9900 ] 14 0.002% 100.222% ** Level 4 read latency histogram (micros): Count: 16037 Average: 159.2775 StdDev: 584.01 Min: 1 Median: 2.4043 Max: 9191 Percentiles: P50: 2.40 P75: 3.89 P99: 3411.51 P99.9: 6086.48 P99.99: 9017.96 ------------------------------------------------------ [ 0, 1 ] 224 1.397% 1.397% ( 1, 2 ] 6079 37.906% 39.303% ######## ( 2, 3 ] 4243 26.458% 65.760% ##### ( 3, 4 ] 1668 10.401% 76.161% ## ( 4, 6 ] 1258 7.844% 84.006% ## ( 6, 10 ] 379 2.363% 86.369% ( 10, 15 ] 63 0.393% 86.762% ( 15, 22 ] 25 0.156% 86.918% ( 22, 34 ] 6 0.037% 86.955% ( 34, 51 ] 7 0.044% 86.999% ( 51, 76 ] 4 0.025% 87.024% ( 76, 110 ] 12 0.075% 87.099% ( 110, 170 ] 111 0.692% 87.791% ( 170, 250 ] 168 1.048% 88.838% ( 250, 380 ] 180 1.122% 89.961% ( 380, 580 ] 284 1.771% 91.732% ( 580, 870 ] 389 2.426% 94.157% ( 870, 1300 ] 297 1.852% 96.009% ( 1300, 1900 ] 239 1.490% 97.500% ( 1900, 2900 ] 183 1.141% 98.641% ( 2900, 4400 ] 169 1.054% 99.694% ( 4400, 6600 ] 43 0.268% 99.963% ( 6600, 9900 ] 6 0.037% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1433.0350 StdDev: 1503.69 Min: 80 Median: 818.8235 Max: 8278 Percentiles: P50: 818.82 P75: 2328.57 P99: 6355.56 P99.9: 8278.00 P99.99: 8278.00 ------------------------------------------------------ ( 76, 110 ] 11 5.500% 5.500% # ( 110, 170 ] 28 14.000% 19.500% ### ( 170, 250 ] 15 7.500% 27.000% ## ( 250, 380 ] 19 9.500% 36.500% ## ( 380, 580 ] 13 6.500% 43.000% # ( 580, 870 ] 17 8.500% 51.500% ## ( 870, 1300 ] 17 8.500% 60.000% ## ( 1300, 1900 ] 21 10.500% 70.500% ## ( 1900, 2900 ] 21 10.500% 81.000% ## ( 2900, 4400 ] 28 14.000% 95.000% ### ( 4400, 6600 ] 9 4.500% 99.500% # ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 43.7 total, 4.9 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 180.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.168 H:M:S, 48.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 202.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.007 H:M:S, 41.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/08-08:40:05 ... thread 0: (1000000,9000000) ops and (321394.7,193034.2) ops/second in (3.111439,46.623859) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/8 3.93 GB 201.4 8.1 0.0 8.1 16.7 8.5 0.0 1.9 140.8 288.9 59.05 53.52 149 0.396 8441K 14K 0.0 0.0 L1 14/13 1.46 GB 0.0 5.7 4.5 1.2 5.6 4.4 0.1 1.3 222.5 219.3 26.33 24.87 4 6.581 5948K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.1 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 19/0 961.73 MB 1.0 3.6 2.7 0.9 3.6 2.7 0.5 1.3 181.2 180.6 20.51 16.76 11 1.865 3775K 12K 0.0 0.0 L4 173/0 9.42 GB 1.0 2.3 2.2 0.1 2.3 2.2 0.8 1.0 122.4 122.3 19.22 11.36 32 0.600 2363K 1664 0.0 0.0 L5 1068/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1291/21 104.58 GB 0.0 19.9 9.5 10.4 28.3 17.9 7.9 3.3 162.1 230.9 125.63 107.01 197 0.638 20M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.9 9.5 10.4 28.3 17.9 7.8 3.3 162.1 230.9 125.63 107.01 197 0.638 20M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.9 9.5 10.4 19.8 9.4 0.0 0.0 206.1 205.0 98.82 84.61 74 1.335 20M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 326.6 26.81 22.40 123 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.8 total, 46.6 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.33 GB write, 619.60 MB/s write, 19.89 GB read, 435.00 MB/s read, 125.6 seconds Interval compaction: 28.33 GB write, 622.18 MB/s write, 19.89 GB read, 436.81 MB/s read, 125.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 45, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3714626 Average: 2.7079 StdDev: 21.46 Min: 0 Median: 1.5414 Max: 7376 Percentiles: P50: 1.54 P75: 1.93 P99: 6.66 P99.9: 131.17 P99.99: 337.52 ------------------------------------------------------ [ 0, 1 ] 558312 15.030% 15.030% ### ( 1, 2 ] 2399465 64.595% 79.625% ############# ( 2, 3 ] 485768 13.077% 92.702% ### ( 3, 4 ] 124288 3.346% 96.048% # ( 4, 6 ] 104713 2.819% 98.867% # ( 6, 10 ] 30107 0.810% 99.678% ( 10, 15 ] 4209 0.113% 99.791% ( 15, 22 ] 589 0.016% 99.807% ( 22, 34 ] 41 0.001% 99.808% ( 34, 51 ] 19 0.001% 99.808% ( 51, 76 ] 29 0.001% 99.809% ( 76, 110 ] 2157 0.058% 99.867% ( 110, 170 ] 3445 0.093% 99.960% ( 170, 250 ] 785 0.021% 99.981% ( 250, 380 ] 488 0.013% 99.994% ( 380, 580 ] 456 0.012% 100.007% ( 580, 870 ] 249 0.007% 100.013% ( 870, 1300 ] 131 0.004% 100.017% ( 1300, 1900 ] 53 0.001% 100.018% ( 1900, 2900 ] 49 0.001% 100.020% ( 2900, 4400 ] 39 0.001% 100.021% ( 4400, 6600 ] 8 0.000% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1366000 Average: 4.1315 StdDev: 54.36 Min: 1 Median: 1.7770 Max: 9378 Percentiles: P50: 1.78 P75: 2.57 P99: 9.11 P99.9: 153.21 P99.99: 402.26 ------------------------------------------------------ [ 0, 1 ] 85488 6.258% 6.258% # ( 1, 2 ] 768980 56.294% 62.553% ########### ( 2, 3 ] 296482 21.704% 84.257% #### ( 3, 4 ] 89723 6.568% 90.825% # ( 4, 6 ] 89611 6.560% 97.385% # ( 6, 10 ] 28359 2.076% 99.461% ( 10, 15 ] 3980 0.291% 99.753% ( 15, 22 ] 532 0.039% 99.792% ( 22, 34 ] 25 0.002% 99.794% ( 34, 51 ] 6 0.000% 99.794% ( 51, 76 ] 13 0.001% 99.795% ( 76, 110 ] 723 0.053% 99.848% ( 110, 170 ] 990 0.072% 99.920% ( 170, 250 ] 460 0.034% 99.954% ( 250, 380 ] 450 0.033% 99.987% ( 380, 580 ] 381 0.028% 100.015% ( 580, 870 ] 322 0.024% 100.038% ( 870, 1300 ] 172 0.013% 100.051% ( 1300, 1900 ] 104 0.008% 100.059% ( 1900, 2900 ] 104 0.008% 100.066% ( 2900, 4400 ] 105 0.008% 100.074% ( 4400, 6600 ] 28 0.002% 100.076% ( 6600, 9900 ] 9 0.001% 100.077% ** Level 2 read latency histogram (micros): Count: 31984 Average: 3.2122 StdDev: 19.33 Min: 0 Median: 1.6591 Max: 961 Percentiles: P50: 1.66 P75: 2.17 P99: 7.00 P99.9: 342.96 P99.99: 799.16 ------------------------------------------------------ [ 0, 1 ] 2286 7.147% 7.147% # ( 1, 2 ] 20794 65.014% 72.161% ############# ( 2, 3 ] 5217 16.311% 88.472% ### ( 3, 4 ] 1729 5.406% 93.878% # ( 4, 6 ] 1564 4.890% 98.768% # ( 6, 10 ] 298 0.932% 99.700% ( 10, 15 ] 29 0.091% 99.791% ( 22, 34 ] 1 0.003% 99.794% ( 110, 170 ] 2 0.006% 99.800% ( 170, 250 ] 17 0.053% 99.853% ( 250, 380 ] 21 0.066% 99.919% ( 380, 580 ] 16 0.050% 99.969% ( 580, 870 ] 9 0.028% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 697556 Average: 7.6092 StdDev: 104.93 Min: 1 Median: 2.2279 Max: 9196 Percentiles: P50: 2.23 P75: 3.12 P99: 9.56 P99.9: 274.14 P99.99: 568.24 ------------------------------------------------------ [ 0, 1 ] 3673 0.527% 0.527% ( 1, 2 ] 296256 42.471% 42.997% ######## ( 2, 3 ] 214360 30.730% 73.727% ###### ( 3, 4 ] 75062 10.761% 84.488% ## ( 4, 6 ] 85475 12.253% 96.741% ## ( 6, 10 ] 17677 2.534% 99.276% # ( 10, 15 ] 3470 0.497% 99.773% ( 15, 22 ] 437 0.063% 99.836% ( 22, 34 ] 22 0.003% 99.839% ( 34, 51 ] 11 0.002% 99.840% ( 51, 76 ] 15 0.002% 99.843% ( 76, 110 ] 15 0.002% 99.845% ( 110, 170 ] 120 0.017% 99.862% ( 170, 250 ] 209 0.030% 99.892% ( 250, 380 ] 304 0.044% 99.935% ( 380, 580 ] 404 0.058% 99.993% ( 580, 870 ] 473 0.068% 100.061% ( 870, 1300 ] 360 0.052% 100.113% ( 1300, 1900 ] 229 0.033% 100.146% ( 1900, 2900 ] 241 0.035% 100.180% ( 2900, 4400 ] 221 0.032% 100.212% ( 4400, 6600 ] 54 0.008% 100.220% ( 6600, 9900 ] 14 0.002% 100.222% ** Level 4 read latency histogram (micros): Count: 16037 Average: 159.2775 StdDev: 584.01 Min: 1 Median: 2.4043 Max: 9191 Percentiles: P50: 2.40 P75: 3.89 P99: 3411.51 P99.9: 6086.48 P99.99: 9017.96 ------------------------------------------------------ [ 0, 1 ] 224 1.397% 1.397% ( 1, 2 ] 6079 37.906% 39.303% ######## ( 2, 3 ] 4243 26.458% 65.760% ##### ( 3, 4 ] 1668 10.401% 76.161% ## ( 4, 6 ] 1258 7.844% 84.006% ## ( 6, 10 ] 379 2.363% 86.369% ( 10, 15 ] 63 0.393% 86.762% ( 15, 22 ] 25 0.156% 86.918% ( 22, 34 ] 6 0.037% 86.955% ( 34, 51 ] 7 0.044% 86.999% ( 51, 76 ] 4 0.025% 87.024% ( 76, 110 ] 12 0.075% 87.099% ( 110, 170 ] 111 0.692% 87.791% ( 170, 250 ] 168 1.048% 88.838% ( 250, 380 ] 180 1.122% 89.961% ( 380, 580 ] 284 1.771% 91.732% ( 580, 870 ] 389 2.426% 94.157% ( 870, 1300 ] 297 1.852% 96.009% ( 1300, 1900 ] 239 1.490% 97.500% ( 1900, 2900 ] 183 1.141% 98.641% ( 2900, 4400 ] 169 1.054% 99.694% ( 4400, 6600 ] 43 0.268% 99.963% ( 6600, 9900 ] 6 0.037% 100.000% ** Level 5 read latency histogram (micros): Count: 200 Average: 1433.0350 StdDev: 1503.69 Min: 80 Median: 818.8235 Max: 8278 Percentiles: P50: 818.82 P75: 2328.57 P99: 6355.56 P99.9: 8278.00 P99.99: 8278.00 ------------------------------------------------------ ( 76, 110 ] 11 5.500% 5.500% # ( 110, 170 ] 28 14.000% 19.500% ### ( 170, 250 ] 15 7.500% 27.000% ## ( 250, 380 ] 19 9.500% 36.500% ## ( 380, 580 ] 13 6.500% 43.000% # ( 580, 870 ] 17 8.500% 51.500% ## ( 870, 1300 ] 17 8.500% 60.000% ## ( 1300, 1900 ] 21 10.500% 70.500% ## ( 1900, 2900 ] 21 10.500% 81.000% ## ( 2900, 4400 ] 28 14.000% 95.000% ### ( 4400, 6600 ] 9 4.500% 99.500% # ( 6600, 9900 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 46.8 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 189.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.601 H:M:S, 46.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.433 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/08-08:40:13 ... thread 0: (1000000,10000000) ops and (123683.2,182785.2) ops/second in (8.085171,54.709030) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 3.20 GB 157.3 9.2 0.0 9.2 18.6 9.5 0.0 2.0 141.7 288.0 66.22 59.96 167 0.397 9529K 15K 0.0 0.0 L1 10/0 1.04 GB 106.3 8.8 6.1 2.7 8.7 6.0 0.1 1.4 215.2 212.5 42.04 38.99 5 8.409 7666K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 5.2 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 23/3 1.30 GB 1.0 6.0 4.1 1.9 6.0 4.1 1.1 1.5 174.2 173.5 35.39 28.28 21 1.685 5737K 22K 0.0 0.0 L4 176/9 9.73 GB 1.0 4.4 3.9 0.5 4.4 3.9 0.9 1.1 131.1 130.8 34.11 21.39 53 0.643 4468K 2462 0.0 0.0 L5 1084/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/21 105.45 GB 0.0 28.5 14.2 14.3 37.8 23.5 12.0 4.0 163.8 217.2 178.29 149.12 247 0.722 27M 124K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.5 14.2 14.3 37.8 23.5 11.9 4.0 163.8 217.2 178.29 149.12 247 0.722 27M 124K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.5 14.2 14.3 28.3 14.1 0.0 0.0 196.7 195.6 148.39 124.30 110 1.349 27M 124K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 324.5 29.90 24.82 137 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.9 total, 54.7 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.82 GB write, 705.41 MB/s write, 28.51 GB read, 531.73 MB/s read, 178.3 seconds Interval compaction: 37.82 GB write, 707.92 MB/s write, 28.51 GB read, 533.62 MB/s read, 178.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 48, pending-compaction-bytes-delays: 45, pending-compaction-bytes-stops: 0, total-delays: 62, total-stops: 48, interval: 110 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4322783 Average: 2.7462 StdDev: 22.01 Min: 0 Median: 1.5665 Max: 7376 Percentiles: P50: 1.57 P75: 1.96 P99: 7.00 P99.9: 124.94 P99.99: 341.84 ------------------------------------------------------ [ 0, 1 ] 600846 13.900% 13.900% ### ( 1, 2 ] 2754689 63.725% 77.624% ############# ( 2, 3 ] 604230 13.978% 91.602% ### ( 3, 4 ] 163387 3.780% 95.382% # ( 4, 6 ] 146500 3.389% 98.771% # ( 6, 10 ] 39532 0.915% 99.685% ( 10, 15 ] 5349 0.124% 99.809% ( 15, 22 ] 705 0.016% 99.825% ( 22, 34 ] 46 0.001% 99.827% ( 34, 51 ] 22 0.001% 99.827% ( 51, 76 ] 42 0.001% 99.828% ( 76, 110 ] 2231 0.052% 99.880% ( 110, 170 ] 3547 0.082% 99.962% ( 170, 250 ] 853 0.020% 99.981% ( 250, 380 ] 529 0.012% 99.994% ( 380, 580 ] 508 0.012% 100.005% ( 580, 870 ] 295 0.007% 100.012% ( 870, 1300 ] 163 0.004% 100.016% ( 1300, 1900 ] 65 0.002% 100.017% ( 1900, 2900 ] 60 0.001% 100.019% ( 2900, 4400 ] 49 0.001% 100.020% ( 4400, 6600 ] 12 0.000% 100.020% ( 6600, 9900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1861405 Average: 4.6781 StdDev: 64.77 Min: 1 Median: 1.8359 Max: 15579 Percentiles: P50: 1.84 P75: 2.71 P99: 9.29 P99.9: 179.90 P99.99: 527.47 ------------------------------------------------------ [ 0, 1 ] 96390 5.178% 5.178% # ( 1, 2 ] 998100 53.621% 58.799% ########### ( 2, 3 ] 426902 22.934% 81.734% ##### ( 3, 4 ] 139111 7.473% 89.207% # ( 4, 6 ] 147125 7.904% 97.111% ## ( 6, 10 ] 42768 2.298% 99.409% ( 10, 15 ] 6169 0.331% 99.740% ( 15, 22 ] 776 0.042% 99.782% ( 22, 34 ] 41 0.002% 99.784% ( 34, 51 ] 15 0.001% 99.785% ( 51, 76 ] 56 0.003% 99.788% ( 76, 110 ] 886 0.048% 99.835% ( 110, 170 ] 1131 0.061% 99.896% ( 170, 250 ] 595 0.032% 99.928% ( 250, 380 ] 665 0.036% 99.964% ( 380, 580 ] 663 0.036% 99.999% ( 580, 870 ] 598 0.032% 100.031% ( 870, 1300 ] 380 0.020% 100.052% ( 1300, 1900 ] 225 0.012% 100.064% ( 1900, 2900 ] 170 0.009% 100.073% ( 2900, 4400 ] 195 0.010% 100.084% ( 4400, 6600 ] 51 0.003% 100.086% ( 6600, 9900 ] 19 0.001% 100.087% ( 9900, 14000 ] 1 0.000% 100.087% ( 14000, 22000 ] 1 0.000% 100.087% ** Level 2 read latency histogram (micros): Count: 31984 Average: 3.2122 StdDev: 19.33 Min: 0 Median: 1.6591 Max: 961 Percentiles: P50: 1.66 P75: 2.17 P99: 7.00 P99.9: 342.96 P99.99: 799.16 ------------------------------------------------------ [ 0, 1 ] 2286 7.147% 7.147% # ( 1, 2 ] 20794 65.014% 72.161% ############# ( 2, 3 ] 5217 16.311% 88.472% ### ( 3, 4 ] 1729 5.406% 93.878% # ( 4, 6 ] 1564 4.890% 98.768% # ( 6, 10 ] 298 0.932% 99.700% ( 10, 15 ] 29 0.091% 99.791% ( 22, 34 ] 1 0.003% 99.794% ( 110, 170 ] 2 0.006% 99.800% ( 170, 250 ] 17 0.053% 99.853% ( 250, 380 ] 21 0.066% 99.919% ( 380, 580 ] 16 0.050% 99.969% ( 580, 870 ] 9 0.028% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1396309 Average: 6.2096 StdDev: 83.50 Min: 1 Median: 2.2740 Max: 9196 Percentiles: P50: 2.27 P75: 3.26 P99: 9.34 P99.9: 17.38 P99.99: 271.58 ------------------------------------------------------ [ 0, 1 ] 6355 0.455% 0.455% ( 1, 2 ] 575353 41.205% 41.660% ######## ( 2, 3 ] 424946 30.434% 72.094% ###### ( 3, 4 ] 159094 11.394% 83.488% ## ( 4, 6 ] 186954 13.389% 96.877% ### ( 6, 10 ] 35464 2.540% 99.417% # ( 10, 15 ] 6484 0.464% 99.881% ( 15, 22 ] 772 0.055% 99.936% ( 22, 34 ] 44 0.003% 99.940% ( 34, 51 ] 27 0.002% 99.942% ( 51, 76 ] 62 0.004% 99.946% ( 76, 110 ] 67 0.005% 99.951% ( 110, 170 ] 187 0.013% 99.964% ( 170, 250 ] 283 0.020% 99.984% ( 250, 380 ] 466 0.033% 100.018% ( 380, 580 ] 626 0.045% 100.063% ( 580, 870 ] 758 0.054% 100.117% ( 870, 1300 ] 575 0.041% 100.158% ( 1300, 1900 ] 312 0.022% 100.180% ( 1900, 2900 ] 278 0.020% 100.200% ( 2900, 4400 ] 283 0.020% 100.221% ( 4400, 6600 ] 65 0.005% 100.225% ( 6600, 9900 ] 16 0.001% 100.226% ** Level 4 read latency histogram (micros): Count: 155338 Average: 37.8777 StdDev: 277.64 Min: 1 Median: 2.2589 Max: 17916 Percentiles: P50: 2.26 P75: 3.40 P99: 1127.78 P99.9: 3817.78 P99.99: 5077.04 ------------------------------------------------------ [ 0, 1 ] 1416 0.912% 0.912% ( 1, 2 ] 65084 41.898% 42.810% ######## ( 2, 3 ] 43141 27.772% 70.582% ###### ( 3, 4 ] 17004 10.946% 81.529% ## ( 4, 6 ] 18254 11.751% 93.280% ## ( 6, 10 ] 4697 3.024% 96.304% # ( 10, 15 ] 829 0.534% 96.837% ( 15, 22 ] 97 0.062% 96.900% ( 22, 34 ] 23 0.015% 96.914% ( 34, 51 ] 10 0.006% 96.921% ( 51, 76 ] 12 0.008% 96.929% ( 76, 110 ] 57 0.037% 96.965% ( 110, 170 ] 222 0.143% 97.108% ( 170, 250 ] 351 0.226% 97.334% ( 250, 380 ] 466 0.300% 97.634% ( 380, 580 ] 767 0.494% 98.128% ( 580, 870 ] 905 0.583% 98.711% ( 870, 1300 ] 750 0.483% 99.193% ( 1300, 1900 ] 537 0.346% 99.539% ( 1900, 2900 ] 382 0.246% 99.785% ( 2900, 4400 ] 292 0.188% 99.973% ( 4400, 6600 ] 86 0.055% 100.028% ( 6600, 9900 ] 15 0.010% 100.038% ( 14000, 22000 ] 1 0.001% 100.039% ** Level 5 read latency histogram (micros): Count: 280 Average: 1706.2857 StdDev: 1828.52 Min: 80 Median: 959.5833 Max: 9469 Percentiles: P50: 959.58 P75: 2861.54 P99: 8580.00 P99.9: 9469.00 P99.99: 9469.00 ------------------------------------------------------ ( 76, 110 ] 13 4.643% 4.643% # ( 110, 170 ] 35 12.500% 17.143% ### ( 170, 250 ] 20 7.143% 24.286% # ( 250, 380 ] 21 7.500% 31.786% ## ( 380, 580 ] 22 7.857% 39.643% ## ( 580, 870 ] 24 8.571% 48.214% ## ( 870, 1300 ] 24 8.571% 56.786% ## ( 1300, 1900 ] 26 9.286% 66.071% ## ( 1900, 2900 ] 26 9.286% 75.357% ## ( 2900, 4400 ] 45 16.071% 91.429% ### ( 4400, 6600 ] 17 6.071% 97.500% # ( 6600, 9900 ] 7 2.500% 100.000% # ** DB Stats ** Uptime(secs): 54.9 total, 8.1 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 179.25 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.652 H:M:S, 48.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.051 H:M:S, 62.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/08-08:40:16 ... thread 0: (1000000,11000000) ops and (319238.0,190174.9) ops/second in (3.132459,57.841489) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 4.17 GB 402.0 11.4 0.0 11.4 21.8 10.4 0.0 2.1 148.3 284.3 78.55 71.52 185 0.425 11M 24K 0.0 0.0 L1 10/0 1.04 GB 106.3 8.8 6.1 2.7 8.7 6.0 0.1 1.4 215.2 212.5 42.04 38.99 5 8.409 7666K 83K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 5.2 2.0 238.2 238.1 0.53 0.51 1 0.529 127K 43 0.0 0.0 L3 20/0 987.43 MB 1.0 6.0 4.1 1.9 6.0 4.1 1.1 1.5 174.2 173.5 35.39 28.28 21 1.685 5737K 22K 0.0 0.0 L4 173/0 9.76 GB 1.0 4.9 4.2 0.6 4.9 4.2 0.9 1.1 135.4 135.1 36.83 23.78 56 0.658 4991K 5483 0.0 0.0 L5 1088/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/4 106.42 GB 0.0 31.2 14.5 16.7 41.5 24.8 12.3 4.0 165.4 219.9 193.35 163.07 268 0.721 30M 136K 0.0 0.0 Int 0/0 0.00 KB 0.0 31.2 14.5 16.7 41.5 24.8 12.2 4.0 165.4 219.9 193.35 163.07 268 0.721 30M 136K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 31.2 14.5 16.7 31.1 14.4 0.0 0.0 199.2 198.1 160.54 135.69 117 1.372 30M 136K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 326.4 32.81 27.38 151 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.0 total, 57.8 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 41.51 GB write, 732.45 MB/s write, 31.23 GB read, 550.99 MB/s read, 193.3 seconds Interval compaction: 41.51 GB write, 734.91 MB/s write, 31.23 GB read, 552.84 MB/s read, 193.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 45, pending-compaction-bytes-stops: 0, total-delays: 62, total-stops: 53, interval: 115 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4630740 Average: 2.7179 StdDev: 21.61 Min: 0 Median: 1.5646 Max: 7376 Percentiles: P50: 1.56 P75: 1.96 P99: 6.89 P99.9: 118.91 P99.99: 318.40 ------------------------------------------------------ [ 0, 1 ] 651524 14.070% 14.070% ### ( 1, 2 ] 2947198 63.644% 77.714% ############# ( 2, 3 ] 645173 13.932% 91.646% ### ( 3, 4 ] 175020 3.780% 95.426% # ( 4, 6 ] 156295 3.375% 98.801% # ( 6, 10 ] 41587 0.898% 99.699% ( 10, 15 ] 5699 0.123% 99.822% ( 15, 22 ] 736 0.016% 99.838% ( 22, 34 ] 51 0.001% 99.839% ( 34, 51 ] 23 0.000% 99.839% ( 51, 76 ] 43 0.001% 99.840% ( 76, 110 ] 2233 0.048% 99.889% ( 110, 170 ] 3556 0.077% 99.965% ( 170, 250 ] 860 0.019% 99.984% ( 250, 380 ] 532 0.011% 99.995% ( 380, 580 ] 512 0.011% 100.007% ( 580, 870 ] 302 0.007% 100.013% ( 870, 1300 ] 170 0.004% 100.017% ( 1300, 1900 ] 69 0.001% 100.018% ( 1900, 2900 ] 61 0.001% 100.020% ( 2900, 4400 ] 51 0.001% 100.021% ( 4400, 6600 ] 13 0.000% 100.021% ( 6600, 9900 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1861405 Average: 4.6781 StdDev: 64.77 Min: 1 Median: 1.8359 Max: 15579 Percentiles: P50: 1.84 P75: 2.71 P99: 9.29 P99.9: 179.90 P99.99: 527.47 ------------------------------------------------------ [ 0, 1 ] 96390 5.178% 5.178% # ( 1, 2 ] 998100 53.621% 58.799% ########### ( 2, 3 ] 426902 22.934% 81.734% ##### ( 3, 4 ] 139111 7.473% 89.207% # ( 4, 6 ] 147125 7.904% 97.111% ## ( 6, 10 ] 42768 2.298% 99.409% ( 10, 15 ] 6169 0.331% 99.740% ( 15, 22 ] 776 0.042% 99.782% ( 22, 34 ] 41 0.002% 99.784% ( 34, 51 ] 15 0.001% 99.785% ( 51, 76 ] 56 0.003% 99.788% ( 76, 110 ] 886 0.048% 99.835% ( 110, 170 ] 1131 0.061% 99.896% ( 170, 250 ] 595 0.032% 99.928% ( 250, 380 ] 665 0.036% 99.964% ( 380, 580 ] 663 0.036% 99.999% ( 580, 870 ] 598 0.032% 100.031% ( 870, 1300 ] 380 0.020% 100.052% ( 1300, 1900 ] 225 0.012% 100.064% ( 1900, 2900 ] 170 0.009% 100.073% ( 2900, 4400 ] 195 0.010% 100.084% ( 4400, 6600 ] 51 0.003% 100.086% ( 6600, 9900 ] 19 0.001% 100.087% ( 9900, 14000 ] 1 0.000% 100.087% ( 14000, 22000 ] 1 0.000% 100.087% ** Level 2 read latency histogram (micros): Count: 31984 Average: 3.2122 StdDev: 19.33 Min: 0 Median: 1.6591 Max: 961 Percentiles: P50: 1.66 P75: 2.17 P99: 7.00 P99.9: 342.96 P99.99: 799.16 ------------------------------------------------------ [ 0, 1 ] 2286 7.147% 7.147% # ( 1, 2 ] 20794 65.014% 72.161% ############# ( 2, 3 ] 5217 16.311% 88.472% ### ( 3, 4 ] 1729 5.406% 93.878% # ( 4, 6 ] 1564 4.890% 98.768% # ( 6, 10 ] 298 0.932% 99.700% ( 10, 15 ] 29 0.091% 99.791% ( 22, 34 ] 1 0.003% 99.794% ( 110, 170 ] 2 0.006% 99.800% ( 170, 250 ] 17 0.053% 99.853% ( 250, 380 ] 21 0.066% 99.919% ( 380, 580 ] 16 0.050% 99.969% ( 580, 870 ] 9 0.028% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1465616 Average: 6.0583 StdDev: 81.51 Min: 1 Median: 2.2660 Max: 9196 Percentiles: P50: 2.27 P75: 3.23 P99: 9.31 P99.9: 16.27 P99.99: 248.44 ------------------------------------------------------ [ 0, 1 ] 6558 0.447% 0.447% ( 1, 2 ] 607465 41.448% 41.895% ######## ( 2, 3 ] 446627 30.474% 72.369% ###### ( 3, 4 ] 165723 11.307% 83.676% ## ( 4, 6 ] 194159 13.248% 96.924% ### ( 6, 10 ] 36761 2.508% 99.432% # ( 10, 15 ] 6714 0.458% 99.890% ( 15, 22 ] 793 0.054% 99.944% ( 22, 34 ] 44 0.003% 99.947% ( 34, 51 ] 28 0.002% 99.949% ( 51, 76 ] 64 0.004% 99.954% ( 76, 110 ] 67 0.005% 99.958% ( 110, 170 ] 187 0.013% 99.971% ( 170, 250 ] 285 0.019% 99.990% ( 250, 380 ] 466 0.032% 100.022% ( 380, 580 ] 626 0.043% 100.065% ( 580, 870 ] 758 0.052% 100.117% ( 870, 1300 ] 576 0.039% 100.156% ( 1300, 1900 ] 312 0.021% 100.177% ( 1900, 2900 ] 278 0.019% 100.196% ( 2900, 4400 ] 283 0.019% 100.215% ( 4400, 6600 ] 65 0.004% 100.220% ( 6600, 9900 ] 16 0.001% 100.221% ** Level 4 read latency histogram (micros): Count: 164908 Average: 35.9598 StdDev: 269.74 Min: 1 Median: 2.2300 Max: 17916 Percentiles: P50: 2.23 P75: 3.34 P99: 1074.39 P99.9: 3763.49 P99.99: 5026.98 ------------------------------------------------------ [ 0, 1 ] 1570 0.952% 0.952% ( 1, 2 ] 70408 42.695% 43.647% ######### ( 2, 3 ] 45540 27.615% 71.263% ###### ( 3, 4 ] 17892 10.850% 82.112% ## ( 4, 6 ] 18821 11.413% 93.525% ## ( 6, 10 ] 4856 2.945% 96.470% # ( 10, 15 ] 856 0.519% 96.989% ( 15, 22 ] 99 0.060% 97.049% ( 22, 34 ] 23 0.014% 97.063% ( 34, 51 ] 10 0.006% 97.069% ( 51, 76 ] 13 0.008% 97.077% ( 76, 110 ] 58 0.035% 97.112% ( 110, 170 ] 232 0.141% 97.253% ( 170, 250 ] 364 0.221% 97.474% ( 250, 380 ] 475 0.288% 97.762% ( 380, 580 ] 772 0.468% 98.230% ( 580, 870 ] 912 0.553% 98.783% ( 870, 1300 ] 753 0.457% 99.240% ( 1300, 1900 ] 539 0.327% 99.566% ( 1900, 2900 ] 382 0.232% 99.798% ( 2900, 4400 ] 292 0.177% 99.975% ( 4400, 6600 ] 86 0.052% 100.027% ( 6600, 9900 ] 15 0.009% 100.036% ( 14000, 22000 ] 1 0.001% 100.037% ** Level 5 read latency histogram (micros): Count: 300 Average: 1653.2167 StdDev: 1792.48 Min: 80 Median: 887.2000 Max: 9469 Percentiles: P50: 887.20 P75: 2700.00 P99: 8485.71 P99.9: 9469.00 P99.99: 9469.00 ------------------------------------------------------ ( 76, 110 ] 14 4.667% 4.667% # ( 110, 170 ] 37 12.333% 17.000% ## ( 170, 250 ] 22 7.333% 24.333% # ( 250, 380 ] 24 8.000% 32.333% ## ( 380, 580 ] 25 8.333% 40.667% ## ( 580, 870 ] 27 9.000% 49.667% ## ( 870, 1300 ] 25 8.333% 58.000% ## ( 1300, 1900 ] 27 9.000% 67.000% ## ( 1900, 2900 ] 30 10.000% 77.000% ## ( 2900, 4400 ] 45 15.000% 92.000% ### ( 4400, 6600 ] 17 5.667% 97.667% # ( 6600, 9900 ] 7 2.333% 100.000% ** DB Stats ** Uptime(secs): 58.0 total, 3.1 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 186.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.063 H:M:S, 46.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.411 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.239 micros/op 190885 ops/sec 60.036 seconds 11459999 operations; 185.0 MB/s Microseconds per write: Count: 11459999 Average: 5.2387 StdDev: 350.16 Min: 1 Median: 1.7612 Max: 683299 Percentiles: P50: 1.76 P75: 2.79 P99: 9.26 P99.9: 1065.42 P99.99: 2550.63 ------------------------------------------------------ [ 0, 1 ] 1353430 11.810% 11.810% ## ( 1, 2 ] 5749411 50.169% 61.979% ########## ( 2, 3 ] 1888569 16.480% 78.459% ### ( 3, 4 ] 1599920 13.961% 92.420% ### ( 4, 6 ] 638196 5.569% 97.989% # ( 6, 10 ] 142020 1.239% 99.228% ( 10, 15 ] 45398 0.396% 99.624% ( 15, 22 ] 10577 0.092% 99.717% ( 22, 34 ] 1947 0.017% 99.734% ( 34, 51 ] 264 0.002% 99.736% ( 51, 76 ] 35 0.000% 99.736% ( 76, 110 ] 8023 0.070% 99.806% ( 110, 170 ] 3062 0.027% 99.833% ( 170, 250 ] 347 0.003% 99.836% ( 250, 380 ] 200 0.002% 99.838% ( 380, 580 ] 36 0.000% 99.838% ( 580, 870 ] 38 0.000% 99.838% ( 870, 1300 ] 15548 0.136% 99.974% ( 1300, 1900 ] 128 0.001% 99.975% ( 1900, 2900 ] 2619 0.023% 99.998% ( 2900, 4400 ] 139 0.001% 99.999% ( 4400, 6600 ] 52 0.000% 100.000% ( 6600, 9900 ] 9 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 186008 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11459999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11826718968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 639 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 28028358 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34489868248 rocksdb.compact.write.bytes COUNT : 34295608263 rocksdb.flush.write.bytes COUNT : 11824263340 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 69 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 406 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11728906240 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4537344 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34601300451 rocksdb.non.last.level.read.count COUNT : 8354735 rocksdb.block.checksum.compute.count COUNT : 8353526 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.406625 P95 : 3.922210 P99 : 7.745712 P100 : 683296.000000 COUNT : 11459999 SUM : 54460264 rocksdb.compaction.times.micros P50 : 890357.142857 P95 : 4327500.000000 P99 : 17240000.000000 P100 : 19127648.000000 COUNT : 119 SUM : 162433316 rocksdb.compaction.times.cpu_micros P50 : 841875.000000 P95 : 4327500.000000 P99 : 17240000.000000 P100 : 17858843.000000 COUNT : 119 SUM : 137561698 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 687.944444 P95 : 1925.000000 P99 : 39970.000000 P100 : 96958.000000 COUNT : 159 SUM : 293183 rocksdb.compaction.outfile.sync.micros P50 : 1195.571429 P95 : 40186.363636 P99 : 91887.500000 P100 : 152328.000000 COUNT : 407 SUM : 3361626 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.166667 P95 : 1211.312500 P99 : 2888.000000 P100 : 7506.000000 COUNT : 306 SUM : 92166 rocksdb.table.open.io.micros P50 : 1613.888889 P95 : 11625.416667 P99 : 20473.043478 P100 : 26412.000000 COUNT : 639 SUM : 1728010 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.792718 P95 : 8.331960 P99 : 11.837536 P100 : 15584.000000 COUNT : 8351655 SUM : 54256267 rocksdb.read.block.get.micros P50 : 534.074074 P95 : 4271.739130 P99 : 8089.125000 P100 : 17930.000000 COUNT : 1278 SUM : 1376184 rocksdb.write.raw.block.micros P50 : 0.513613 P95 : 0.975866 P99 : 2.944286 P100 : 23606.000000 COUNT : 11169877 SUM : 22634116 rocksdb.numfiles.in.singlecompaction P50 : 3.054795 P95 : 5.920000 P99 : 19.760000 P100 : 24.000000 COUNT : 164 SUM : 575 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558294 P95 : 1133.959698 P99 : 2294.131851 P100 : 683091.000000 COUNT : 178271 SUM : 28047145 rocksdb.sst.read.micros P50 : 1.710794 P95 : 5.074595 P99 : 8.834720 P100 : 17916.000000 COUNT : 8354873 SUM : 37319836 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11459999 SUM : 11826718968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 212500.000000 P95 : 367928.571429 P99 : 547580.000000 P100 : 844525.000000 COUNT : 159 SUM : 34375993 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 409 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0