[2024-12-15 12:53:52.152202] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 23.11.0 initialization... [2024-12-15 12:53:52.152472] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid446284 ] Set seed to 1734263632145224 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 12:53:52.283090] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 12:53:52.306388] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 12:53:52.306434] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 446284' to capture a snapshot of events at runtime. [2024-12-15 12:53:52.306445] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 12:53:52.306456] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 12:53:52.306463] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid446284 for offline analysis/debug. [2024-12-15 12:53:52.307032] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 12:53:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-12:54:04 ... thread 0: (1000000,1000000) ops and (132444.0,132444.0) ops/second in (7.550360,7.550360) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/2 566.89 MB 37.8 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 117.9 6.94 2.40 9 0.772 0 0 0.0 0.0 L1 2/2 158.75 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 1.3 118.4 118.3 3.27 1.67 2 1.637 393K 279 0.0 0.0 L2 4/0 317.62 MB 3.2 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 56/11 4.79 GB 3.9 3.7 2.8 0.9 3.6 2.7 0.0 1.3 99.6 98.3 37.57 17.44 20 1.879 2002K 0 0.0 0.0 L4 182/15 11.15 GB 1.1 2.2 1.5 0.7 2.1 1.5 0.2 1.4 111.7 109.7 20.02 10.41 13 1.540 1123K 0 0.0 0.0 L5 1104/0 90.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1354/30 107.69 GB 0.0 6.2 4.6 1.7 6.9 5.3 0.5 8.7 93.9 104.7 67.81 31.93 44 1.541 3520K 279 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 4.6 1.7 6.9 5.3 0.5 8.7 93.9 104.7 67.81 31.93 44 1.541 3520K 279 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 4.6 1.7 6.1 4.5 0.0 0.0 104.6 103.1 60.87 29.52 35 1.739 3520K 279 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 117.9 6.94 2.40 9 0.772 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.6 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.93 GB write, 916.93 MB/s write, 6.22 GB read, 822.70 MB/s read, 67.8 seconds Interval compaction: 6.93 GB write, 939.66 MB/s write, 6.22 GB read, 843.09 MB/s read, 67.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 36, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 118983 Average: 7.2294 StdDev: 157.78 Min: 1 Median: 1.8372 Max: 40271 Percentiles: P50: 1.84 P75: 2.79 P99: 9.33 P99.9: 1369.02 P99.99: 4353.54 ------------------------------------------------------ [ 0, 1 ] 4966 4.174% 4.174% # ( 1, 2 ] 65127 54.736% 58.910% ########### ( 2, 3 ] 24205 20.343% 79.253% #### ( 3, 4 ] 11431 9.607% 88.861% ## ( 4, 6 ] 10257 8.621% 97.481% ## ( 6, 10 ] 2172 1.825% 99.307% ( 10, 15 ] 392 0.329% 99.636% ( 15, 22 ] 51 0.043% 99.679% ( 22, 34 ] 4 0.003% 99.682% ( 34, 51 ] 6 0.005% 99.687% ( 51, 76 ] 6 0.005% 99.692% ( 76, 110 ] 1 0.001% 99.693% ( 110, 170 ] 2 0.002% 99.695% ( 170, 250 ] 13 0.011% 99.706% ( 250, 380 ] 26 0.022% 99.728% ( 380, 580 ] 51 0.043% 99.771% ( 580, 870 ] 83 0.070% 99.840% ( 870, 1300 ] 64 0.054% 99.894% ( 1300, 1900 ] 61 0.051% 99.945% ( 1900, 2900 ] 25 0.021% 99.966% ( 2900, 4400 ] 29 0.024% 99.991% ( 4400, 6600 ] 8 0.007% 99.997% ( 6600, 9900 ] 1 0.001% 99.998% ( 14000, 22000 ] 1 0.001% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 93689 Average: 9.5040 StdDev: 124.41 Min: 1 Median: 1.9176 Max: 7165 Percentiles: P50: 1.92 P75: 2.96 P99: 9.91 P99.9: 2028.80 P99.99: 4287.70 ------------------------------------------------------ [ 0, 1 ] 2765 2.951% 2.951% # ( 1, 2 ] 48042 51.278% 54.229% ########## ( 2, 3 ] 20363 21.735% 75.964% #### ( 3, 4 ] 10213 10.901% 86.865% ## ( 4, 6 ] 9460 10.097% 96.962% ## ( 6, 10 ] 1955 2.087% 99.049% ( 10, 15 ] 381 0.407% 99.456% ( 15, 22 ] 74 0.079% 99.535% ( 22, 34 ] 9 0.010% 99.544% ( 34, 51 ] 4 0.004% 99.549% ( 51, 76 ] 7 0.007% 99.556% ( 76, 110 ] 2 0.002% 99.558% ( 110, 170 ] 5 0.005% 99.563% ( 170, 250 ] 7 0.007% 99.571% ( 250, 380 ] 17 0.018% 99.589% ( 380, 580 ] 45 0.048% 99.637% ( 580, 870 ] 81 0.086% 99.724% ( 870, 1300 ] 92 0.098% 99.822% ( 1300, 1900 ] 70 0.075% 99.896% ( 1900, 2900 ] 49 0.052% 99.949% ( 2900, 4400 ] 45 0.048% 99.997% ( 4400, 6600 ] 5 0.005% 100.002% ( 6600, 9900 ] 3 0.003% 100.005% ** Level 2 read latency histogram (micros): Count: 541655 Average: 14.1760 StdDev: 166.01 Min: 1 Median: 1.9664 Max: 10765 Percentiles: P50: 1.97 P75: 3.02 P99: 12.55 P99.9: 1575.01 P99.99: 2133.70 ------------------------------------------------------ [ 0, 1 ] 15964 2.947% 2.947% # ( 1, 2 ] 263723 48.688% 51.636% ########## ( 2, 3 ] 125206 23.115% 74.751% ##### ( 3, 4 ] 56885 10.502% 85.253% ## ( 4, 6 ] 56049 10.348% 95.601% ## ( 6, 10 ] 16762 3.095% 98.695% # ( 10, 15 ] 3231 0.597% 99.292% ( 15, 22 ] 562 0.104% 99.396% ( 22, 34 ] 85 0.016% 99.411% ( 34, 51 ] 43 0.008% 99.419% ( 51, 76 ] 22 0.004% 99.423% ( 76, 110 ] 17 0.003% 99.427% ( 110, 170 ] 45 0.008% 99.435% ( 170, 250 ] 97 0.018% 99.453% ( 250, 380 ] 201 0.037% 99.490% ( 380, 580 ] 399 0.074% 99.564% ( 580, 870 ] 701 0.129% 99.693% ( 870, 1300 ] 817 0.151% 99.844% ( 1300, 1900 ] 664 0.123% 99.966% ( 1900, 2900 ] 547 0.101% 100.067% ( 2900, 4400 ] 409 0.076% 100.143% ( 4400, 6600 ] 108 0.020% 100.163% ( 6600, 9900 ] 19 0.004% 100.166% ( 9900, 14000 ] 1 0.000% 100.167% ** Level 3 read latency histogram (micros): Count: 688327 Average: 11.8576 StdDev: 166.17 Min: 1 Median: 1.9478 Max: 39926 Percentiles: P50: 1.95 P75: 2.97 P99: 9.93 P99.9: 1062.11 P99.99: 1523.47 ------------------------------------------------------ [ 0, 1 ] 16005 2.325% 2.325% ( 1, 2 ] 346243 50.302% 52.627% ########## ( 2, 3 ] 158464 23.022% 75.649% ##### ( 3, 4 ] 71823 10.434% 86.083% ## ( 4, 6 ] 70382 10.225% 96.308% ## ( 6, 10 ] 18859 2.740% 99.048% # ( 10, 15 ] 3148 0.457% 99.506% ( 15, 22 ] 505 0.073% 99.579% ( 22, 34 ] 53 0.008% 99.587% ( 34, 51 ] 36 0.005% 99.592% ( 51, 76 ] 57 0.008% 99.600% ( 76, 110 ] 22 0.003% 99.603% ( 110, 170 ] 54 0.008% 99.611% ( 170, 250 ] 124 0.018% 99.629% ( 250, 380 ] 221 0.032% 99.661% ( 380, 580 ] 505 0.073% 99.735% ( 580, 870 ] 795 0.115% 99.850% ( 870, 1300 ] 767 0.111% 99.962% ( 1300, 1900 ] 524 0.076% 100.038% ( 1900, 2900 ] 427 0.062% 100.100% ( 2900, 4400 ] 438 0.064% 100.163% ( 4400, 6600 ] 133 0.019% 100.183% ( 6600, 9900 ] 29 0.004% 100.187% ( 9900, 14000 ] 6 0.001% 100.188% ( 14000, 22000 ] 3 0.000% 100.188% ( 33000, 50000 ] 1 0.000% 100.188% ** Level 4 read latency histogram (micros): Count: 314067 Average: 21.6232 StdDev: 267.48 Min: 1 Median: 1.9635 Max: 36014 Percentiles: P50: 1.96 P75: 3.00 P99: 386.12 P99.9: 2464.20 P99.99: 3456.73 ------------------------------------------------------ [ 0, 1 ] 6599 2.101% 2.101% ( 1, 2 ] 156134 49.714% 51.815% ########## ( 2, 3 ] 72972 23.235% 75.049% ##### ( 3, 4 ] 32484 10.343% 85.392% ## ( 4, 6 ] 32105 10.222% 95.615% ## ( 6, 10 ] 8519 2.712% 98.327% # ( 10, 15 ] 1455 0.463% 98.790% ( 15, 22 ] 194 0.062% 98.852% ( 22, 34 ] 11 0.004% 98.856% ( 34, 51 ] 17 0.005% 98.861% ( 51, 76 ] 34 0.011% 98.872% ( 76, 110 ] 14 0.004% 98.876% ( 110, 170 ] 58 0.018% 98.895% ( 170, 250 ] 96 0.031% 98.925% ( 250, 380 ] 220 0.070% 98.995% ( 380, 580 ] 501 0.160% 99.155% ( 580, 870 ] 797 0.254% 99.409% ( 870, 1300 ] 844 0.269% 99.677% ( 1300, 1900 ] 494 0.157% 99.835% ( 1900, 2900 ] 365 0.116% 99.951% ( 2900, 4400 ] 333 0.106% 100.057% ( 4400, 6600 ] 141 0.045% 100.102% ( 6600, 9900 ] 24 0.008% 100.110% ( 9900, 14000 ] 2 0.001% 100.110% ( 14000, 22000 ] 7 0.002% 100.112% ( 22000, 33000 ] 5 0.002% 100.114% ( 33000, 50000 ] 1 0.000% 100.114% ** Level 5 read latency histogram (micros): Count: 13514 Average: 1634.5450 StdDev: 1598.41 Min: 92 Median: 1086.4782 Max: 40252 Percentiles: P50: 1086.48 P75: 2182.53 P99: 6590.06 P99.9: 9778.89 P99.99: 40006.55 ------------------------------------------------------ ( 76, 110 ] 14 0.104% 0.104% ( 110, 170 ] 86 0.636% 0.740% ( 170, 250 ] 310 2.294% 3.034% ( 250, 380 ] 745 5.513% 8.547% # ( 380, 580 ] 1665 12.321% 20.867% ## ( 580, 870 ] 2619 19.380% 40.247% #### ( 870, 1300 ] 2618 19.373% 59.620% #### ( 1300, 1900 ] 1692 12.520% 72.140% ### ( 1900, 2900 ] 1368 10.123% 82.263% ## ( 2900, 4400 ] 1570 11.618% 93.880% ## ( 4400, 6600 ] 695 5.143% 99.023% # ( 6600, 9900 ] 123 0.910% 99.933% ( 9900, 14000 ] 4 0.030% 99.963% ( 14000, 22000 ] 1 0.007% 99.970% ( 22000, 33000 ] 1 0.007% 99.978% ( 33000, 50000 ] 4 0.030% 100.007% ** DB Stats ** Uptime(secs): 7.7 total, 7.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 127.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.602 H:M:S, 46.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.602 H:M:S, 47.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-12:54:12 ... thread 0: (1000000,2000000) ops and (116017.9,123688.0) ops/second in (8.619359,16.169719) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 1006.77 MB 0.0 0.7 0.0 0.7 2.5 1.8 0.0 1.4 36.5 124.6 20.71 8.61 22 0.942 767K 1010 0.0 0.0 L1 2/2 253.81 MB 0.0 1.4 0.8 0.6 1.4 0.8 0.0 1.7 114.8 114.6 12.72 6.70 4 3.180 1483K 2594 0.0 0.0 L2 5/4 539.27 MB 1.3 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/13 1.09 GB 0.2 4.1 2.8 1.2 4.0 2.8 0.2 1.4 99.9 98.7 41.64 19.49 21 1.983 2163K 0 0.0 0.0 L4 177/4 9.69 GB 1.0 9.8 5.1 4.7 9.6 4.9 0.6 1.9 113.2 110.7 88.65 47.31 48 1.847 4216K 11K 0.0 0.0 L5 1168/0 95.97 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1372/28 108.50 GB 0.0 16.0 8.8 7.3 17.5 10.3 6.7 9.8 100.2 109.7 163.72 82.12 95 1.723 8629K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.0 8.8 7.3 17.5 10.3 6.7 9.8 100.2 109.7 163.72 82.12 95 1.723 8629K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.0 8.8 7.3 15.8 8.5 0.0 0.0 110.6 108.8 148.35 76.70 75 1.978 8629K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 118.8 15.37 5.42 20 0.769 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.2 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.54 GB write, 1098.24 MB/s write, 16.02 GB read, 1002.97 MB/s read, 163.7 seconds Interval compaction: 17.54 GB write, 1110.95 MB/s write, 16.02 GB read, 1014.58 MB/s read, 163.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 81, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 411369 Average: 12.7414 StdDev: 195.22 Min: 1 Median: 1.8551 Max: 40271 Percentiles: P50: 1.86 P75: 2.83 P99: 11.14 P99.9: 2516.65 P99.99: 5447.76 ------------------------------------------------------ [ 0, 1 ] 17186 4.178% 4.178% # ( 1, 2 ] 220447 53.589% 57.766% ########### ( 2, 3 ] 85228 20.718% 78.485% #### ( 3, 4 ] 39522 9.607% 88.092% ## ( 4, 6 ] 36367 8.840% 96.932% ## ( 6, 10 ] 8175 1.987% 98.920% ( 10, 15 ] 1448 0.352% 99.272% ( 15, 22 ] 189 0.046% 99.318% ( 22, 34 ] 12 0.003% 99.321% ( 34, 51 ] 17 0.004% 99.325% ( 51, 76 ] 25 0.006% 99.331% ( 76, 110 ] 5 0.001% 99.332% ( 110, 170 ] 12 0.003% 99.335% ( 170, 250 ] 67 0.016% 99.351% ( 250, 380 ] 174 0.042% 99.393% ( 380, 580 ] 410 0.100% 99.493% ( 580, 870 ] 630 0.153% 99.646% ( 870, 1300 ] 569 0.138% 99.785% ( 1300, 1900 ] 355 0.086% 99.871% ( 1900, 2900 ] 194 0.047% 99.918% ( 2900, 4400 ] 253 0.062% 99.980% ( 4400, 6600 ] 90 0.022% 100.001% ( 6600, 9900 ] 17 0.004% 100.006% ( 9900, 14000 ] 3 0.001% 100.006% ( 14000, 22000 ] 2 0.000% 100.007% ( 22000, 33000 ] 5 0.001% 100.008% ( 33000, 50000 ] 1 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 252765 Average: 13.6374 StdDev: 188.71 Min: 1 Median: 1.9579 Max: 29138 Percentiles: P50: 1.96 P75: 2.98 P99: 12.09 P99.9: 3013.13 P99.99: 5799.87 ------------------------------------------------------ [ 0, 1 ] 5791 2.291% 2.291% ( 1, 2 ] 125894 49.807% 52.098% ########## ( 2, 3 ] 59053 23.363% 75.461% ##### ( 3, 4 ] 26777 10.594% 86.054% ## ( 4, 6 ] 25901 10.247% 96.301% ## ( 6, 10 ] 6368 2.519% 98.821% # ( 10, 15 ] 1087 0.430% 99.251% ( 15, 22 ] 152 0.060% 99.311% ( 22, 34 ] 15 0.006% 99.317% ( 34, 51 ] 7 0.003% 99.320% ( 51, 76 ] 23 0.009% 99.329% ( 76, 110 ] 4 0.002% 99.330% ( 110, 170 ] 15 0.006% 99.336% ( 170, 250 ] 30 0.012% 99.348% ( 250, 380 ] 111 0.044% 99.392% ( 380, 580 ] 239 0.095% 99.486% ( 580, 870 ] 349 0.138% 99.625% ( 870, 1300 ] 349 0.138% 99.763% ( 1300, 1900 ] 194 0.077% 99.839% ( 1900, 2900 ] 139 0.055% 99.894% ( 2900, 4400 ] 202 0.080% 99.974% ( 4400, 6600 ] 64 0.025% 100.000% ( 6600, 9900 ] 19 0.008% 100.007% ( 9900, 14000 ] 3 0.001% 100.008% ( 14000, 22000 ] 2 0.001% 100.009% ( 22000, 33000 ] 1 0.000% 100.009% ** Level 2 read latency histogram (micros): Count: 584517 Average: 14.1092 StdDev: 171.72 Min: 1 Median: 1.9633 Max: 21975 Percentiles: P50: 1.96 P75: 3.01 P99: 12.42 P99.9: 1608.77 P99.99: 2245.56 ------------------------------------------------------ [ 0, 1 ] 16839 2.881% 2.881% # ( 1, 2 ] 285914 48.915% 51.795% ########## ( 2, 3 ] 135205 23.131% 74.926% ##### ( 3, 4 ] 60979 10.432% 85.359% ## ( 4, 6 ] 60159 10.292% 95.651% ## ( 6, 10 ] 17924 3.066% 98.717% # ( 10, 15 ] 3410 0.583% 99.301% ( 15, 22 ] 589 0.101% 99.402% ( 22, 34 ] 86 0.015% 99.416% ( 34, 51 ] 44 0.008% 99.424% ( 51, 76 ] 28 0.005% 99.429% ( 76, 110 ] 19 0.003% 99.432% ( 110, 170 ] 45 0.008% 99.440% ( 170, 250 ] 106 0.018% 99.458% ( 250, 380 ] 221 0.038% 99.495% ( 380, 580 ] 424 0.073% 99.568% ( 580, 870 ] 740 0.127% 99.695% ( 870, 1300 ] 849 0.145% 99.840% ( 1300, 1900 ] 683 0.117% 99.957% ( 1900, 2900 ] 563 0.096% 100.053% ( 2900, 4400 ] 435 0.074% 100.127% ( 4400, 6600 ] 130 0.022% 100.150% ( 6600, 9900 ] 23 0.004% 100.154% ( 9900, 14000 ] 2 0.000% 100.154% ( 14000, 22000 ] 2 0.000% 100.154% ** Level 3 read latency histogram (micros): Count: 1599693 Average: 11.3632 StdDev: 172.65 Min: 1 Median: 1.9606 Max: 39926 Percentiles: P50: 1.96 P75: 2.98 P99: 9.85 P99.9: 961.50 P99.99: 1431.98 ------------------------------------------------------ [ 0, 1 ] 33836 2.115% 2.115% ( 1, 2 ] 797451 49.850% 51.965% ########## ( 2, 3 ] 375974 23.503% 75.468% ##### ( 3, 4 ] 166561 10.412% 85.880% ## ( 4, 6 ] 166184 10.388% 96.269% ## ( 6, 10 ] 45402 2.838% 99.107% # ( 10, 15 ] 7531 0.471% 99.578% ( 15, 22 ] 1090 0.068% 99.646% ( 22, 34 ] 97 0.006% 99.652% ( 34, 51 ] 96 0.006% 99.658% ( 51, 76 ] 158 0.010% 99.668% ( 76, 110 ] 50 0.003% 99.671% ( 110, 170 ] 81 0.005% 99.676% ( 170, 250 ] 208 0.013% 99.689% ( 250, 380 ] 455 0.028% 99.718% ( 380, 580 ] 1010 0.063% 99.781% ( 580, 870 ] 1580 0.099% 99.879% ( 870, 1300 ] 1557 0.097% 99.977% ( 1300, 1900 ] 973 0.061% 100.038% ( 1900, 2900 ] 813 0.051% 100.088% ( 2900, 4400 ] 972 0.061% 100.149% ( 4400, 6600 ] 349 0.022% 100.171% ( 6600, 9900 ] 95 0.006% 100.177% ( 9900, 14000 ] 19 0.001% 100.178% ( 14000, 22000 ] 11 0.001% 100.179% ( 22000, 33000 ] 3 0.000% 100.179% ( 33000, 50000 ] 2 0.000% 100.179% ** Level 4 read latency histogram (micros): Count: 1284626 Average: 17.7201 StdDev: 236.29 Min: 1 Median: 1.9690 Max: 53061 Percentiles: P50: 1.97 P75: 2.99 P99: 13.96 P99.9: 1750.92 P99.99: 2663.22 ------------------------------------------------------ [ 0, 1 ] 25166 1.959% 1.959% ( 1, 2 ] 636878 49.577% 51.536% ########## ( 2, 3 ] 303424 23.620% 75.156% ##### ( 3, 4 ] 133272 10.374% 85.530% ## ( 4, 6 ] 132401 10.307% 95.837% ## ( 6, 10 ] 35764 2.784% 98.621% # ( 10, 15 ] 6161 0.480% 99.100% ( 15, 22 ] 779 0.061% 99.161% ( 22, 34 ] 65 0.005% 99.166% ( 34, 51 ] 65 0.005% 99.171% ( 51, 76 ] 143 0.011% 99.182% ( 76, 110 ] 50 0.004% 99.186% ( 110, 170 ] 152 0.012% 99.198% ( 170, 250 ] 358 0.028% 99.226% ( 250, 380 ] 738 0.057% 99.283% ( 380, 580 ] 1696 0.132% 99.415% ( 580, 870 ] 2642 0.206% 99.621% ( 870, 1300 ] 2542 0.198% 99.819% ( 1300, 1900 ] 1391 0.108% 99.927% ( 1900, 2900 ] 1062 0.083% 100.010% ( 2900, 4400 ] 1223 0.095% 100.105% ( 4400, 6600 ] 487 0.038% 100.143% ( 6600, 9900 ] 96 0.007% 100.150% ( 9900, 14000 ] 10 0.001% 100.151% ( 14000, 22000 ] 19 0.001% 100.152% ( 22000, 33000 ] 14 0.001% 100.154% ( 33000, 50000 ] 2 0.000% 100.154% ( 50000, 75000 ] 1 0.000% 100.154% ** Level 5 read latency histogram (micros): Count: 33084 Average: 1447.1937 StdDev: 1544.13 Min: 84 Median: 947.8730 Max: 49004 Percentiles: P50: 947.87 P75: 1729.63 P99: 6489.24 P99.9: 9870.86 P99.99: 36594.65 ------------------------------------------------------ ( 76, 110 ] 25 0.076% 0.076% ( 110, 170 ] 226 0.683% 0.759% ( 170, 250 ] 747 2.258% 3.017% ( 250, 380 ] 2151 6.502% 9.518% # ( 380, 580 ] 4870 14.720% 24.238% ### ( 580, 870 ] 7285 22.020% 46.258% #### ( 870, 1300 ] 6836 20.663% 66.921% #### ( 1300, 1900 ] 3733 11.283% 78.204% ## ( 1900, 2900 ] 2561 7.741% 85.945% ## ( 2900, 4400 ] 3115 9.415% 95.360% ## ( 4400, 6600 ] 1268 3.833% 99.193% # ( 6600, 9900 ] 236 0.713% 99.906% ( 9900, 14000 ] 11 0.033% 99.940% ( 14000, 22000 ] 6 0.018% 99.958% ( 22000, 33000 ] 9 0.027% 99.985% ( 33000, 50000 ] 8 0.024% 100.009% ** DB Stats ** Uptime(secs): 16.4 total, 8.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 120.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.118 H:M:S, 49.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 114.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.516 H:M:S, 52.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/12/15-12:54:16 ... thread 0: (1000000,3000000) ops and (243997.4,148015.7) ops/second in (4.098404,20.268123) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.91 GB 62.9 1.2 0.0 1.2 3.9 2.7 0.0 1.5 47.3 151.3 26.63 13.21 38 0.701 1279K 1554 0.0 0.0 L1 2/2 253.81 MB 0.0 1.4 0.8 0.6 1.4 0.8 0.0 1.7 114.8 114.6 12.72 6.70 4 3.180 1483K 2594 0.0 0.0 L3 19/4 1.17 GB 0.9 5.5 3.4 2.2 5.5 3.3 0.2 1.6 113.0 111.9 50.23 26.34 26 1.932 3314K 3427 0.0 0.0 L4 182/8 9.92 GB 1.0 10.3 5.3 5.0 10.0 5.0 0.8 1.9 114.1 111.7 92.02 49.41 50 1.840 4376K 11K 0.0 0.0 L5 1171/12 96.14 GB 1.0 0.3 0.1 0.2 0.3 0.0 5.4 3.9 200.4 182.6 1.65 1.25 1 1.645 334K 29K 0.0 0.0 Sum 1387/35 109.38 GB 0.0 18.8 9.5 9.2 21.2 11.9 6.3 7.8 104.9 118.3 183.24 96.91 119 1.540 10M 48K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.8 9.5 9.2 21.2 11.9 6.3 7.8 104.9 118.3 183.24 96.91 119 1.540 10M 48K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.8 9.5 9.2 18.5 9.2 0.0 0.0 117.3 115.3 163.96 88.85 85 1.929 10M 48K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 143.8 19.28 8.07 34 0.567 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.5 total, 20.3 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.18 GB write, 1060.00 MB/s write, 18.78 GB read, 939.96 MB/s read, 183.2 seconds Interval compaction: 21.18 GB write, 1069.79 MB/s write, 18.78 GB read, 948.64 MB/s read, 183.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 84, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 84, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 720781 Average: 10.2373 StdDev: 155.56 Min: 1 Median: 1.8138 Max: 40271 Percentiles: P50: 1.81 P75: 2.73 P99: 10.19 P99.9: 1597.53 P99.99: 3761.00 ------------------------------------------------------ [ 0, 1 ] 36081 5.006% 5.006% # ( 1, 2 ] 398492 55.286% 60.292% ########### ( 2, 3 ] 145430 20.177% 80.469% #### ( 3, 4 ] 64132 8.898% 89.366% ## ( 4, 6 ] 57190 7.934% 97.301% ## ( 6, 10 ] 12172 1.689% 98.989% ( 10, 15 ] 2012 0.279% 99.269% ( 15, 22 ] 256 0.036% 99.304% ( 22, 34 ] 14 0.002% 99.306% ( 34, 51 ] 22 0.003% 99.309% ( 51, 76 ] 39 0.005% 99.314% ( 76, 110 ] 62 0.009% 99.323% ( 110, 170 ] 350 0.049% 99.372% ( 170, 250 ] 483 0.067% 99.439% ( 250, 380 ] 580 0.080% 99.519% ( 380, 580 ] 822 0.114% 99.633% ( 580, 870 ] 962 0.133% 99.767% ( 870, 1300 ] 748 0.104% 99.870% ( 1300, 1900 ] 432 0.060% 99.930% ( 1900, 2900 ] 257 0.036% 99.966% ( 2900, 4400 ] 303 0.042% 100.008% ( 4400, 6600 ] 93 0.013% 100.021% ( 6600, 9900 ] 17 0.002% 100.023% ( 9900, 14000 ] 3 0.000% 100.024% ( 14000, 22000 ] 2 0.000% 100.024% ( 22000, 33000 ] 5 0.001% 100.025% ( 33000, 50000 ] 1 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 402835 Average: 10.5737 StdDev: 154.39 Min: 1 Median: 1.9249 Max: 29138 Percentiles: P50: 1.92 P75: 2.91 P99: 9.99 P99.9: 1874.76 P99.99: 4255.12 ------------------------------------------------------ [ 0, 1 ] 9189 2.281% 2.281% ( 1, 2 ] 207840 51.594% 53.875% ########## ( 2, 3 ] 93422 23.191% 77.067% ##### ( 3, 4 ] 39963 9.920% 86.987% ## ( 4, 6 ] 38406 9.534% 96.521% ## ( 6, 10 ] 10003 2.483% 99.004% ( 10, 15 ] 1499 0.372% 99.376% ( 15, 22 ] 210 0.052% 99.428% ( 22, 34 ] 21 0.005% 99.434% ( 34, 51 ] 14 0.003% 99.437% ( 51, 76 ] 25 0.006% 99.443% ( 76, 110 ] 8 0.002% 99.445% ( 110, 170 ] 80 0.020% 99.465% ( 170, 250 ] 109 0.027% 99.492% ( 250, 380 ] 210 0.052% 99.544% ( 380, 580 ] 354 0.088% 99.632% ( 580, 870 ] 480 0.119% 99.751% ( 870, 1300 ] 398 0.099% 99.850% ( 1300, 1900 ] 210 0.052% 99.902% ( 1900, 2900 ] 164 0.041% 99.943% ( 2900, 4400 ] 210 0.052% 99.995% ( 4400, 6600 ] 67 0.017% 100.012% ( 6600, 9900 ] 20 0.005% 100.017% ( 9900, 14000 ] 3 0.001% 100.017% ( 14000, 22000 ] 2 0.000% 100.018% ( 22000, 33000 ] 1 0.000% 100.018% ** Level 2 read latency histogram (micros): Count: 589532 Average: 14.0413 StdDev: 171.18 Min: 1 Median: 1.9627 Max: 21975 Percentiles: P50: 1.96 P75: 3.00 P99: 12.40 P99.9: 1606.12 P99.99: 2248.22 ------------------------------------------------------ [ 0, 1 ] 16968 2.878% 2.878% # ( 1, 2 ] 288562 48.948% 51.826% ########## ( 2, 3 ] 136358 23.130% 74.956% ##### ( 3, 4 ] 61401 10.415% 85.371% ## ( 4, 6 ] 60600 10.279% 95.650% ## ( 6, 10 ] 18100 3.070% 98.721% # ( 10, 15 ] 3430 0.582% 99.302% ( 15, 22 ] 594 0.101% 99.403% ( 22, 34 ] 86 0.015% 99.418% ( 34, 51 ] 44 0.007% 99.425% ( 51, 76 ] 28 0.005% 99.430% ( 76, 110 ] 19 0.003% 99.433% ( 110, 170 ] 49 0.008% 99.441% ( 170, 250 ] 106 0.018% 99.459% ( 250, 380 ] 228 0.039% 99.498% ( 380, 580 ] 429 0.073% 99.571% ( 580, 870 ] 742 0.126% 99.697% ( 870, 1300 ] 850 0.144% 99.841% ( 1300, 1900 ] 683 0.116% 99.957% ( 1900, 2900 ] 563 0.095% 100.052% ( 2900, 4400 ] 436 0.074% 100.126% ( 4400, 6600 ] 131 0.022% 100.148% ( 6600, 9900 ] 23 0.004% 100.152% ( 9900, 14000 ] 2 0.000% 100.153% ( 14000, 22000 ] 2 0.000% 100.153% ** Level 3 read latency histogram (micros): Count: 1911552 Average: 10.6846 StdDev: 162.92 Min: 1 Median: 1.9443 Max: 39926 Percentiles: P50: 1.94 P75: 2.95 P99: 9.80 P99.9: 940.57 P99.99: 1460.44 ------------------------------------------------------ [ 0, 1 ] 40637 2.126% 2.126% ( 1, 2 ] 969114 50.698% 52.824% ########## ( 2, 3 ] 447306 23.400% 76.224% ##### ( 3, 4 ] 194772 10.189% 86.413% ## ( 4, 6 ] 191642 10.025% 96.438% ## ( 6, 10 ] 51603 2.700% 99.138% # ( 10, 15 ] 8355 0.437% 99.575% ( 15, 22 ] 1194 0.062% 99.638% ( 22, 34 ] 105 0.005% 99.643% ( 34, 51 ] 112 0.006% 99.649% ( 51, 76 ] 177 0.009% 99.658% ( 76, 110 ] 74 0.004% 99.662% ( 110, 170 ] 206 0.011% 99.673% ( 170, 250 ] 353 0.018% 99.691% ( 250, 380 ] 657 0.034% 99.726% ( 380, 580 ] 1241 0.065% 99.791% ( 580, 870 ] 1810 0.095% 99.885% ( 870, 1300 ] 1721 0.090% 99.975% ( 1300, 1900 ] 1054 0.055% 100.030% ( 1900, 2900 ] 906 0.047% 100.078% ( 2900, 4400 ] 1062 0.056% 100.133% ( 4400, 6600 ] 376 0.020% 100.153% ( 6600, 9900 ] 96 0.005% 100.158% ( 9900, 14000 ] 19 0.001% 100.159% ( 14000, 22000 ] 11 0.001% 100.160% ( 22000, 33000 ] 3 0.000% 100.160% ( 33000, 50000 ] 2 0.000% 100.160% ** Level 4 read latency histogram (micros): Count: 1576585 Average: 17.4962 StdDev: 223.74 Min: 1 Median: 1.9655 Max: 53061 Percentiles: P50: 1.97 P75: 3.00 P99: 21.08 P99.9: 1672.79 P99.99: 2523.70 ------------------------------------------------------ [ 0, 1 ] 31093 1.972% 1.972% ( 1, 2 ] 784264 49.744% 51.717% ########## ( 2, 3 ] 368890 23.398% 75.115% ##### ( 3, 4 ] 164572 10.439% 85.553% ## ( 4, 6 ] 160620 10.188% 95.741% ## ( 6, 10 ] 43405 2.753% 98.494% # ( 10, 15 ] 7199 0.457% 98.951% ( 15, 22 ] 894 0.057% 99.007% ( 22, 34 ] 82 0.005% 99.013% ( 34, 51 ] 118 0.007% 99.020% ( 51, 76 ] 206 0.013% 99.033% ( 76, 110 ] 160 0.010% 99.043% ( 110, 170 ] 718 0.046% 99.089% ( 170, 250 ] 1045 0.066% 99.155% ( 250, 380 ] 1518 0.096% 99.251% ( 380, 580 ] 2609 0.165% 99.417% ( 580, 870 ] 3488 0.221% 99.638% ( 870, 1300 ] 3101 0.197% 99.835% ( 1300, 1900 ] 1652 0.105% 99.940% ( 1900, 2900 ] 1272 0.081% 100.020% ( 2900, 4400 ] 1416 0.090% 100.110% ( 4400, 6600 ] 536 0.034% 100.144% ( 6600, 9900 ] 102 0.006% 100.151% ( 9900, 14000 ] 10 0.001% 100.151% ( 14000, 22000 ] 19 0.001% 100.152% ( 22000, 33000 ] 14 0.001% 100.153% ( 33000, 50000 ] 2 0.000% 100.153% ( 50000, 75000 ] 1 0.000% 100.154% ** Level 5 read latency histogram (micros): Count: 52948 Average: 1127.9936 StdDev: 1353.94 Min: 1 Median: 719.2726 Max: 49004 Percentiles: P50: 719.27 P75: 1266.99 P99: 6180.71 P99.9: 9587.07 P99.99: 31417.47 ------------------------------------------------------ [ 0, 1 ] 4 0.008% 0.008% ( 1, 2 ] 6 0.011% 0.019% ( 2, 3 ] 7 0.013% 0.032% ( 3, 4 ] 2 0.004% 0.036% ( 76, 110 ] 467 0.882% 0.918% ( 110, 170 ] 2858 5.398% 6.316% # ( 170, 250 ] 3920 7.403% 13.719% # ( 250, 380 ] 5509 10.405% 24.124% ## ( 380, 580 ] 8716 16.461% 40.585% ### ( 580, 870 ] 10380 19.604% 60.189% #### ( 870, 1300 ] 8494 16.042% 76.231% ### ( 1300, 1900 ] 4438 8.382% 84.613% ## ( 1900, 2900 ] 3060 5.779% 90.392% # ( 2900, 4400 ] 3464 6.542% 96.935% # ( 4400, 6600 ] 1351 2.552% 99.486% # ( 6600, 9900 ] 242 0.457% 99.943% ( 9900, 14000 ] 11 0.021% 99.964% ( 14000, 22000 ] 6 0.011% 99.975% ( 22000, 33000 ] 9 0.017% 99.992% ( 33000, 50000 ] 8 0.015% 100.008% ** DB Stats ** Uptime(secs): 20.5 total, 4.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 144.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.459 H:M:S, 41.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 240.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.341 H:M:S, 8.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/12/15-12:54:22 ... thread 0: (1000000,4000000) ops and (174005.0,153757.0) ops/second in (5.746960,26.015083) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/12 1.97 GB 0.0 2.2 0.0 2.2 5.9 3.7 0.0 1.6 59.4 163.0 37.09 20.18 54 0.687 2238K 2674 0.0 0.0 L1 8/7 745.76 MB 0.0 2.7 1.8 0.8 2.6 1.8 0.0 1.5 134.0 133.5 20.31 12.60 5 4.062 2763K 8852 0.0 0.0 L2 1/1 128.78 MB 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/5 1.28 GB 0.9 6.2 3.7 2.4 6.1 3.7 0.2 1.6 116.9 115.8 53.89 29.22 29 1.858 3943K 5973 0.0 0.0 L4 178/11 9.73 GB 0.9 10.8 5.5 5.3 10.6 5.3 0.8 1.9 114.7 112.2 96.53 52.05 54 1.788 4819K 16K 0.0 0.0 L5 1186/0 96.14 GB 1.0 4.4 0.5 3.9 4.0 0.0 5.4 7.8 150.4 134.8 30.27 18.14 9 3.364 2768K 262K 0.0 0.0 Sum 1405/36 109.97 GB 0.0 26.2 11.6 14.6 29.2 14.6 7.5 7.8 112.8 125.6 238.10 132.18 151 1.577 16M 296K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.2 11.6 14.6 29.2 14.6 7.5 7.8 112.8 125.6 238.10 132.18 151 1.577 16M 296K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.2 11.6 14.6 25.5 10.8 0.0 0.0 126.0 122.3 213.10 121.02 104 2.049 16M 296K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 153.7 25.00 11.16 47 0.532 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.2 total, 26.0 interval Flush(GB): cumulative 3.752, interval 3.752 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.21 GB write, 1141.43 MB/s write, 26.22 GB read, 1024.69 MB/s read, 238.1 seconds Interval compaction: 29.21 GB write, 1149.65 MB/s write, 26.22 GB read, 1032.06 MB/s read, 238.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 100, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 100, interval: 100 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1051661 Average: 11.4090 StdDev: 152.18 Min: 0 Median: 1.8358 Max: 40271 Percentiles: P50: 1.84 P75: 2.79 P99: 80.16 P99.9: 1635.73 P99.99: 3613.43 ------------------------------------------------------ [ 0, 1 ] 49471 4.704% 4.704% # ( 1, 2 ] 569969 54.197% 58.901% ########### ( 2, 3 ] 215164 20.459% 79.361% #### ( 3, 4 ] 97542 9.275% 88.636% ## ( 4, 6 ] 87251 8.296% 96.932% ## ( 6, 10 ] 18263 1.737% 98.669% ( 10, 15 ] 2968 0.282% 98.951% ( 15, 22 ] 391 0.037% 98.988% ( 22, 34 ] 21 0.002% 98.990% ( 34, 51 ] 26 0.002% 98.993% ( 51, 76 ] 51 0.005% 98.997% ( 76, 110 ] 224 0.021% 99.019% ( 110, 170 ] 1146 0.109% 99.128% ( 170, 250 ] 1431 0.136% 99.264% ( 250, 380 ] 1480 0.141% 99.404% ( 380, 580 ] 1844 0.175% 99.580% ( 580, 870 ] 1731 0.165% 99.744% ( 870, 1300 ] 1262 0.120% 99.864% ( 1300, 1900 ] 669 0.064% 99.928% ( 1900, 2900 ] 434 0.041% 99.969% ( 2900, 4400 ] 458 0.044% 100.013% ( 4400, 6600 ] 116 0.011% 100.024% ( 6600, 9900 ] 18 0.002% 100.026% ( 9900, 14000 ] 5 0.000% 100.026% ( 14000, 22000 ] 4 0.000% 100.026% ( 22000, 33000 ] 6 0.001% 100.027% ( 33000, 50000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 532247 Average: 9.8467 StdDev: 147.36 Min: 1 Median: 1.8901 Max: 29138 Percentiles: P50: 1.89 P75: 2.85 P99: 9.93 P99.9: 1611.50 P99.99: 3892.25 ------------------------------------------------------ [ 0, 1 ] 14048 2.639% 2.639% # ( 1, 2 ] 283201 53.209% 55.848% ########### ( 2, 3 ] 120244 22.592% 78.440% ##### ( 3, 4 ] 49616 9.322% 87.762% ## ( 4, 6 ] 47052 8.840% 96.602% ## ( 6, 10 ] 12998 2.442% 99.044% ( 10, 15 ] 1843 0.346% 99.390% ( 15, 22 ] 278 0.052% 99.443% ( 22, 34 ] 26 0.005% 99.447% ( 34, 51 ] 16 0.003% 99.450% ( 51, 76 ] 28 0.005% 99.456% ( 76, 110 ] 20 0.004% 99.459% ( 110, 170 ] 167 0.031% 99.491% ( 170, 250 ] 195 0.037% 99.527% ( 250, 380 ] 304 0.057% 99.585% ( 380, 580 ] 465 0.087% 99.672% ( 580, 870 ] 603 0.113% 99.785% ( 870, 1300 ] 482 0.091% 99.876% ( 1300, 1900 ] 248 0.047% 99.922% ( 1900, 2900 ] 203 0.038% 99.961% ( 2900, 4400 ] 237 0.045% 100.005% ( 4400, 6600 ] 75 0.014% 100.019% ( 6600, 9900 ] 22 0.004% 100.023% ( 9900, 14000 ] 3 0.001% 100.024% ( 14000, 22000 ] 4 0.001% 100.025% ( 22000, 33000 ] 1 0.000% 100.025% ** Level 2 read latency histogram (micros): Count: 589532 Average: 14.0413 StdDev: 171.18 Min: 1 Median: 1.9627 Max: 21975 Percentiles: P50: 1.96 P75: 3.00 P99: 12.40 P99.9: 1606.12 P99.99: 2248.22 ------------------------------------------------------ [ 0, 1 ] 16968 2.878% 2.878% # ( 1, 2 ] 288562 48.948% 51.826% ########## ( 2, 3 ] 136358 23.130% 74.956% ##### ( 3, 4 ] 61401 10.415% 85.371% ## ( 4, 6 ] 60600 10.279% 95.650% ## ( 6, 10 ] 18100 3.070% 98.721% # ( 10, 15 ] 3430 0.582% 99.302% ( 15, 22 ] 594 0.101% 99.403% ( 22, 34 ] 86 0.015% 99.418% ( 34, 51 ] 44 0.007% 99.425% ( 51, 76 ] 28 0.005% 99.430% ( 76, 110 ] 19 0.003% 99.433% ( 110, 170 ] 49 0.008% 99.441% ( 170, 250 ] 106 0.018% 99.459% ( 250, 380 ] 228 0.039% 99.498% ( 380, 580 ] 429 0.073% 99.571% ( 580, 870 ] 742 0.126% 99.697% ( 870, 1300 ] 850 0.144% 99.841% ( 1300, 1900 ] 683 0.116% 99.957% ( 1900, 2900 ] 563 0.095% 100.052% ( 2900, 4400 ] 436 0.074% 100.126% ( 4400, 6600 ] 131 0.022% 100.148% ( 6600, 9900 ] 23 0.004% 100.152% ( 9900, 14000 ] 2 0.000% 100.153% ( 14000, 22000 ] 2 0.000% 100.153% ** Level 3 read latency histogram (micros): Count: 2064150 Average: 10.5265 StdDev: 159.50 Min: 1 Median: 1.9368 Max: 39926 Percentiles: P50: 1.94 P75: 2.93 P99: 9.81 P99.9: 950.52 P99.99: 1485.39 ------------------------------------------------------ [ 0, 1 ] 45771 2.217% 2.217% ( 1, 2 ] 1052885 51.008% 53.226% ########## ( 2, 3 ] 481399 23.322% 76.547% ##### ( 3, 4 ] 207744 10.064% 86.612% ## ( 4, 6 ] 203422 9.855% 96.467% ## ( 6, 10 ] 54932 2.661% 99.128% # ( 10, 15 ] 8739 0.423% 99.551% ( 15, 22 ] 1265 0.061% 99.613% ( 22, 34 ] 109 0.005% 99.618% ( 34, 51 ] 117 0.006% 99.624% ( 51, 76 ] 191 0.009% 99.633% ( 76, 110 ] 90 0.004% 99.637% ( 110, 170 ] 340 0.016% 99.654% ( 170, 250 ] 490 0.024% 99.678% ( 250, 380 ] 792 0.038% 99.716% ( 380, 580 ] 1429 0.069% 99.785% ( 580, 870 ] 2023 0.098% 99.883% ( 870, 1300 ] 1863 0.090% 99.973% ( 1300, 1900 ] 1112 0.054% 100.027% ( 1900, 2900 ] 964 0.047% 100.074% ( 2900, 4400 ] 1094 0.053% 100.127% ( 4400, 6600 ] 381 0.018% 100.145% ( 6600, 9900 ] 97 0.005% 100.150% ( 9900, 14000 ] 20 0.001% 100.151% ( 14000, 22000 ] 12 0.001% 100.152% ( 22000, 33000 ] 3 0.000% 100.152% ( 33000, 50000 ] 2 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 2025355 Average: 17.3359 StdDev: 215.82 Min: 1 Median: 1.9714 Max: 53061 Percentiles: P50: 1.97 P75: 3.01 P99: 111.86 P99.9: 1722.18 P99.99: 2597.54 ------------------------------------------------------ [ 0, 1 ] 40412 1.995% 1.995% ( 1, 2 ] 1000925 49.420% 51.415% ########## ( 2, 3 ] 476071 23.506% 74.921% ##### ( 3, 4 ] 214432 10.587% 85.508% ## ( 4, 6 ] 206993 10.220% 95.728% ## ( 6, 10 ] 55170 2.724% 98.452% # ( 10, 15 ] 9172 0.453% 98.905% ( 15, 22 ] 1166 0.058% 98.962% ( 22, 34 ] 103 0.005% 98.968% ( 34, 51 ] 144 0.007% 98.975% ( 51, 76 ] 237 0.012% 98.986% ( 76, 110 ] 242 0.012% 98.998% ( 110, 170 ] 1143 0.056% 99.055% ( 170, 250 ] 1609 0.079% 99.134% ( 250, 380 ] 2202 0.109% 99.243% ( 380, 580 ] 3482 0.172% 99.415% ( 580, 870 ] 4486 0.221% 99.636% ( 870, 1300 ] 3864 0.191% 99.827% ( 1300, 1900 ] 2100 0.104% 99.931% ( 1900, 2900 ] 1721 0.085% 100.016% ( 2900, 4400 ] 1848 0.091% 100.107% ( 4400, 6600 ] 610 0.030% 100.137% ( 6600, 9900 ] 114 0.006% 100.143% ( 9900, 14000 ] 15 0.001% 100.143% ( 14000, 22000 ] 22 0.001% 100.145% ( 22000, 33000 ] 15 0.001% 100.145% ( 33000, 50000 ] 2 0.000% 100.145% ( 50000, 75000 ] 1 0.000% 100.145% ** Level 5 read latency histogram (micros): Count: 536269 Average: 153.5773 StdDev: 606.90 Min: 0 Median: 2.2985 Max: 49004 Percentiles: P50: 2.30 P75: 4.20 P99: 3067.97 P99.9: 5318.66 P99.99: 6006.36 ------------------------------------------------------ [ 0, 1 ] 9911 1.848% 1.848% ( 1, 2 ] 225494 42.049% 43.897% ######## ( 2, 3 ] 109629 20.443% 64.340% #### ( 3, 4 ] 52274 9.748% 74.087% ## ( 4, 6 ] 48492 9.042% 83.130% ## ( 6, 10 ] 12220 2.279% 85.409% ( 10, 15 ] 2083 0.388% 85.797% ( 15, 22 ] 291 0.054% 85.851% ( 22, 34 ] 28 0.005% 85.857% ( 34, 51 ] 30 0.006% 85.862% ( 51, 76 ] 58 0.011% 85.873% ( 76, 110 ] 793 0.148% 86.021% ( 110, 170 ] 4963 0.925% 86.946% ( 170, 250 ] 6709 1.251% 88.197% ( 250, 380 ] 8543 1.593% 89.790% ( 380, 580 ] 12542 2.339% 92.129% ( 580, 870 ] 14339 2.674% 94.803% # ( 870, 1300 ] 11500 2.144% 96.947% ( 1300, 1900 ] 5994 1.118% 98.065% ( 1900, 2900 ] 4486 0.837% 98.902% ( 2900, 4400 ] 4709 0.878% 99.780% ( 4400, 6600 ] 1544 0.288% 100.068% ( 6600, 9900 ] 268 0.050% 100.118% ( 9900, 14000 ] 23 0.004% 100.122% ( 14000, 22000 ] 12 0.002% 100.124% ( 22000, 33000 ] 12 0.002% 100.126% ( 33000, 50000 ] 8 0.001% 100.128% ** DB Stats ** Uptime(secs): 26.2 total, 5.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 150.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.343 H:M:S, 39.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 171.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.884 H:M:S, 32.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/15-12:54:27 ... thread 0: (1000000,5000000) ops and (216350.9,163200.3) ops/second in (4.622121,30.637204) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.89 GB 94.4 3.0 0.0 3.0 7.6 4.7 0.0 1.6 67.4 174.0 44.87 26.01 70 0.641 3070K 3526 0.0 0.0 L1 8/7 745.76 MB 0.0 2.7 1.8 0.8 2.6 1.8 0.0 1.5 134.0 133.5 20.31 12.60 5 4.062 2763K 8852 0.0 0.0 L3 16/0 952.22 MB 1.0 6.4 3.9 2.5 6.3 3.8 0.2 1.6 118.9 117.8 55.13 30.35 30 1.838 4203K 7070 0.0 0.0 L4 183/7 10.17 GB 1.0 12.7 6.0 6.7 12.5 5.7 0.8 2.1 120.7 118.1 108.10 61.08 61 1.772 6602K 24K 0.0 0.0 L5 1186/41 96.14 GB 0.9 4.4 0.5 3.9 4.0 0.0 5.4 7.8 150.4 134.8 30.27 18.14 9 3.364 2768K 262K 0.0 0.0 Sum 1409/67 110.86 GB 0.0 29.2 12.2 17.0 33.1 16.1 6.3 7.1 115.6 130.9 258.68 148.18 175 1.478 19M 305K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.2 12.2 17.0 33.1 16.1 6.3 7.1 115.6 130.9 258.68 148.18 175 1.478 19M 305K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.2 12.2 17.0 28.4 11.4 0.0 0.0 130.4 126.8 229.31 134.43 115 1.994 19M 305K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 163.0 29.37 13.75 60 0.489 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.8 total, 30.6 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.07 GB write, 1098.52 MB/s write, 29.19 GB read, 969.79 MB/s read, 258.7 seconds Interval compaction: 33.07 GB write, 1105.23 MB/s write, 29.19 GB read, 975.72 MB/s read, 258.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 105, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 105, interval: 105 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1273696 Average: 14.6974 StdDev: 165.08 Min: 0 Median: 1.8299 Max: 40271 Percentiles: P50: 1.83 P75: 2.78 P99: 298.26 P99.9: 2091.34 P99.99: 3916.10 ------------------------------------------------------ [ 0, 1 ] 61847 4.856% 4.856% # ( 1, 2 ] 692826 54.395% 59.251% ########### ( 2, 3 ] 256024 20.101% 79.352% #### ( 3, 4 ] 116753 9.166% 88.518% ## ( 4, 6 ] 103508 8.127% 96.645% ## ( 6, 10 ] 20276 1.592% 98.236% ( 10, 15 ] 3426 0.269% 98.505% ( 15, 22 ] 416 0.033% 98.538% ( 22, 34 ] 24 0.002% 98.540% ( 34, 51 ] 30 0.002% 98.542% ( 51, 76 ] 54 0.004% 98.547% ( 76, 110 ] 367 0.029% 98.575% ( 110, 170 ] 2034 0.160% 98.735% ( 170, 250 ] 2414 0.190% 98.925% ( 250, 380 ] 2586 0.203% 99.128% ( 380, 580 ] 3239 0.254% 99.382% ( 580, 870 ] 3113 0.244% 99.626% ( 870, 1300 ] 2222 0.174% 99.801% ( 1300, 1900 ] 1111 0.087% 99.888% ( 1900, 2900 ] 796 0.062% 99.951% ( 2900, 4400 ] 742 0.058% 100.009% ( 4400, 6600 ] 161 0.013% 100.021% ( 6600, 9900 ] 21 0.002% 100.023% ( 9900, 14000 ] 6 0.000% 100.024% ( 14000, 22000 ] 4 0.000% 100.024% ( 22000, 33000 ] 6 0.000% 100.024% ( 33000, 50000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 532521 Average: 10.1934 StdDev: 149.25 Min: 1 Median: 1.8906 Max: 29138 Percentiles: P50: 1.89 P75: 2.85 P99: 10.09 P99.9: 1666.49 P99.99: 3920.91 ------------------------------------------------------ [ 0, 1 ] 14048 2.638% 2.638% # ( 1, 2 ] 283203 53.182% 55.820% ########### ( 2, 3 ] 120246 22.581% 78.400% ##### ( 3, 4 ] 49616 9.317% 87.717% ## ( 4, 6 ] 47053 8.836% 96.553% ## ( 6, 10 ] 12998 2.441% 98.994% ( 10, 15 ] 1843 0.346% 99.340% ( 15, 22 ] 278 0.052% 99.392% ( 22, 34 ] 26 0.005% 99.397% ( 34, 51 ] 16 0.003% 99.400% ( 51, 76 ] 28 0.005% 99.405% ( 76, 110 ] 24 0.005% 99.410% ( 110, 170 ] 209 0.039% 99.449% ( 170, 250 ] 236 0.044% 99.494% ( 250, 380 ] 336 0.063% 99.557% ( 380, 580 ] 506 0.095% 99.652% ( 580, 870 ] 651 0.122% 99.774% ( 870, 1300 ] 509 0.096% 99.869% ( 1300, 1900 ] 266 0.050% 99.919% ( 1900, 2900 ] 209 0.039% 99.959% ( 2900, 4400 ] 245 0.046% 100.005% ( 4400, 6600 ] 77 0.014% 100.019% ( 6600, 9900 ] 22 0.004% 100.023% ( 9900, 14000 ] 3 0.001% 100.024% ( 14000, 22000 ] 4 0.001% 100.025% ( 22000, 33000 ] 1 0.000% 100.025% ** Level 2 read latency histogram (micros): Count: 589532 Average: 14.0413 StdDev: 171.18 Min: 1 Median: 1.9627 Max: 21975 Percentiles: P50: 1.96 P75: 3.00 P99: 12.40 P99.9: 1606.12 P99.99: 2248.22 ------------------------------------------------------ [ 0, 1 ] 16968 2.878% 2.878% # ( 1, 2 ] 288562 48.948% 51.826% ########## ( 2, 3 ] 136358 23.130% 74.956% ##### ( 3, 4 ] 61401 10.415% 85.371% ## ( 4, 6 ] 60600 10.279% 95.650% ## ( 6, 10 ] 18100 3.070% 98.721% # ( 10, 15 ] 3430 0.582% 99.302% ( 15, 22 ] 594 0.101% 99.403% ( 22, 34 ] 86 0.015% 99.418% ( 34, 51 ] 44 0.007% 99.425% ( 51, 76 ] 28 0.005% 99.430% ( 76, 110 ] 19 0.003% 99.433% ( 110, 170 ] 49 0.008% 99.441% ( 170, 250 ] 106 0.018% 99.459% ( 250, 380 ] 228 0.039% 99.498% ( 380, 580 ] 429 0.073% 99.571% ( 580, 870 ] 742 0.126% 99.697% ( 870, 1300 ] 850 0.144% 99.841% ( 1300, 1900 ] 683 0.116% 99.957% ( 1900, 2900 ] 563 0.095% 100.052% ( 2900, 4400 ] 436 0.074% 100.126% ( 4400, 6600 ] 131 0.022% 100.148% ( 6600, 9900 ] 23 0.004% 100.152% ( 9900, 14000 ] 2 0.000% 100.153% ( 14000, 22000 ] 2 0.000% 100.153% ** Level 3 read latency histogram (micros): Count: 2181834 Average: 10.3245 StdDev: 156.45 Min: 1 Median: 1.9326 Max: 39926 Percentiles: P50: 1.93 P75: 2.93 P99: 9.79 P99.9: 947.57 P99.99: 1494.85 ------------------------------------------------------ [ 0, 1 ] 48900 2.241% 2.241% ( 1, 2 ] 1117372 51.213% 53.454% ########## ( 2, 3 ] 507852 23.276% 76.730% ##### ( 3, 4 ] 218572 10.018% 86.748% ## ( 4, 6 ] 213302 9.776% 96.524% ## ( 6, 10 ] 57026 2.614% 99.138% # ( 10, 15 ] 9020 0.413% 99.551% ( 15, 22 ] 1295 0.059% 99.611% ( 22, 34 ] 116 0.005% 99.616% ( 34, 51 ] 122 0.006% 99.622% ( 51, 76 ] 200 0.009% 99.631% ( 76, 110 ] 100 0.005% 99.635% ( 110, 170 ] 385 0.018% 99.653% ( 170, 250 ] 545 0.025% 99.678% ( 250, 380 ] 843 0.039% 99.717% ( 380, 580 ] 1520 0.070% 99.786% ( 580, 870 ] 2132 0.098% 99.884% ( 870, 1300 ] 1941 0.089% 99.973% ( 1300, 1900 ] 1148 0.053% 100.026% ( 1900, 2900 ] 995 0.046% 100.071% ( 2900, 4400 ] 1115 0.051% 100.122% ( 4400, 6600 ] 385 0.018% 100.140% ( 6600, 9900 ] 98 0.004% 100.144% ( 9900, 14000 ] 20 0.001% 100.145% ( 14000, 22000 ] 12 0.001% 100.146% ( 22000, 33000 ] 3 0.000% 100.146% ( 33000, 50000 ] 2 0.000% 100.146% ** Level 4 read latency histogram (micros): Count: 2437375 Average: 16.3644 StdDev: 203.65 Min: 1 Median: 1.9620 Max: 53061 Percentiles: P50: 1.96 P75: 2.98 P99: 85.93 P99.9: 1568.81 P99.99: 2366.25 ------------------------------------------------------ [ 0, 1 ] 48569 1.993% 1.993% ( 1, 2 ] 1216385 49.906% 51.898% ########## ( 2, 3 ] 572022 23.469% 75.367% ##### ( 3, 4 ] 254298 10.433% 85.800% ## ( 4, 6 ] 244261 10.021% 95.822% ## ( 6, 10 ] 64885 2.662% 98.484% # ( 10, 15 ] 10556 0.433% 98.917% ( 15, 22 ] 1299 0.053% 98.970% ( 22, 34 ] 121 0.005% 98.975% ( 34, 51 ] 214 0.009% 98.984% ( 51, 76 ] 294 0.012% 98.996% ( 76, 110 ] 333 0.014% 99.010% ( 110, 170 ] 1523 0.062% 99.072% ( 170, 250 ] 2169 0.089% 99.161% ( 250, 380 ] 2908 0.119% 99.280% ( 380, 580 ] 4356 0.179% 99.459% ( 580, 870 ] 5307 0.218% 99.677% ( 870, 1300 ] 4383 0.180% 99.857% ( 1300, 1900 ] 2354 0.097% 99.953% ( 1900, 2900 ] 1918 0.079% 100.032% ( 2900, 4400 ] 2015 0.083% 100.115% ( 4400, 6600 ] 637 0.026% 100.141% ( 6600, 9900 ] 119 0.005% 100.146% ( 9900, 14000 ] 15 0.001% 100.146% ( 14000, 22000 ] 26 0.001% 100.147% ( 22000, 33000 ] 15 0.001% 100.148% ( 33000, 50000 ] 2 0.000% 100.148% ( 50000, 75000 ] 1 0.000% 100.148% ** Level 5 read latency histogram (micros): Count: 1058631 Average: 96.0918 StdDev: 470.63 Min: 0 Median: 2.1739 Max: 49004 Percentiles: P50: 2.17 P75: 3.67 P99: 1969.30 P99.9: 4017.56 P99.99: 4269.44 ------------------------------------------------------ [ 0, 1 ] 21729 2.053% 2.053% ( 1, 2 ] 467548 44.165% 46.218% ######### ( 2, 3 ] 230283 21.753% 67.971% #### ( 3, 4 ] 111160 10.500% 78.471% ## ( 4, 6 ] 102300 9.663% 88.135% ## ( 6, 10 ] 25622 2.420% 90.555% ( 10, 15 ] 4491 0.424% 90.979% ( 15, 22 ] 606 0.057% 91.036% ( 22, 34 ] 60 0.006% 91.042% ( 34, 51 ] 73 0.007% 91.049% ( 51, 76 ] 108 0.010% 91.059% ( 76, 110 ] 1090 0.103% 91.162% ( 110, 170 ] 6981 0.659% 91.822% ( 170, 250 ] 9120 0.861% 92.683% ( 250, 380 ] 11213 1.059% 93.742% ( 380, 580 ] 15975 1.509% 95.251% ( 580, 870 ] 17837 1.685% 96.936% ( 870, 1300 ] 14099 1.332% 98.268% ( 1300, 1900 ] 7357 0.695% 98.963% ( 1900, 2900 ] 5695 0.538% 99.501% ( 2900, 4400 ] 5674 0.536% 100.037% ( 4400, 6600 ] 1720 0.162% 100.199% ( 6600, 9900 ] 283 0.027% 100.226% ( 9900, 14000 ] 27 0.003% 100.229% ( 14000, 22000 ] 13 0.001% 100.230% ( 22000, 33000 ] 12 0.001% 100.231% ( 33000, 50000 ] 8 0.001% 100.232% ** DB Stats ** Uptime(secs): 30.8 total, 4.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 159.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.164 H:M:S, 36.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 212.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.821 H:M:S, 17.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/12/15-12:54:32 ... thread 0: (1000000,6000000) ops and (182571.2,166138.2) ops/second in (5.477316,36.114520) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 3.87 GB 226.6 4.1 0.0 4.1 9.7 5.7 0.0 1.7 77.5 185.5 53.62 33.15 89 0.602 4221K 4763 0.0 0.0 L1 8/7 745.76 MB 0.0 2.7 1.8 0.8 2.6 1.8 0.0 1.5 134.0 133.5 20.31 12.60 5 4.062 2763K 8852 0.0 0.0 L3 16/0 952.22 MB 1.0 6.4 3.9 2.5 6.3 3.8 0.2 1.6 118.9 117.8 55.13 30.35 30 1.838 4203K 7070 0.0 0.0 L4 176/0 9.75 GB 1.0 12.7 6.0 6.7 12.5 5.7 0.8 2.1 120.7 118.1 108.10 61.08 61 1.772 6602K 24K 0.0 0.0 L5 1200/0 96.14 GB 1.0 8.3 0.9 7.3 7.4 0.0 5.4 7.9 151.5 135.2 55.80 33.48 16 3.487 3214K 262K 0.0 0.0 Sum 1419/15 111.41 GB 0.0 34.1 12.6 21.5 38.5 17.0 6.3 6.8 119.2 134.7 292.96 170.66 201 1.458 21M 306K 0.0 0.0 Int 0/0 0.00 KB 0.0 34.1 12.6 21.5 38.5 17.0 6.3 6.8 119.2 134.7 292.96 170.66 201 1.458 21M 306K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 34.1 12.6 21.5 32.9 11.4 0.0 0.0 134.6 129.8 259.49 154.06 126 2.059 21M 306K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 173.1 33.47 16.61 75 0.446 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.3 total, 36.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.54 GB write, 1087.18 MB/s write, 34.11 GB read, 962.21 MB/s read, 293.0 seconds Interval compaction: 38.54 GB write, 1092.82 MB/s write, 34.11 GB read, 967.20 MB/s read, 293.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 107, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 107, interval: 113 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1585258 Average: 16.9556 StdDev: 160.65 Min: 0 Median: 1.7808 Max: 40271 Percentiles: P50: 1.78 P75: 2.73 P99: 344.45 P99.9: 1908.98 P99.99: 3669.98 ------------------------------------------------------ [ 0, 1 ] 123551 7.794% 7.794% ## ( 1, 2 ] 856869 54.052% 61.846% ########### ( 2, 3 ] 286474 18.071% 79.917% #### ( 3, 4 ] 130459 8.230% 88.147% ## ( 4, 6 ] 113810 7.179% 95.326% # ( 6, 10 ] 21973 1.386% 96.712% ( 10, 15 ] 3936 0.248% 96.960% ( 15, 22 ] 464 0.029% 96.990% ( 22, 34 ] 28 0.002% 96.991% ( 34, 51 ] 33 0.002% 96.993% ( 51, 76 ] 57 0.004% 96.997% ( 76, 110 ] 4162 0.263% 97.260% ( 110, 170 ] 16748 1.056% 98.316% ( 170, 250 ] 7673 0.484% 98.800% ( 250, 380 ] 4361 0.275% 99.075% ( 380, 580 ] 4821 0.304% 99.379% ( 580, 870 ] 4050 0.255% 99.635% ( 870, 1300 ] 2793 0.176% 99.811% ( 1300, 1900 ] 1402 0.088% 99.899% ( 1900, 2900 ] 974 0.061% 99.961% ( 2900, 4400 ] 899 0.057% 100.018% ( 4400, 6600 ] 180 0.011% 100.029% ( 6600, 9900 ] 22 0.001% 100.030% ( 9900, 14000 ] 6 0.000% 100.031% ( 14000, 22000 ] 4 0.000% 100.031% ( 22000, 33000 ] 6 0.000% 100.031% ( 33000, 50000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 533427 Average: 10.5894 StdDev: 150.00 Min: 1 Median: 1.8922 Max: 29138 Percentiles: P50: 1.89 P75: 2.86 P99: 12.52 P99.9: 1688.72 P99.99: 3926.15 ------------------------------------------------------ [ 0, 1 ] 14048 2.634% 2.634% # ( 1, 2 ] 283203 53.091% 55.725% ########### ( 2, 3 ] 120246 22.542% 78.267% ##### ( 3, 4 ] 49616 9.301% 87.568% ## ( 4, 6 ] 47053 8.821% 96.389% ## ( 6, 10 ] 12998 2.437% 98.826% ( 10, 15 ] 1843 0.346% 99.171% ( 15, 22 ] 278 0.052% 99.224% ( 22, 34 ] 26 0.005% 99.228% ( 34, 51 ] 16 0.003% 99.231% ( 51, 76 ] 28 0.005% 99.237% ( 76, 110 ] 126 0.024% 99.260% ( 110, 170 ] 670 0.126% 99.386% ( 170, 250 ] 402 0.075% 99.461% ( 250, 380 ] 393 0.074% 99.535% ( 380, 580 ] 569 0.107% 99.642% ( 580, 870 ] 677 0.127% 99.768% ( 870, 1300 ] 526 0.099% 99.867% ( 1300, 1900 ] 271 0.051% 99.918% ( 1900, 2900 ] 215 0.040% 99.958% ( 2900, 4400 ] 248 0.046% 100.005% ( 4400, 6600 ] 77 0.014% 100.019% ( 6600, 9900 ] 22 0.004% 100.023% ( 9900, 14000 ] 3 0.001% 100.024% ( 14000, 22000 ] 4 0.001% 100.025% ( 22000, 33000 ] 1 0.000% 100.025% ** Level 2 read latency histogram (micros): Count: 589532 Average: 14.0413 StdDev: 171.18 Min: 1 Median: 1.9627 Max: 21975 Percentiles: P50: 1.96 P75: 3.00 P99: 12.40 P99.9: 1606.12 P99.99: 2248.22 ------------------------------------------------------ [ 0, 1 ] 16968 2.878% 2.878% # ( 1, 2 ] 288562 48.948% 51.826% ########## ( 2, 3 ] 136358 23.130% 74.956% ##### ( 3, 4 ] 61401 10.415% 85.371% ## ( 4, 6 ] 60600 10.279% 95.650% ## ( 6, 10 ] 18100 3.070% 98.721% # ( 10, 15 ] 3430 0.582% 99.302% ( 15, 22 ] 594 0.101% 99.403% ( 22, 34 ] 86 0.015% 99.418% ( 34, 51 ] 44 0.007% 99.425% ( 51, 76 ] 28 0.005% 99.430% ( 76, 110 ] 19 0.003% 99.433% ( 110, 170 ] 49 0.008% 99.441% ( 170, 250 ] 106 0.018% 99.459% ( 250, 380 ] 228 0.039% 99.498% ( 380, 580 ] 429 0.073% 99.571% ( 580, 870 ] 742 0.126% 99.697% ( 870, 1300 ] 850 0.144% 99.841% ( 1300, 1900 ] 683 0.116% 99.957% ( 1900, 2900 ] 563 0.095% 100.052% ( 2900, 4400 ] 436 0.074% 100.126% ( 4400, 6600 ] 131 0.022% 100.148% ( 6600, 9900 ] 23 0.004% 100.152% ( 9900, 14000 ] 2 0.000% 100.153% ( 14000, 22000 ] 2 0.000% 100.153% ** Level 3 read latency histogram (micros): Count: 2183293 Average: 10.4854 StdDev: 156.83 Min: 1 Median: 1.9332 Max: 39926 Percentiles: P50: 1.93 P75: 2.93 P99: 9.89 P99.9: 957.60 P99.99: 1506.74 ------------------------------------------------------ [ 0, 1 ] 48900 2.240% 2.240% ( 1, 2 ] 1117372 51.178% 53.418% ########## ( 2, 3 ] 507852 23.261% 76.679% ##### ( 3, 4 ] 218572 10.011% 86.690% ## ( 4, 6 ] 213302 9.770% 96.460% ## ( 6, 10 ] 57026 2.612% 99.072% # ( 10, 15 ] 9020 0.413% 99.485% ( 15, 22 ] 1295 0.059% 99.544% ( 22, 34 ] 116 0.005% 99.549% ( 34, 51 ] 122 0.006% 99.555% ( 51, 76 ] 200 0.009% 99.564% ( 76, 110 ] 290 0.013% 99.577% ( 110, 170 ] 1099 0.050% 99.628% ( 170, 250 ] 840 0.038% 99.666% ( 250, 380 ] 936 0.043% 99.709% ( 380, 580 ] 1593 0.073% 99.782% ( 580, 870 ] 2174 0.100% 99.882% ( 870, 1300 ] 1967 0.090% 99.972% ( 1300, 1900 ] 1157 0.053% 100.025% ( 1900, 2900 ] 1001 0.046% 100.071% ( 2900, 4400 ] 1125 0.052% 100.122% ( 4400, 6600 ] 386 0.018% 100.140% ( 6600, 9900 ] 98 0.004% 100.144% ( 9900, 14000 ] 20 0.001% 100.145% ( 14000, 22000 ] 12 0.001% 100.146% ( 22000, 33000 ] 3 0.000% 100.146% ( 33000, 50000 ] 2 0.000% 100.146% ** Level 4 read latency histogram (micros): Count: 2492597 Average: 16.9961 StdDev: 203.49 Min: 1 Median: 1.9659 Max: 53061 Percentiles: P50: 1.97 P75: 3.00 P99: 188.67 P99.9: 1595.11 P99.99: 2400.88 ------------------------------------------------------ [ 0, 1 ] 49645 1.992% 1.992% ( 1, 2 ] 1238917 49.704% 51.696% ########## ( 2, 3 ] 583314 23.402% 75.097% ##### ( 3, 4 ] 259547 10.413% 85.510% ## ( 4, 6 ] 249350 10.004% 95.514% ## ( 6, 10 ] 66159 2.654% 98.168% # ( 10, 15 ] 10739 0.431% 98.599% ( 15, 22 ] 1329 0.053% 98.652% ( 22, 34 ] 125 0.005% 98.657% ( 34, 51 ] 220 0.009% 98.666% ( 51, 76 ] 300 0.012% 98.678% ( 76, 110 ] 1415 0.057% 98.735% ( 110, 170 ] 5772 0.232% 98.966% ( 170, 250 ] 3596 0.144% 99.111% ( 250, 380 ] 3423 0.137% 99.248% ( 380, 580 ] 4839 0.194% 99.442% ( 580, 870 ] 5631 0.226% 99.668% ( 870, 1300 ] 4570 0.183% 99.851% ( 1300, 1900 ] 2467 0.099% 99.950% ( 1900, 2900 ] 1976 0.079% 100.030% ( 2900, 4400 ] 2072 0.083% 100.113% ( 4400, 6600 ] 643 0.026% 100.138% ( 6600, 9900 ] 120 0.005% 100.143% ( 9900, 14000 ] 15 0.001% 100.144% ( 14000, 22000 ] 26 0.001% 100.145% ( 22000, 33000 ] 15 0.001% 100.146% ( 33000, 50000 ] 2 0.000% 100.146% ( 50000, 75000 ] 1 0.000% 100.146% ** Level 5 read latency histogram (micros): Count: 1480468 Average: 80.2077 StdDev: 412.26 Min: 0 Median: 2.2003 Max: 49004 Percentiles: P50: 2.20 P75: 3.76 P99: 1607.12 P99.9: 3660.54 P99.99: 3986.74 ------------------------------------------------------ [ 0, 1 ] 29358 1.983% 1.983% ( 1, 2 ] 647477 43.735% 45.718% ######### ( 2, 3 ] 316505 21.379% 67.096% #### ( 3, 4 ] 154654 10.446% 77.543% ## ( 4, 6 ] 142031 9.594% 87.136% ## ( 6, 10 ] 35441 2.394% 89.530% ( 10, 15 ] 6140 0.415% 89.945% ( 15, 22 ] 820 0.055% 90.000% ( 22, 34 ] 84 0.006% 90.006% ( 34, 51 ] 86 0.006% 90.012% ( 51, 76 ] 149 0.010% 90.022% ( 76, 110 ] 7789 0.526% 90.548% ( 110, 170 ] 33519 2.264% 92.812% ( 170, 250 ] 18485 1.249% 94.061% ( 250, 380 ] 14666 0.991% 95.051% ( 380, 580 ] 19035 1.286% 96.337% ( 580, 870 ] 19865 1.342% 97.679% ( 870, 1300 ] 15429 1.042% 98.721% ( 1300, 1900 ] 8071 0.545% 99.266% ( 1900, 2900 ] 6278 0.424% 99.690% ( 2900, 4400 ] 6127 0.414% 100.104% ( 4400, 6600 ] 1779 0.120% 100.224% ( 6600, 9900 ] 287 0.019% 100.244% ( 9900, 14000 ] 27 0.002% 100.245% ( 14000, 22000 ] 13 0.001% 100.246% ( 22000, 33000 ] 12 0.001% 100.247% ( 33000, 50000 ] 8 0.001% 100.248% ** DB Stats ** Uptime(secs): 36.3 total, 5.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 162.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.008 H:M:S, 35.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 179.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.843 H:M:S, 33.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 388.519 micros/op 10286 ops/sec 60.174 seconds 618996 operations; 10.0 MB/s (154999 of 154999 found) Microseconds per read: Count: 618996 Average: 388.5238 StdDev: 1027.78 Min: 4 Median: 209.4421 Max: 83582 Percentiles: P50: 209.44 P75: 315.68 P99: 3698.17 P99.9: 15430.96 P99.99: 35919.00 ------------------------------------------------------ ( 3, 4 ] 9 0.001% 0.001% ( 4, 6 ] 46 0.007% 0.009% ( 6, 10 ] 160 0.026% 0.035% ( 10, 15 ] 119 0.019% 0.054% ( 15, 22 ] 409 0.066% 0.120% ( 22, 34 ] 8224 1.329% 1.449% ( 34, 51 ] 5981 0.966% 2.415% ( 51, 76 ] 685 0.111% 2.526% ( 76, 110 ] 244 0.039% 2.565% ( 110, 170 ] 183767 29.688% 32.253% ###### ( 170, 250 ] 222816 35.996% 68.249% ####### ( 250, 380 ] 82705 13.361% 81.610% ### ( 380, 580 ] 43935 7.098% 88.708% # ( 580, 870 ] 27478 4.439% 93.147% # ( 870, 1300 ] 17972 2.903% 96.051% # ( 1300, 1900 ] 9238 1.492% 97.543% ( 1900, 2900 ] 6159 0.995% 98.538% ( 2900, 4400 ] 5373 0.868% 99.406% ( 4400, 6600 ] 1904 0.308% 99.714% ( 6600, 9900 ] 576 0.093% 99.807% ( 9900, 14000 ] 489 0.079% 99.886% ( 14000, 22000 ] 492 0.079% 99.965% ( 22000, 33000 ] 144 0.023% 99.989% ( 33000, 50000 ] 53 0.009% 99.997% ( 50000, 75000 ] 17 0.003% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 11580652 rocksdb.bloom.filter.full.positive COUNT : 731760 rocksdb.bloom.filter.full.true.positive COUNT : 618656 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 340 rocksdb.memtable.miss COUNT : 618656 rocksdb.l0.hit COUNT : 24985 rocksdb.l1.hit COUNT : 4124 rocksdb.l2andup.hit COUNT : 589547 rocksdb.compaction.key.drop.new COUNT : 1288909 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6870319 rocksdb.number.keys.read COUNT : 618996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7090169208 rocksdb.bytes.read COUNT : 618996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1919 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33176279 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 40092753897 rocksdb.compact.write.bytes COUNT : 38766030171 rocksdb.flush.write.bytes COUNT : 7067876780 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 1454 rocksdb.number.superversion_releases COUNT : 1412 rocksdb.number.superversion_cleanups COUNT : 359 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 347 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7011127296 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2932736 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 42961503244 rocksdb.non.last.level.read.count COUNT : 10241688 rocksdb.block.checksum.compute.count COUNT : 10453227 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 208.453579 P95 : 1143.571365 P99 : 3697.086981 P100 : 83580.000000 COUNT : 618996 SUM : 239792309 rocksdb.db.write.micros P50 : 1.573888 P95 : 4.448421 P99 : 8.439480 P100 : 890173.000000 COUNT : 6870319 SUM : 51023032 rocksdb.compaction.times.micros P50 : 1756818.181818 P95 : 4031666.666667 P99 : 7591105.000000 P100 : 7591105.000000 COUNT : 132 SUM : 269253317 rocksdb.compaction.times.cpu_micros P50 : 1137037.037037 P95 : 2747058.823529 P99 : 4150666.666667 P100 : 5898374.000000 COUNT : 132 SUM : 163698341 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1600.000000 P95 : 183333.333333 P99 : 321500.000000 P100 : 355970.000000 COUNT : 90 SUM : 2018329 rocksdb.compaction.outfile.sync.micros P50 : 20761.904762 P95 : 240166.666667 P99 : 372850.000000 P100 : 1061655.000000 COUNT : 499 SUM : 29809742 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 475.000000 P95 : 4219.318182 P99 : 7117.000000 P100 : 8965.000000 COUNT : 253 SUM : 287294 rocksdb.table.open.io.micros P50 : 7775.386100 P95 : 18946.733668 P99 : 22495.000000 P100 : 54553.000000 COUNT : 1919 SUM : 15245103 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.982224 P95 : 9.585909 P99 : 160.846641 P100 : 40277.000000 COUNT : 9710302 SUM : 138722282 rocksdb.read.block.get.micros P50 : 149.415485 P95 : 983.538381 P99 : 3221.588365 P100 : 53066.000000 COUNT : 741011 SUM : 209110634 rocksdb.write.raw.block.micros P50 : 0.528382 P95 : 1.110190 P99 : 3.834447 P100 : 61503.000000 COUNT : 11101483 SUM : 36187879 rocksdb.numfiles.in.singlecompaction P50 : 3.149123 P95 : 8.212500 P99 : 9.842500 P100 : 15.000000 COUNT : 163 SUM : 611 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.571815 P95 : 1268.474832 P99 : 2677.482344 P100 : 890014.000000 COUNT : 119777 SUM : 33190879 rocksdb.sst.read.micros P50 : 1.956855 P95 : 140.965139 P99 : 578.924340 P100 : 53061.000000 COUNT : 10241742 SUM : 321666675 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 618996 SUM : 618996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6870319 SUM : 7090169208 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 290000.000000 P95 : 1008750.000000 P99 : 1112175.000000 P100 : 1112175.000000 COUNT : 90 SUM : 36585807 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 503 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0