[2024-12-09 23:56:37.002949] Starting SPDK v25.01-pre git sha1 1ae735a5d / DPDK 24.03.0 initialization... [2024-12-09 23:56:37.003217] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid287896 ] Set seed to 1733784996996035 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 23:56:37.138880] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 23:56:37.243372] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 23:56:37.243419] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 287896' to capture a snapshot of events at runtime. [2024-12-09 23:56:37.243429] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 23:56:37.243438] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 23:56:37.243461] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid287896 for offline analysis/debug. [2024-12-09 23:56:37.244642] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 23:56:42 2024 CPU: 112 * Intel(R) Xeon(R) Platinum 8280 CPU @ 2.70GHz CPUCache: 39424 KB 2024/12/09-23:56:47 ... thread 0: (1000000,1000000) ops and (200028.4,200028.4) ops/second in (4.999291,4.999291) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.94 GB 25.1 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 195.8 4.49 2.39 11 0.409 0 0 0.0 0.0 L1 6/6 444.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/1 1007.65 MB 0.9 1.2 1.0 0.2 1.2 1.0 0.0 1.2 131.5 128.7 9.25 5.75 5 1.851 757K 0 0.0 0.0 L4 134/5 9.90 GB 1.0 3.2 1.2 2.0 2.9 0.9 0.2 2.4 144.3 132.3 22.72 13.74 13 1.748 524K 0 0.0 0.0 L5 132/0 10.68 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 308/27 24.93 GB 0.0 4.4 2.2 2.2 5.0 2.8 1.0 5.8 123.2 139.2 36.47 21.88 29 1.258 1282K 0 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 2.2 2.2 5.0 2.8 1.0 5.8 123.2 139.2 36.47 21.88 29 1.258 1282K 0 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 2.2 2.2 4.1 1.9 0.0 0.0 140.6 131.3 31.97 19.49 18 1.776 1282K 0 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 195.8 4.49 2.39 11 0.409 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.2 total, 5.0 interval Flush(GB): cumulative 0.859, interval 0.859 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.96 GB write, 984.96 MB/s write, 4.39 GB read, 871.94 MB/s read, 36.5 seconds Interval compaction: 4.96 GB write, 1014.67 MB/s write, 4.39 GB read, 898.24 MB/s read, 36.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 58473 Average: 159.8948 StdDev: 538.49 Min: 1 Median: 2.3198 Max: 21662 Percentiles: P50: 2.32 P75: 4.52 P99: 2752.50 P99.9: 4996.66 P99.99: 6671.99 ------------------------------------------------------ [ 0, 1 ] 2550 4.361% 4.361% # ( 1, 2 ] 22237 38.030% 42.391% ######## ( 2, 3 ] 13915 23.797% 66.188% ##### ( 3, 4 ] 4208 7.196% 73.384% # ( 4, 6 ] 3655 6.251% 79.635% # ( 6, 10 ] 1196 2.045% 81.680% ( 10, 15 ] 260 0.445% 82.125% ( 15, 22 ] 33 0.056% 82.182% ( 22, 34 ] 6 0.010% 82.192% ( 34, 51 ] 2 0.003% 82.195% ( 51, 76 ] 2 0.003% 82.199% ( 76, 110 ] 35 0.060% 82.258% ( 110, 170 ] 495 0.847% 83.105% ( 170, 250 ] 1229 2.102% 85.207% ( 250, 380 ] 1518 2.596% 87.803% # ( 380, 580 ] 1862 3.184% 90.987% # ( 580, 870 ] 1992 3.407% 94.394% # ( 870, 1300 ] 1472 2.517% 96.911% # ( 1300, 1900 ] 721 1.233% 98.144% ( 1900, 2900 ] 588 1.006% 99.150% ( 2900, 4400 ] 420 0.718% 99.868% ( 4400, 6600 ] 72 0.123% 99.991% ( 6600, 9900 ] 7 0.012% 100.003% ( 9900, 14000 ] 3 0.005% 100.009% ( 14000, 22000 ] 5 0.009% 100.017% ** Level 1 read latency histogram (micros): Count: 404 Average: 1577.4035 StdDev: 2855.78 Min: 109 Median: 723.0667 Max: 21921 Percentiles: P50: 723.07 P75: 1438.46 P99: 16613.33 P99.9: 21461.33 P99.99: 21921.00 ------------------------------------------------------ ( 76, 110 ] 1 0.248% 0.248% ( 110, 170 ] 16 3.960% 4.208% # ( 170, 250 ] 28 6.931% 11.139% # ( 250, 380 ] 50 12.376% 23.515% ## ( 380, 580 ] 70 17.327% 40.842% ### ( 580, 870 ] 75 18.564% 59.406% #### ( 870, 1300 ] 54 13.366% 72.772% ### ( 1300, 1900 ] 39 9.653% 82.426% ## ( 1900, 2900 ] 20 4.950% 87.376% # ( 2900, 4400 ] 23 5.693% 93.069% # ( 4400, 6600 ] 9 2.228% 95.297% ( 6600, 9900 ] 11 2.723% 98.020% # ( 9900, 14000 ] 2 0.495% 98.515% ( 14000, 22000 ] 6 1.485% 100.000% ** Level 2 read latency histogram (micros): Count: 161475 Average: 12.6401 StdDev: 166.93 Min: 1 Median: 2.5431 Max: 20630 Percentiles: P50: 2.54 P75: 3.40 P99: 13.08 P99.9: 1178.22 P99.99: 1614.09 ------------------------------------------------------ [ 0, 1 ] 935 0.579% 0.579% ( 1, 2 ] 42572 26.364% 26.943% ##### ( 2, 3 ] 68557 42.457% 69.400% ######## ( 3, 4 ] 22367 13.852% 83.252% ### ( 4, 6 ] 19299 11.952% 95.204% ## ( 6, 10 ] 5369 3.325% 98.529% # ( 10, 15 ] 1236 0.765% 99.294% ( 15, 22 ] 136 0.084% 99.378% ( 22, 34 ] 15 0.009% 99.388% ( 34, 51 ] 16 0.010% 99.397% ( 51, 76 ] 4 0.002% 99.400% ( 76, 110 ] 3 0.002% 99.402% ( 110, 170 ] 33 0.020% 99.422% ( 170, 250 ] 96 0.059% 99.482% ( 250, 380 ] 137 0.085% 99.566% ( 380, 580 ] 184 0.114% 99.680% ( 580, 870 ] 204 0.126% 99.807% ( 870, 1300 ] 210 0.130% 99.937% ( 1300, 1900 ] 164 0.102% 100.038% ( 1900, 2900 ] 119 0.074% 100.112% ( 2900, 4400 ] 53 0.033% 100.145% ( 4400, 6600 ] 22 0.014% 100.159% ( 6600, 9900 ] 7 0.004% 100.163% ( 9900, 14000 ] 3 0.002% 100.165% ( 14000, 22000 ] 3 0.002% 100.167% ** Level 3 read latency histogram (micros): Count: 271667 Average: 15.5970 StdDev: 164.99 Min: 0 Median: 2.4646 Max: 8513 Percentiles: P50: 2.46 P75: 3.36 P99: 14.30 P99.9: 1523.92 P99.99: 2087.99 ------------------------------------------------------ [ 0, 1 ] 3201 1.178% 1.178% ( 1, 2 ] 85004 31.290% 32.468% ###### ( 2, 3 ] 102507 37.733% 70.201% ######## ( 3, 4 ] 36349 13.380% 83.581% ### ( 4, 6 ] 32632 12.012% 95.592% ## ( 6, 10 ] 7943 2.924% 98.516% # ( 10, 15 ] 1527 0.562% 99.078% ( 15, 22 ] 147 0.054% 99.132% ( 22, 34 ] 26 0.010% 99.142% ( 34, 51 ] 31 0.011% 99.153% ( 51, 76 ] 22 0.008% 99.161% ( 76, 110 ] 4 0.001% 99.163% ( 110, 170 ] 48 0.018% 99.181% ( 170, 250 ] 125 0.046% 99.227% ( 250, 380 ] 254 0.093% 99.320% ( 380, 580 ] 444 0.163% 99.484% ( 580, 870 ] 567 0.209% 99.692% ( 870, 1300 ] 452 0.166% 99.859% ( 1300, 1900 ] 301 0.111% 99.969% ( 1900, 2900 ] 297 0.109% 100.079% ( 2900, 4400 ] 194 0.071% 100.150% ( 4400, 6600 ] 49 0.018% 100.168% ( 6600, 9900 ] 8 0.003% 100.171% ** Level 4 read latency histogram (micros): Count: 570715 Average: 23.9582 StdDev: 207.80 Min: 0 Median: 2.5839 Max: 9400 Percentiles: P50: 2.58 P75: 3.50 P99: 489.63 P99.9: 1470.70 P99.99: 1797.52 ------------------------------------------------------ [ 0, 1 ] 3014 0.528% 0.528% ( 1, 2 ] 141697 24.828% 25.356% ##### ( 2, 3 ] 240893 42.209% 67.565% ######## ( 3, 4 ] 84331 14.776% 82.341% ### ( 4, 6 ] 71080 12.455% 94.796% ## ( 6, 10 ] 17526 3.071% 97.867% # ( 10, 15 ] 2718 0.476% 98.343% ( 15, 22 ] 250 0.044% 98.387% ( 22, 34 ] 45 0.008% 98.395% ( 34, 51 ] 50 0.009% 98.404% ( 51, 76 ] 42 0.007% 98.411% ( 76, 110 ] 24 0.004% 98.415% ( 110, 170 ] 319 0.056% 98.471% ( 170, 250 ] 786 0.138% 98.609% ( 250, 380 ] 1200 0.210% 98.819% ( 380, 580 ] 1887 0.331% 99.150% ( 580, 870 ] 2222 0.389% 99.539% ( 870, 1300 ] 1794 0.314% 99.853% ( 1300, 1900 ] 943 0.165% 100.019% ( 1900, 2900 ] 840 0.147% 100.166% ( 2900, 4400 ] 690 0.121% 100.287% ( 4400, 6600 ] 170 0.030% 100.316% ( 6600, 9900 ] 19 0.003% 100.320% ** Level 5 read latency histogram (micros): Count: 6466 Average: 1030.9207 StdDev: 1022.12 Min: 86 Median: 703.9921 Max: 8371 Percentiles: P50: 703.99 P75: 1240.27 P99: 5429.78 P99.9: 8121.85 P99.99: 8371.00 ------------------------------------------------------ ( 76, 110 ] 19 0.294% 0.294% ( 110, 170 ] 226 3.495% 3.789% # ( 170, 250 ] 573 8.862% 12.651% ## ( 250, 380 ] 781 12.079% 24.729% ## ( 380, 580 ] 1091 16.873% 41.602% ### ( 580, 870 ] 1270 19.641% 61.243% #### ( 870, 1300 ] 1033 15.976% 77.219% ### ( 1300, 1900 ] 576 8.908% 86.127% ## ( 1900, 2900 ] 434 6.712% 92.839% # ( 2900, 4400 ] 352 5.444% 98.283% # ( 4400, 6600 ] 99 1.531% 99.814% ( 6600, 9900 ] 12 0.186% 100.000% ** DB Stats ** Uptime(secs): 5.2 total, 5.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 190.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.448 H:M:S, 28.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.448 H:M:S, 28.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/09-23:56:52 ... thread 0: (1000000,2000000) ops and (214656.5,207084.4) ops/second in (4.658606,9.657897) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.91 GB 50.1 1.4 0.0 1.4 3.2 1.8 0.0 1.7 89.0 210.0 15.54 10.84 32 0.486 1405K 7230 0.0 0.0 L1 6/6 444.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 948.46 MB 0.9 1.2 1.0 0.2 1.2 1.0 0.0 1.2 131.5 128.7 9.25 5.75 5 1.851 757K 0 0.0 0.0 L4 131/0 9.59 GB 1.0 3.6 1.3 2.4 3.3 0.9 0.2 2.6 148.3 135.1 25.04 15.42 14 1.789 584K 0 0.0 0.0 L5 136/0 10.99 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 309/23 25.85 GB 0.0 6.2 2.3 3.9 7.7 3.8 1.3 4.2 126.7 157.3 49.83 32.01 51 0.977 2747K 7230 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 2.3 3.9 7.7 3.8 1.3 4.2 126.7 157.3 49.83 32.01 51 0.977 2747K 7230 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 2.3 3.9 5.8 1.9 0.0 0.0 151.2 142.4 41.78 26.62 24 1.741 2747K 7230 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 234.2 8.06 5.39 27 0.298 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.8 total, 9.7 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.65 GB write, 798.73 MB/s write, 6.17 GB read, 643.56 MB/s read, 49.8 seconds Interval compaction: 7.65 GB write, 811.20 MB/s write, 6.17 GB read, 653.61 MB/s read, 49.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 12, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 457910 Average: 43.9575 StdDev: 213.48 Min: 0 Median: 1.8862 Max: 21662 Percentiles: P50: 1.89 P75: 2.96 P99: 718.52 P99.9: 2001.45 P99.99: 2674.85 ------------------------------------------------------ [ 0, 1 ] 44462 9.710% 9.710% ## ( 1, 2 ] 208186 45.464% 55.174% ######### ( 2, 3 ] 94106 20.551% 75.725% #### ( 3, 4 ] 31438 6.866% 82.591% # ( 4, 6 ] 20673 4.515% 87.106% # ( 6, 10 ] 5218 1.140% 88.245% ( 10, 15 ] 1021 0.223% 88.468% ( 15, 22 ] 128 0.028% 88.496% ( 22, 34 ] 29 0.006% 88.502% ( 34, 51 ] 4 0.001% 88.503% ( 51, 76 ] 3 0.001% 88.504% ( 76, 110 ] 783 0.171% 88.675% ( 110, 170 ] 16283 3.556% 92.231% # ( 170, 250 ] 17439 3.808% 96.039% # ( 250, 380 ] 6955 1.519% 97.558% ( 380, 580 ] 5095 1.113% 98.671% ( 580, 870 ] 3159 0.690% 99.361% ( 870, 1300 ] 1664 0.363% 99.724% ( 1300, 1900 ] 745 0.163% 99.887% ( 1900, 2900 ] 612 0.134% 100.020% ( 2900, 4400 ] 431 0.094% 100.114% ( 4400, 6600 ] 72 0.016% 100.130% ( 6600, 9900 ] 7 0.002% 100.132% ( 9900, 14000 ] 3 0.001% 100.132% ( 14000, 22000 ] 5 0.001% 100.133% ** Level 1 read latency histogram (micros): Count: 1591 Average: 570.8693 StdDev: 1560.06 Min: 95 Median: 220.8061 Max: 21921 Percentiles: P50: 220.81 P75: 421.82 P99: 7527.00 P99.9: 19878.67 P99.99: 21787.87 ------------------------------------------------------ ( 76, 110 ] 29 1.823% 1.823% ( 110, 170 ] 475 29.855% 31.678% ###### ( 170, 250 ] 459 28.850% 60.528% ###### ( 250, 380 ] 197 12.382% 72.910% ## ( 380, 580 ] 159 9.994% 82.904% ## ( 580, 870 ] 97 6.097% 89.001% # ( 870, 1300 ] 62 3.897% 92.898% # ( 1300, 1900 ] 41 2.577% 95.475% # ( 1900, 2900 ] 21 1.320% 96.794% ( 2900, 4400 ] 23 1.446% 98.240% ( 4400, 6600 ] 9 0.566% 98.806% ( 6600, 9900 ] 11 0.691% 99.497% ( 9900, 14000 ] 2 0.126% 99.623% ( 14000, 22000 ] 6 0.377% 100.000% ** Level 2 read latency histogram (micros): Count: 161475 Average: 12.6401 StdDev: 166.93 Min: 1 Median: 2.5431 Max: 20630 Percentiles: P50: 2.54 P75: 3.40 P99: 13.08 P99.9: 1178.22 P99.99: 1614.09 ------------------------------------------------------ [ 0, 1 ] 935 0.579% 0.579% ( 1, 2 ] 42572 26.364% 26.943% ##### ( 2, 3 ] 68557 42.457% 69.400% ######## ( 3, 4 ] 22367 13.852% 83.252% ### ( 4, 6 ] 19299 11.952% 95.204% ## ( 6, 10 ] 5369 3.325% 98.529% # ( 10, 15 ] 1236 0.765% 99.294% ( 15, 22 ] 136 0.084% 99.378% ( 22, 34 ] 15 0.009% 99.388% ( 34, 51 ] 16 0.010% 99.397% ( 51, 76 ] 4 0.002% 99.400% ( 76, 110 ] 3 0.002% 99.402% ( 110, 170 ] 33 0.020% 99.422% ( 170, 250 ] 96 0.059% 99.482% ( 250, 380 ] 137 0.085% 99.566% ( 380, 580 ] 184 0.114% 99.680% ( 580, 870 ] 204 0.126% 99.807% ( 870, 1300 ] 210 0.130% 99.937% ( 1300, 1900 ] 164 0.102% 100.038% ( 1900, 2900 ] 119 0.074% 100.112% ( 2900, 4400 ] 53 0.033% 100.145% ( 4400, 6600 ] 22 0.014% 100.159% ( 6600, 9900 ] 7 0.004% 100.163% ( 9900, 14000 ] 3 0.002% 100.165% ( 14000, 22000 ] 3 0.002% 100.167% ** Level 3 read latency histogram (micros): Count: 279017 Average: 17.8348 StdDev: 165.00 Min: 0 Median: 2.4737 Max: 8513 Percentiles: P50: 2.47 P75: 3.41 P99: 255.85 P99.9: 1512.55 P99.99: 2088.25 ------------------------------------------------------ [ 0, 1 ] 3363 1.205% 1.205% ( 1, 2 ] 86882 31.139% 32.344% ###### ( 2, 3 ] 103995 37.272% 69.616% ####### ( 3, 4 ] 36656 13.138% 82.753% ### ( 4, 6 ] 32831 11.767% 94.520% ## ( 6, 10 ] 8030 2.878% 97.398% # ( 10, 15 ] 1536 0.551% 97.949% ( 15, 22 ] 150 0.054% 98.002% ( 22, 34 ] 26 0.009% 98.012% ( 34, 51 ] 31 0.011% 98.023% ( 51, 76 ] 22 0.008% 98.031% ( 76, 110 ] 83 0.030% 98.060% ( 110, 170 ] 1260 0.452% 98.512% ( 170, 250 ] 1333 0.478% 98.990% ( 250, 380 ] 641 0.230% 99.219% ( 380, 580 ] 674 0.242% 99.461% ( 580, 870 ] 649 0.233% 99.694% ( 870, 1300 ] 469 0.168% 99.862% ( 1300, 1900 ] 302 0.108% 99.970% ( 1900, 2900 ] 298 0.107% 100.077% ( 2900, 4400 ] 194 0.070% 100.146% ( 4400, 6600 ] 49 0.018% 100.164% ( 6600, 9900 ] 8 0.003% 100.167% ** Level 4 read latency histogram (micros): Count: 623112 Average: 31.1410 StdDev: 205.00 Min: 0 Median: 2.6295 Max: 9400 Percentiles: P50: 2.63 P75: 3.69 P99: 551.73 P99.9: 1446.95 P99.99: 1799.28 ------------------------------------------------------ [ 0, 1 ] 3114 0.500% 0.500% ( 1, 2 ] 147940 23.742% 24.242% ##### ( 2, 3 ] 254980 40.920% 65.162% ######## ( 3, 4 ] 88284 14.168% 79.331% ### ( 4, 6 ] 73636 11.817% 91.148% ## ( 6, 10 ] 18250 2.929% 94.077% # ( 10, 15 ] 2832 0.454% 94.531% ( 15, 22 ] 268 0.043% 94.574% ( 22, 34 ] 46 0.007% 94.582% ( 34, 51 ] 52 0.008% 94.590% ( 51, 76 ] 42 0.007% 94.597% ( 76, 110 ] 579 0.093% 94.690% ( 110, 170 ] 9840 1.579% 96.269% ( 170, 250 ] 9670 1.552% 97.821% ( 250, 380 ] 4111 0.660% 98.481% ( 380, 580 ] 3771 0.605% 99.086% ( 580, 870 ] 2917 0.468% 99.554% ( 870, 1300 ] 1924 0.309% 99.863% ( 1300, 1900 ] 955 0.153% 100.016% ( 1900, 2900 ] 851 0.137% 100.152% ( 2900, 4400 ] 690 0.111% 100.263% ( 4400, 6600 ] 170 0.027% 100.290% ( 6600, 9900 ] 19 0.003% 100.294% ** Level 5 read latency histogram (micros): Count: 28851 Average: 408.3071 StdDev: 602.45 Min: 86 Median: 216.4710 Max: 8371 Percentiles: P50: 216.47 P75: 385.12 P99: 3647.84 P99.9: 6225.53 P99.99: 8371.00 ------------------------------------------------------ ( 76, 110 ] 496 1.719% 1.719% ( 110, 170 ] 8863 30.720% 32.439% ###### ( 170, 250 ] 8722 30.231% 62.670% ###### ( 250, 380 ] 3487 12.086% 74.757% ## ( 380, 580 ] 2746 9.518% 84.274% ## ( 580, 870 ] 1896 6.572% 90.846% # ( 870, 1300 ] 1140 3.951% 94.797% # ( 1300, 1900 ] 592 2.052% 96.849% ( 1900, 2900 ] 444 1.539% 98.388% ( 2900, 4400 ] 354 1.227% 99.615% ( 4400, 6600 ] 99 0.343% 99.958% ( 6600, 9900 ] 12 0.042% 100.000% ** DB Stats ** Uptime(secs): 9.8 total, 4.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 200.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.705 H:M:S, 27.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 211.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.257 H:M:S, 27.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/09-23:57:02 ... thread 0: (1000000,3000000) ops and (100975.6,153364.2) ops/second in (9.903381,19.561278) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 4.81 GB 166.9 3.4 0.0 3.4 6.1 2.7 0.0 2.2 127.8 231.2 27.04 21.48 52 0.520 3508K 34K 0.0 0.0 L1 6/6 444.44 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 948.46 MB 0.9 1.2 1.0 0.2 1.2 1.0 0.0 1.2 131.5 128.7 9.25 5.75 5 1.851 757K 0 0.0 0.0 L4 131/0 9.59 GB 1.0 3.6 1.3 2.4 3.3 0.9 0.2 2.6 148.3 135.1 25.04 15.42 14 1.789 584K 0 0.0 0.0 L5 136/0 10.99 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 308/19 26.74 GB 0.0 8.2 2.3 5.9 10.6 4.7 1.3 3.8 136.7 176.5 61.33 42.66 71 0.864 4850K 34K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.2 2.3 5.9 10.6 4.7 1.3 3.8 136.7 176.5 61.33 42.66 71 0.864 4850K 34K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.2 2.3 5.9 7.8 1.9 0.0 0.0 167.7 159.9 50.00 34.49 29 1.724 4850K 34K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 249.8 11.33 8.17 42 0.270 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.7 total, 19.6 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.57 GB write, 549.08 MB/s write, 8.19 GB read, 425.35 MB/s read, 61.3 seconds Interval compaction: 10.57 GB write, 553.31 MB/s write, 8.19 GB read, 428.64 MB/s read, 61.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 12, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1124788 Average: 41.8288 StdDev: 154.46 Min: 0 Median: 1.7514 Max: 21662 Percentiles: P50: 1.75 P75: 2.96 P99: 502.66 P99.9: 1188.12 P99.99: 1713.25 ------------------------------------------------------ [ 0, 1 ] 167069 14.853% 14.853% ### ( 1, 2 ] 526148 46.778% 61.631% ######### ( 2, 3 ] 156436 13.908% 75.539% ### ( 3, 4 ] 50094 4.454% 79.993% # ( 4, 6 ] 36304 3.228% 83.220% # ( 6, 10 ] 7628 0.678% 83.898% ( 10, 15 ] 1772 0.158% 84.056% ( 15, 22 ] 217 0.019% 84.075% ( 22, 34 ] 39 0.003% 84.079% ( 34, 51 ] 5 0.000% 84.079% ( 51, 76 ] 6 0.001% 84.080% ( 76, 110 ] 2644 0.235% 84.315% ( 110, 170 ] 70941 6.307% 90.622% # ( 170, 250 ] 70270 6.247% 96.869% # ( 250, 380 ] 17585 1.563% 98.433% ( 380, 580 ] 10406 0.925% 99.358% ( 580, 870 ] 4715 0.419% 99.777% ( 870, 1300 ] 1871 0.166% 99.943% ( 1300, 1900 ] 763 0.068% 100.011% ( 1900, 2900 ] 646 0.057% 100.069% ( 2900, 4400 ] 470 0.042% 100.110% ( 4400, 6600 ] 72 0.006% 100.117% ( 6600, 9900 ] 7 0.001% 100.117% ( 9900, 14000 ] 3 0.000% 100.118% ( 14000, 22000 ] 5 0.000% 100.118% ** Level 1 read latency histogram (micros): Count: 4414 Average: 333.7431 StdDev: 956.53 Min: 95 Median: 189.7462 Max: 21921 Percentiles: P50: 189.75 P75: 245.76 P99: 3347.39 P99.9: 16114.67 P99.99: 21411.47 ------------------------------------------------------ ( 76, 110 ] 80 1.812% 1.812% ( 110, 170 ] 1738 39.375% 41.187% ######## ( 170, 250 ] 1576 35.705% 76.892% ####### ( 250, 380 ] 424 9.606% 86.498% ## ( 380, 580 ] 286 6.479% 92.977% # ( 580, 870 ] 135 3.058% 96.035% # ( 870, 1300 ] 62 1.405% 97.440% ( 1300, 1900 ] 41 0.929% 98.369% ( 1900, 2900 ] 21 0.476% 98.845% ( 2900, 4400 ] 23 0.521% 99.366% ( 4400, 6600 ] 9 0.204% 99.570% ( 6600, 9900 ] 11 0.249% 99.819% ( 9900, 14000 ] 2 0.045% 99.864% ( 14000, 22000 ] 6 0.136% 100.000% ** Level 2 read latency histogram (micros): Count: 161475 Average: 12.6401 StdDev: 166.93 Min: 1 Median: 2.5431 Max: 20630 Percentiles: P50: 2.54 P75: 3.40 P99: 13.08 P99.9: 1178.22 P99.99: 1614.09 ------------------------------------------------------ [ 0, 1 ] 935 0.579% 0.579% ( 1, 2 ] 42572 26.364% 26.943% ##### ( 2, 3 ] 68557 42.457% 69.400% ######## ( 3, 4 ] 22367 13.852% 83.252% ### ( 4, 6 ] 19299 11.952% 95.204% ## ( 6, 10 ] 5369 3.325% 98.529% # ( 10, 15 ] 1236 0.765% 99.294% ( 15, 22 ] 136 0.084% 99.378% ( 22, 34 ] 15 0.009% 99.388% ( 34, 51 ] 16 0.010% 99.397% ( 51, 76 ] 4 0.002% 99.400% ( 76, 110 ] 3 0.002% 99.402% ( 110, 170 ] 33 0.020% 99.422% ( 170, 250 ] 96 0.059% 99.482% ( 250, 380 ] 137 0.085% 99.566% ( 380, 580 ] 184 0.114% 99.680% ( 580, 870 ] 204 0.126% 99.807% ( 870, 1300 ] 210 0.130% 99.937% ( 1300, 1900 ] 164 0.102% 100.038% ( 1900, 2900 ] 119 0.074% 100.112% ( 2900, 4400 ] 53 0.033% 100.145% ( 4400, 6600 ] 22 0.014% 100.159% ( 6600, 9900 ] 7 0.004% 100.163% ( 9900, 14000 ] 3 0.002% 100.165% ( 14000, 22000 ] 3 0.002% 100.167% ** Level 3 read latency histogram (micros): Count: 286174 Average: 22.3395 StdDev: 166.12 Min: 0 Median: 2.5081 Max: 8513 Percentiles: P50: 2.51 P75: 3.56 P99: 346.75 P99.9: 1502.95 P99.99: 2088.57 ------------------------------------------------------ [ 0, 1 ] 3363 1.175% 1.175% ( 1, 2 ] 86882 30.360% 31.535% ###### ( 2, 3 ] 103995 36.340% 67.875% ####### ( 3, 4 ] 36656 12.809% 80.684% ### ( 4, 6 ] 32831 11.472% 92.156% ## ( 6, 10 ] 8030 2.806% 94.962% # ( 10, 15 ] 1536 0.537% 95.499% ( 15, 22 ] 150 0.052% 95.551% ( 22, 34 ] 26 0.009% 95.560% ( 34, 51 ] 31 0.011% 95.571% ( 51, 76 ] 22 0.008% 95.579% ( 76, 110 ] 217 0.076% 95.655% ( 110, 170 ] 4530 1.583% 97.238% ( 170, 250 ] 4174 1.459% 98.696% ( 250, 380 ] 1168 0.408% 99.104% ( 380, 580 ] 968 0.338% 99.443% ( 580, 870 ] 726 0.254% 99.696% ( 870, 1300 ] 480 0.168% 99.864% ( 1300, 1900 ] 304 0.106% 99.970% ( 1900, 2900 ] 299 0.104% 100.075% ( 2900, 4400 ] 194 0.068% 100.143% ( 4400, 6600 ] 49 0.017% 100.160% ( 6600, 9900 ] 8 0.003% 100.162% ** Level 4 read latency histogram (micros): Count: 681070 Average: 45.4454 StdDev: 204.19 Min: 0 Median: 2.7431 Max: 9400 Percentiles: P50: 2.74 P75: 4.45 P99: 570.59 P99.9: 1431.23 P99.99: 1810.77 ------------------------------------------------------ [ 0, 1 ] 3114 0.457% 0.457% ( 1, 2 ] 147940 21.722% 22.179% #### ( 2, 3 ] 254988 37.439% 59.618% ####### ( 3, 4 ] 88317 12.967% 72.586% ### ( 4, 6 ] 73740 10.827% 83.413% ## ( 6, 10 ] 18264 2.682% 86.094% # ( 10, 15 ] 2833 0.416% 86.510% ( 15, 22 ] 268 0.039% 86.550% ( 22, 34 ] 46 0.007% 86.556% ( 34, 51 ] 52 0.008% 86.564% ( 51, 76 ] 42 0.006% 86.570% ( 76, 110 ] 1667 0.245% 86.815% ( 110, 170 ] 36100 5.300% 92.115% # ( 170, 250 ] 32375 4.754% 96.869% # ( 250, 380 ] 8645 1.269% 98.138% ( 380, 580 ] 6158 0.904% 99.043% ( 580, 870 ] 3603 0.529% 99.572% ( 870, 1300 ] 2025 0.297% 99.869% ( 1300, 1900 ] 969 0.142% 100.011% ( 1900, 2900 ] 870 0.128% 100.139% ( 2900, 4400 ] 693 0.102% 100.241% ( 4400, 6600 ] 170 0.025% 100.266% ( 6600, 9900 ] 19 0.003% 100.268% ** Level 5 read latency histogram (micros): Count: 79463 Average: 275.5766 StdDev: 386.29 Min: 85 Median: 188.2332 Max: 8371 Percentiles: P50: 188.23 P75: 243.64 P99: 2181.85 P99.9: 5056.38 P99.99: 7164.77 ------------------------------------------------------ ( 76, 110 ] 1433 1.803% 1.803% ( 110, 170 ] 31761 39.970% 41.773% ######## ( 170, 250 ] 28684 36.097% 77.870% ####### ( 250, 380 ] 7494 9.431% 87.301% ## ( 380, 580 ] 4807 6.049% 93.350% # ( 580, 870 ] 2534 3.189% 96.539% # ( 870, 1300 ] 1225 1.542% 98.081% ( 1300, 1900 ] 601 0.756% 98.837% ( 1900, 2900 ] 459 0.578% 99.415% ( 2900, 4400 ] 356 0.448% 99.863% ( 4400, 6600 ] 99 0.125% 99.987% ( 6600, 9900 ] 12 0.015% 100.003% ** DB Stats ** Uptime(secs): 19.7 total, 9.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 149.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.867 H:M:S, 45.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 99.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.162 H:M:S, 62.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 342.074 micros/op 11678 ops/sec 20.208 seconds 235996 operations; 11.3 MB/s (58999 of 58999 found) Microseconds per read: Count: 235996 Average: 342.0818 StdDev: 721.76 Min: 3 Median: 232.6888 Max: 52893 Percentiles: P50: 232.69 P75: 350.61 P99: 1943.79 P99.9: 10651.94 P99.99: 29414.90 ------------------------------------------------------ ( 2, 3 ] 8 0.003% 0.003% ( 3, 4 ] 11 0.005% 0.008% ( 4, 6 ] 99 0.042% 0.050% ( 6, 10 ] 344 0.146% 0.196% ( 10, 15 ] 318 0.135% 0.331% ( 15, 22 ] 527 0.223% 0.554% ( 22, 34 ] 5731 2.428% 2.982% ( 34, 51 ] 2933 1.243% 4.225% ( 51, 76 ] 372 0.158% 4.383% ( 76, 110 ] 51 0.022% 4.404% ( 110, 170 ] 20570 8.716% 13.121% ## ( 170, 250 ] 111068 47.064% 60.184% ######### ( 250, 380 ] 45178 19.144% 79.328% #### ( 380, 580 ] 27668 11.724% 91.052% ## ( 580, 870 ] 12234 5.184% 96.236% # ( 870, 1300 ] 4689 1.987% 98.222% ( 1300, 1900 ] 1787 0.757% 98.980% ( 1900, 2900 ] 1097 0.465% 99.444% ( 2900, 4400 ] 774 0.328% 99.772% ( 4400, 6600 ] 225 0.095% 99.868% ( 6600, 9900 ] 65 0.028% 99.895% ( 9900, 14000 ] 60 0.025% 99.921% ( 14000, 22000 ] 127 0.054% 99.975% ( 22000, 33000 ] 54 0.023% 99.997% ( 33000, 50000 ] 5 0.002% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 4252337 rocksdb.bloom.filter.full.positive COUNT : 276965 rocksdb.bloom.filter.full.true.positive COUNT : 235255 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 741 rocksdb.memtable.miss COUNT : 235255 rocksdb.l0.hit COUNT : 44859 rocksdb.l1.hit COUNT : 4276 rocksdb.l2andup.hit COUNT : 186120 rocksdb.compaction.key.drop.new COUNT : 415342 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3086202 rocksdb.number.keys.read COUNT : 235996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3184960464 rocksdb.bytes.read COUNT : 235996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 418 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 9213626 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9592923582 rocksdb.compact.write.bytes COUNT : 9159471335 rocksdb.flush.write.bytes COUNT : 3165869183 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 23 rocksdb.number.superversion_acquires COUNT : 522 rocksdb.number.superversion_releases COUNT : 502 rocksdb.number.superversion_cleanups COUNT : 127 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3145189376 rocksdb.memtable.garbage.bytes.at.flush COUNT : 5664768 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9994503283 rocksdb.non.last.level.read.count COUNT : 2382685 rocksdb.block.checksum.compute.count COUNT : 2604210 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 231.833636 P95 : 799.949663 P99 : 1942.841530 P100 : 52892.000000 COUNT : 235996 SUM : 80438381 rocksdb.db.write.micros P50 : 1.370292 P95 : 3.916767 P99 : 8.510857 P100 : 549423.000000 COUNT : 3086202 SUM : 16304518 rocksdb.compaction.times.micros P50 : 1520833.333333 P95 : 3285000.000000 P99 : 4097000.000000 P100 : 4294884.000000 COUNT : 29 SUM : 50003912 rocksdb.compaction.times.cpu_micros P50 : 1052666.666667 P95 : 1855000.000000 P99 : 3894000.000000 P100 : 4028670.000000 COUNT : 29 SUM : 34487629 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 862.368421 P95 : 13658.333333 P99 : 40297.000000 P100 : 40297.000000 COUNT : 45 SUM : 160069 rocksdb.compaction.outfile.sync.micros P50 : 5087.500000 P95 : 29810.000000 P99 : 43417.000000 P100 : 43417.000000 COUNT : 89 SUM : 728491 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 195.714286 P95 : 1900.000000 P99 : 2614.000000 P100 : 2614.000000 COUNT : 80 SUM : 30597 rocksdb.table.open.io.micros P50 : 8137.500000 P95 : 21141.818182 P99 : 44533.846154 P100 : 49003.000000 COUNT : 418 SUM : 3805616 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.280251 P95 : 128.558625 P99 : 349.012673 P100 : 10322.000000 COUNT : 2323928 SUM : 52608031 rocksdb.read.block.get.micros P50 : 188.047282 P95 : 625.768985 P99 : 1755.255754 P100 : 23465.000000 COUNT : 280130 SUM : 70053405 rocksdb.write.raw.block.micros P50 : 0.543978 P95 : 1.592415 P99 : 4.441704 P100 : 10358.000000 COUNT : 2987165 SUM : 8210677 rocksdb.numfiles.in.singlecompaction P50 : 3.300000 P95 : 5.757143 P99 : 13.000000 P100 : 13.000000 COUNT : 37 SUM : 148 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566663 P95 : 1161.169677 P99 : 2369.438976 P100 : 549250.000000 COUNT : 54505 SUM : 9221385 rocksdb.sst.read.micros P50 : 2.329506 P95 : 231.467357 P99 : 622.070322 P100 : 21921.000000 COUNT : 2383130 SUM : 113196174 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 235996 SUM : 235996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3086202 SUM : 3184960464 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221428.571429 P95 : 554166.666667 P99 : 790083.000000 P100 : 790083.000000 COUNT : 45 SUM : 11935898 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 107 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0