[2024-12-12 00:02:22.119162] Starting SPDK v25.01-pre git sha1 2104eacf0 / DPDK 24.03.0 initialization... [2024-12-12 00:02:22.119261] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1722434 ] Set seed to 1733958142116784 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-12 00:02:22.227592] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-12 00:02:22.331608] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-12 00:02:22.331654] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1722434' to capture a snapshot of events at runtime. [2024-12-12 00:02:22.331665] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-12 00:02:22.331674] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-12 00:02:22.331683] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1722434 for offline analysis/debug. [2024-12-12 00:02:22.332967] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 12 00:02:30 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/12-00:02:38 ... thread 0: (1000000,1000000) ops and (131475.4,131475.4) ops/second in (7.605983,7.605983) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.32 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 38.7 122.4 9.78 4.05 10 0.978 383K 497 0.0 0.0 L1 5/5 464.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 3/1 256.35 MB 1.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 30/8 2.85 GB 2.0 2.1 1.4 0.7 2.1 1.4 0.0 1.5 99.6 98.0 21.75 10.28 11 1.977 921K 0 0.0 0.0 L4 211/26 12.14 GB 1.1 3.8 2.5 1.3 3.8 2.4 0.1 1.5 108.7 106.9 36.04 18.62 27 1.335 1986K 0 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1364/49 107.82 GB 0.0 6.3 3.9 2.4 7.0 4.6 0.1 8.8 95.6 106.3 67.56 32.95 48 1.407 3291K 497 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 3.9 2.4 7.0 4.6 0.1 8.8 95.6 106.3 67.56 32.95 48 1.407 3291K 497 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 3.9 2.4 6.2 3.8 0.0 0.0 106.8 105.1 60.50 30.51 39 1.551 3291K 497 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 116.0 7.06 2.44 9 0.785 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.8 total, 7.6 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.01 GB write, 917.99 MB/s write, 6.31 GB read, 826.02 MB/s read, 67.6 seconds Interval compaction: 7.01 GB write, 943.73 MB/s write, 6.31 GB read, 849.19 MB/s read, 67.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 238424 Average: 18.7084 StdDev: 226.16 Min: 1 Median: 2.0774 Max: 30092 Percentiles: P50: 2.08 P75: 2.98 P99: 12.69 P99.9: 3478.83 P99.99: 5646.43 ------------------------------------------------------ [ 0, 1 ] 4236 1.777% 1.777% ( 1, 2 ] 109843 46.070% 47.847% ######### ( 2, 3 ] 66288 27.803% 75.650% ###### ( 3, 4 ] 22336 9.368% 85.018% ## ( 4, 6 ] 26283 11.024% 96.042% ## ( 6, 10 ] 6558 2.751% 98.792% # ( 10, 15 ] 922 0.387% 99.179% ( 15, 22 ] 93 0.039% 99.218% ( 22, 34 ] 10 0.004% 99.222% ( 34, 51 ] 3 0.001% 99.223% ( 51, 76 ] 5 0.002% 99.225% ( 76, 110 ] 1 0.000% 99.226% ( 110, 170 ] 6 0.003% 99.228% ( 170, 250 ] 19 0.008% 99.236% ( 250, 380 ] 45 0.019% 99.255% ( 380, 580 ] 111 0.047% 99.302% ( 580, 870 ] 199 0.083% 99.385% ( 870, 1300 ] 339 0.142% 99.527% ( 1300, 1900 ] 386 0.162% 99.689% ( 1900, 2900 ] 398 0.167% 99.856% ( 2900, 4400 ] 271 0.114% 99.970% ( 4400, 6600 ] 85 0.036% 100.005% ( 6600, 9900 ] 11 0.005% 100.010% ( 9900, 14000 ] 7 0.003% 100.013% ( 14000, 22000 ] 1 0.000% 100.013% ( 22000, 33000 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 41536 Average: 21.6882 StdDev: 261.10 Min: 1 Median: 2.3581 Max: 10200 Percentiles: P50: 2.36 P75: 3.32 P99: 13.88 P99.9: 4617.74 P99.99: 9011.64 ------------------------------------------------------ [ 0, 1 ] 158 0.380% 0.380% ( 1, 2 ] 15610 37.582% 37.962% ######## ( 2, 3 ] 13961 33.612% 71.574% ####### ( 3, 4 ] 4457 10.730% 82.305% ## ( 4, 6 ] 5315 12.796% 95.101% ### ( 6, 10 ] 1407 3.387% 98.488% # ( 10, 15 ] 274 0.660% 99.148% ( 15, 22 ] 29 0.070% 99.218% ( 22, 34 ] 2 0.005% 99.222% ( 34, 51 ] 2 0.005% 99.227% ( 51, 76 ] 3 0.007% 99.234% ( 110, 170 ] 2 0.005% 99.239% ( 170, 250 ] 3 0.007% 99.246% ( 250, 380 ] 4 0.010% 99.256% ( 380, 580 ] 17 0.041% 99.297% ( 580, 870 ] 30 0.072% 99.369% ( 870, 1300 ] 50 0.120% 99.490% ( 1300, 1900 ] 59 0.142% 99.632% ( 1900, 2900 ] 52 0.125% 99.757% ( 2900, 4400 ] 56 0.135% 99.892% ( 4400, 6600 ] 35 0.084% 99.976% ( 6600, 9900 ] 8 0.019% 99.995% ( 9900, 14000 ] 2 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 209812 Average: 18.2259 StdDev: 215.34 Min: 1 Median: 2.2030 Max: 10793 Percentiles: P50: 2.20 P75: 3.09 P99: 13.30 P99.9: 2877.22 P99.99: 4040.87 ------------------------------------------------------ [ 0, 1 ] 2589 1.234% 1.234% ( 1, 2 ] 89440 42.629% 43.863% ######### ( 2, 3 ] 63422 30.228% 74.091% ###### ( 3, 4 ] 20558 9.798% 83.889% ## ( 4, 6 ] 24171 11.520% 95.409% ## ( 6, 10 ] 6618 3.154% 98.563% # ( 10, 15 ] 1388 0.662% 99.225% ( 15, 22 ] 189 0.090% 99.315% ( 22, 34 ] 15 0.007% 99.322% ( 34, 51 ] 13 0.006% 99.328% ( 51, 76 ] 8 0.004% 99.332% ( 76, 110 ] 8 0.004% 99.336% ( 110, 170 ] 9 0.004% 99.340% ( 170, 250 ] 11 0.005% 99.346% ( 250, 380 ] 30 0.014% 99.360% ( 380, 580 ] 92 0.044% 99.404% ( 580, 870 ] 147 0.070% 99.474% ( 870, 1300 ] 232 0.111% 99.584% ( 1300, 1900 ] 327 0.156% 99.740% ( 1900, 2900 ] 343 0.163% 99.904% ( 2900, 4400 ] 238 0.113% 100.017% ( 4400, 6600 ] 77 0.037% 100.054% ( 6600, 9900 ] 25 0.012% 100.066% ( 9900, 14000 ] 2 0.001% 100.067% ** Level 3 read latency histogram (micros): Count: 765988 Average: 12.8381 StdDev: 184.39 Min: 1 Median: 2.2217 Max: 39431 Percentiles: P50: 2.22 P75: 3.07 P99: 9.62 P99.9: 1458.57 P99.99: 2169.10 ------------------------------------------------------ [ 0, 1 ] 5755 0.751% 0.751% ( 1, 2 ] 324344 42.343% 43.095% ######## ( 2, 3 ] 238546 31.142% 74.237% ###### ( 3, 4 ] 78319 10.225% 84.461% ## ( 4, 6 ] 93095 12.154% 96.615% ## ( 6, 10 ] 20169 2.633% 99.248% # ( 10, 15 ] 3154 0.412% 99.660% ( 15, 22 ] 344 0.045% 99.705% ( 22, 34 ] 47 0.006% 99.711% ( 34, 51 ] 30 0.004% 99.715% ( 51, 76 ] 42 0.005% 99.720% ( 76, 110 ] 16 0.002% 99.722% ( 110, 170 ] 14 0.002% 99.724% ( 170, 250 ] 33 0.004% 99.728% ( 250, 380 ] 55 0.007% 99.736% ( 380, 580 ] 173 0.023% 99.758% ( 580, 870 ] 351 0.046% 99.804% ( 870, 1300 ] 561 0.073% 99.877% ( 1300, 1900 ] 666 0.087% 99.964% ( 1900, 2900 ] 741 0.097% 100.061% ( 2900, 4400 ] 615 0.080% 100.141% ( 4400, 6600 ] 199 0.026% 100.167% ( 6600, 9900 ] 47 0.006% 100.173% ( 9900, 14000 ] 5 0.001% 100.174% ( 14000, 22000 ] 3 0.000% 100.174% ( 22000, 33000 ] 1 0.000% 100.175% ( 33000, 50000 ] 1 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 431306 Average: 24.9361 StdDev: 268.10 Min: 1 Median: 2.2257 Max: 39833 Percentiles: P50: 2.23 P75: 3.11 P99: 17.60 P99.9: 3098.15 P99.99: 3955.68 ------------------------------------------------------ [ 0, 1 ] 3933 0.912% 0.912% ( 1, 2 ] 181672 42.121% 43.033% ######## ( 2, 3 ] 133122 30.865% 73.898% ###### ( 3, 4 ] 44006 10.203% 84.101% ## ( 4, 6 ] 50263 11.654% 95.755% ## ( 6, 10 ] 12126 2.811% 98.566% # ( 10, 15 ] 1797 0.417% 98.983% ( 15, 22 ] 199 0.046% 99.029% ( 22, 34 ] 21 0.005% 99.034% ( 34, 51 ] 27 0.006% 99.040% ( 51, 76 ] 19 0.004% 99.045% ( 76, 110 ] 9 0.002% 99.047% ( 110, 170 ] 24 0.006% 99.052% ( 170, 250 ] 71 0.016% 99.069% ( 250, 380 ] 88 0.020% 99.089% ( 380, 580 ] 236 0.055% 99.144% ( 580, 870 ] 476 0.110% 99.254% ( 870, 1300 ] 828 0.192% 99.446% ( 1300, 1900 ] 912 0.211% 99.658% ( 1900, 2900 ] 956 0.222% 99.879% ( 2900, 4400 ] 679 0.157% 100.037% ( 4400, 6600 ] 266 0.062% 100.098% ( 6600, 9900 ] 51 0.012% 100.110% ( 9900, 14000 ] 7 0.002% 100.112% ( 14000, 22000 ] 2 0.000% 100.112% ( 33000, 50000 ] 1 0.000% 100.112% ** Level 5 read latency histogram (micros): Count: 8570 Average: 2496.7734 StdDev: 1906.77 Min: 135 Median: 1904.8376 Max: 28282 Percentiles: P50: 1904.84 P75: 3598.77 P99: 9219.22 P99.9: 13720.13 P99.99: 28282.00 ------------------------------------------------------ ( 110, 170 ] 9 0.105% 0.105% ( 170, 250 ] 40 0.467% 0.572% ( 250, 380 ] 159 1.855% 2.427% ( 380, 580 ] 411 4.796% 7.223% # ( 580, 870 ] 895 10.443% 17.666% ## ( 870, 1300 ] 1301 15.181% 32.847% ### ( 1300, 1900 ] 1463 17.071% 49.918% ### ( 1900, 2900 ] 1447 16.884% 66.803% ### ( 2900, 4400 ] 1508 17.596% 84.399% #### ( 4400, 6600 ] 1037 12.100% 96.499% ## ( 6600, 9900 ] 270 3.151% 99.650% # ( 9900, 14000 ] 23 0.268% 99.918% ( 14000, 22000 ] 5 0.058% 99.977% ( 22000, 33000 ] 2 0.023% 100.000% ** DB Stats ** Uptime(secs): 7.8 total, 7.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 125.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.722 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.722 H:M:S, 48.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/12-00:02:45 ... thread 0: (1000000,2000000) ops and (143416.5,137186.6) ops/second in (6.972697,14.578680) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 1.78 GB 6.3 1.4 0.0 1.4 3.2 1.8 0.0 1.8 61.4 138.8 23.59 11.94 25 0.944 1471K 1894 0.0 0.0 L1 11/11 999.20 MB 0.0 1.0 0.5 0.5 1.0 0.5 0.0 1.9 73.2 72.9 13.70 5.34 1 13.704 1018K 3603 0.0 0.0 L3 12/0 946.51 MB 0.9 2.2 1.5 0.7 2.2 1.4 0.2 1.5 99.3 97.8 22.73 10.71 12 1.894 1014K 660 0.0 0.0 L4 178/0 9.65 GB 1.0 9.1 4.5 4.6 9.0 4.4 0.2 2.0 110.3 108.1 84.81 46.60 45 1.885 3423K 12K 0.0 0.0 L5 1160/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1370/19 108.68 GB 0.0 13.7 6.5 7.2 15.3 8.1 4.9 8.6 97.1 108.2 144.83 74.59 83 1.745 6927K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.7 6.5 7.2 15.3 8.1 4.9 8.6 97.1 108.2 144.83 74.59 83 1.745 6927K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.7 6.5 7.2 13.5 6.3 0.0 0.0 107.4 105.7 130.95 68.91 62 2.112 6927K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 131.6 13.88 5.68 21 0.661 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.6 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.30 GB write, 1059.05 MB/s write, 13.73 GB read, 950.51 MB/s read, 144.8 seconds Interval compaction: 15.30 GB write, 1074.55 MB/s write, 13.73 GB read, 964.42 MB/s read, 144.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 53, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 510001 Average: 24.7564 StdDev: 366.05 Min: 1 Median: 1.9711 Max: 84850 Percentiles: P50: 1.97 P75: 2.91 P99: 543.13 P99.9: 3693.02 P99.99: 6326.55 ------------------------------------------------------ [ 0, 1 ] 17009 3.335% 3.335% # ( 1, 2 ] 245071 48.053% 51.388% ########## ( 2, 3 ] 132555 25.991% 77.379% ##### ( 3, 4 ] 42984 8.428% 85.807% ## ( 4, 6 ] 50982 9.996% 95.804% ## ( 6, 10 ] 11697 2.294% 98.097% ( 10, 15 ] 1561 0.306% 98.404% ( 15, 22 ] 157 0.031% 98.434% ( 22, 34 ] 15 0.003% 98.437% ( 34, 51 ] 4 0.001% 98.438% ( 51, 76 ] 14 0.003% 98.441% ( 76, 110 ] 72 0.014% 98.455% ( 110, 170 ] 647 0.127% 98.582% ( 170, 250 ] 754 0.148% 98.730% ( 250, 380 ] 649 0.127% 98.857% ( 380, 580 ] 895 0.175% 99.032% ( 580, 870 ] 1150 0.225% 99.258% ( 870, 1300 ] 1214 0.238% 99.496% ( 1300, 1900 ] 919 0.180% 99.676% ( 1900, 2900 ] 801 0.157% 99.833% ( 2900, 4400 ] 645 0.126% 99.960% ( 4400, 6600 ] 177 0.035% 99.994% ( 6600, 9900 ] 19 0.004% 99.998% ( 9900, 14000 ] 11 0.002% 100.000% ( 14000, 22000 ] 21 0.004% 100.004% ( 22000, 33000 ] 17 0.003% 100.008% ( 33000, 50000 ] 11 0.002% 100.010% ( 50000, 75000 ] 1 0.000% 100.010% ( 75000, 110000 ] 1 0.000% 100.010% ** Level 1 read latency histogram (micros): Count: 118884 Average: 15.4329 StdDev: 260.94 Min: 1 Median: 2.4576 Max: 30836 Percentiles: P50: 2.46 P75: 3.54 P99: 14.30 P99.9: 3291.04 P99.99: 8840.92 ------------------------------------------------------ [ 0, 1 ] 508 0.427% 0.427% ( 1, 2 ] 39985 33.634% 34.061% ####### ( 2, 3 ] 41409 34.831% 68.892% ####### ( 3, 4 ] 13378 11.253% 80.145% ## ( 4, 6 ] 16691 14.040% 94.185% ### ( 6, 10 ] 4949 4.163% 98.348% # ( 10, 15 ] 902 0.759% 99.107% ( 15, 22 ] 129 0.109% 99.215% ( 22, 34 ] 15 0.013% 99.228% ( 34, 51 ] 10 0.008% 99.236% ( 51, 76 ] 8 0.007% 99.243% ( 76, 110 ] 8 0.007% 99.250% ( 110, 170 ] 93 0.078% 99.328% ( 170, 250 ] 83 0.070% 99.398% ( 250, 380 ] 76 0.064% 99.462% ( 380, 580 ] 86 0.072% 99.534% ( 580, 870 ] 108 0.091% 99.625% ( 870, 1300 ] 108 0.091% 99.716% ( 1300, 1900 ] 116 0.098% 99.813% ( 1900, 2900 ] 82 0.069% 99.882% ( 2900, 4400 ] 81 0.068% 99.950% ( 4400, 6600 ] 41 0.034% 99.985% ( 6600, 9900 ] 9 0.008% 99.992% ( 9900, 14000 ] 2 0.002% 99.994% ( 14000, 22000 ] 4 0.003% 99.997% ( 22000, 33000 ] 4 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 247642 Average: 16.9349 StdDev: 209.25 Min: 1 Median: 2.2099 Max: 17935 Percentiles: P50: 2.21 P75: 3.10 P99: 12.94 P99.9: 2823.66 P99.99: 4101.44 ------------------------------------------------------ [ 0, 1 ] 2863 1.156% 1.156% ( 1, 2 ] 105132 42.453% 43.609% ######## ( 2, 3 ] 75390 30.443% 74.052% ###### ( 3, 4 ] 24370 9.841% 83.893% ## ( 4, 6 ] 28724 11.599% 95.492% ## ( 6, 10 ] 7776 3.140% 98.632% # ( 10, 15 ] 1548 0.625% 99.257% ( 15, 22 ] 198 0.080% 99.337% ( 22, 34 ] 18 0.007% 99.345% ( 34, 51 ] 15 0.006% 99.351% ( 51, 76 ] 11 0.004% 99.355% ( 76, 110 ] 9 0.004% 99.359% ( 110, 170 ] 11 0.004% 99.363% ( 170, 250 ] 22 0.009% 99.372% ( 250, 380 ] 49 0.020% 99.392% ( 380, 580 ] 123 0.050% 99.442% ( 580, 870 ] 206 0.083% 99.525% ( 870, 1300 ] 266 0.107% 99.632% ( 1300, 1900 ] 341 0.138% 99.770% ( 1900, 2900 ] 349 0.141% 99.911% ( 2900, 4400 ] 245 0.099% 100.010% ( 4400, 6600 ] 85 0.034% 100.044% ( 6600, 9900 ] 27 0.011% 100.055% ( 9900, 14000 ] 2 0.001% 100.056% ( 14000, 22000 ] 2 0.001% 100.057% ** Level 3 read latency histogram (micros): Count: 1192477 Average: 11.7459 StdDev: 209.84 Min: 1 Median: 2.2163 Max: 39431 Percentiles: P50: 2.22 P75: 3.07 P99: 9.63 P99.9: 1266.92 P99.99: 2043.06 ------------------------------------------------------ [ 0, 1 ] 10148 0.851% 0.851% ( 1, 2 ] 506307 42.458% 43.309% ######## ( 2, 3 ] 368924 30.938% 74.247% ###### ( 3, 4 ] 120979 10.145% 84.392% ## ( 4, 6 ] 143883 12.066% 96.458% ## ( 6, 10 ] 33398 2.801% 99.259% # ( 10, 15 ] 4904 0.411% 99.670% ( 15, 22 ] 546 0.046% 99.716% ( 22, 34 ] 64 0.005% 99.721% ( 34, 51 ] 64 0.005% 99.727% ( 51, 76 ] 77 0.006% 99.733% ( 76, 110 ] 30 0.003% 99.736% ( 110, 170 ] 64 0.005% 99.741% ( 170, 250 ] 94 0.008% 99.749% ( 250, 380 ] 129 0.011% 99.760% ( 380, 580 ] 321 0.027% 99.787% ( 580, 870 ] 579 0.049% 99.835% ( 870, 1300 ] 838 0.070% 99.905% ( 1300, 1900 ] 883 0.074% 99.979% ( 1900, 2900 ] 879 0.074% 100.053% ( 2900, 4400 ] 724 0.061% 100.114% ( 4400, 6600 ] 247 0.021% 100.135% ( 6600, 9900 ] 58 0.005% 100.139% ( 9900, 14000 ] 11 0.001% 100.140% ( 14000, 22000 ] 19 0.002% 100.142% ( 22000, 33000 ] 17 0.001% 100.143% ( 33000, 50000 ] 5 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 1192608 Average: 22.0605 StdDev: 357.34 Min: 1 Median: 2.2104 Max: 78671 Percentiles: P50: 2.21 P75: 3.08 P99: 14.60 P99.9: 2338.57 P99.99: 3067.65 ------------------------------------------------------ [ 0, 1 ] 12777 1.071% 1.071% ( 1, 2 ] 506729 42.489% 43.560% ######## ( 2, 3 ] 365028 30.608% 74.168% ###### ( 3, 4 ] 119205 9.995% 84.163% ## ( 4, 6 ] 137465 11.526% 95.690% ## ( 6, 10 ] 34734 2.912% 98.602% # ( 10, 15 ] 5156 0.432% 99.035% ( 15, 22 ] 530 0.044% 99.079% ( 22, 34 ] 49 0.004% 99.083% ( 34, 51 ] 74 0.006% 99.089% ( 51, 76 ] 86 0.007% 99.097% ( 76, 110 ] 82 0.007% 99.103% ( 110, 170 ] 491 0.041% 99.145% ( 170, 250 ] 686 0.058% 99.202% ( 250, 380 ] 675 0.057% 99.259% ( 380, 580 ] 1133 0.095% 99.354% ( 580, 870 ] 1728 0.145% 99.499% ( 870, 1300 ] 2197 0.184% 99.683% ( 1300, 1900 ] 1865 0.156% 99.839% ( 1900, 2900 ] 1654 0.139% 99.978% ( 2900, 4400 ] 1295 0.109% 100.086% ( 4400, 6600 ] 468 0.039% 100.126% ( 6600, 9900 ] 78 0.007% 100.132% ( 9900, 14000 ] 24 0.002% 100.134% ( 14000, 22000 ] 63 0.005% 100.140% ( 22000, 33000 ] 44 0.004% 100.143% ( 33000, 50000 ] 26 0.002% 100.145% ( 50000, 75000 ] 1 0.000% 100.145% ( 75000, 110000 ] 1 0.000% 100.146% ** Level 5 read latency histogram (micros): Count: 30733 Average: 1360.0814 StdDev: 1951.97 Min: 84 Median: 753.9376 Max: 42957 Percentiles: P50: 753.94 P75: 1699.08 P99: 7866.48 P99.9: 27287.82 P99.99: 42957.00 ------------------------------------------------------ ( 76, 110 ] 322 1.048% 1.048% ( 110, 170 ] 3278 10.666% 11.714% ## ( 170, 250 ] 3091 10.058% 21.771% ## ( 250, 380 ] 2726 8.870% 30.641% ## ( 380, 580 ] 3440 11.193% 41.835% ## ( 580, 870 ] 4184 13.614% 55.449% ### ( 870, 1300 ] 4016 13.067% 68.516% ### ( 1300, 1900 ] 2996 9.748% 78.264% ## ( 1900, 2900 ] 2586 8.414% 86.679% ## ( 2900, 4400 ] 2350 7.647% 94.325% ## ( 4400, 6600 ] 1320 4.295% 98.620% # ( 6600, 9900 ] 304 0.989% 99.610% ( 9900, 14000 ] 33 0.107% 99.717% ( 14000, 22000 ] 38 0.124% 99.841% ( 22000, 33000 ] 38 0.124% 99.964% ( 33000, 50000 ] 11 0.036% 100.000% ** DB Stats ** Uptime(secs): 14.8 total, 7.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 133.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.790 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 141.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.068 H:M:S, 44.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/12-00:02:48 ... thread 0: (1000000,3000000) ops and (294202.5,166873.4) ops/second in (3.399019,17.977699) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.77 GB 81.8 2.2 0.0 2.2 4.9 2.8 0.0 1.8 73.7 168.5 29.90 17.70 44 0.680 2238K 2587 0.0 0.0 L1 11/11 999.20 MB 0.0 1.0 0.5 0.5 1.0 0.5 0.0 1.9 73.2 72.9 13.70 5.34 1 13.704 1018K 3603 0.0 0.0 L3 12/0 946.51 MB 0.9 2.2 1.5 0.7 2.2 1.4 0.2 1.5 99.3 97.8 22.73 10.71 12 1.894 1014K 660 0.0 0.0 L4 178/0 9.65 GB 1.0 9.1 4.5 4.6 9.0 4.4 0.2 2.0 110.3 108.1 84.81 46.60 45 1.885 3423K 12K 0.0 0.0 L5 1160/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/23 109.67 GB 0.0 14.5 6.5 7.9 17.0 9.1 4.9 6.1 98.0 115.3 151.14 80.35 102 1.482 7695K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.5 6.5 7.9 17.0 9.1 4.9 6.1 98.0 115.3 151.14 80.35 102 1.482 7695K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.5 6.5 7.9 14.3 6.3 0.0 0.0 110.6 109.0 133.95 71.85 65 2.061 7695K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 164.9 17.19 8.50 37 0.465 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.2 total, 18.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.02 GB write, 958.11 MB/s write, 14.47 GB read, 814.48 MB/s read, 151.1 seconds Interval compaction: 17.02 GB write, 969.48 MB/s write, 14.47 GB read, 824.14 MB/s read, 151.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 53, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 865621 Average: 16.6150 StdDev: 281.96 Min: 1 Median: 1.7874 Max: 84850 Percentiles: P50: 1.79 P75: 2.61 P99: 197.37 P99.9: 2642.41 P99.99: 4222.77 ------------------------------------------------------ [ 0, 1 ] 60369 6.974% 6.974% # ( 1, 2 ] 472985 54.641% 61.615% ########### ( 2, 3 ] 190244 21.978% 83.593% #### ( 3, 4 ] 54249 6.267% 89.860% # ( 4, 6 ] 59722 6.899% 96.759% # ( 6, 10 ] 14204 1.641% 98.400% ( 10, 15 ] 1866 0.216% 98.616% ( 15, 22 ] 197 0.023% 98.639% ( 22, 34 ] 24 0.003% 98.641% ( 34, 51 ] 7 0.001% 98.642% ( 51, 76 ] 18 0.002% 98.644% ( 76, 110 ] 281 0.032% 98.677% ( 110, 170 ] 2120 0.245% 98.922% ( 170, 250 ] 1987 0.230% 99.151% ( 250, 380 ] 1154 0.133% 99.284% ( 380, 580 ] 1276 0.147% 99.432% ( 580, 870 ] 1282 0.148% 99.580% ( 870, 1300 ] 1244 0.144% 99.724% ( 1300, 1900 ] 929 0.107% 99.831% ( 1900, 2900 ] 806 0.093% 99.924% ( 2900, 4400 ] 648 0.075% 99.999% ( 4400, 6600 ] 177 0.020% 100.019% ( 6600, 9900 ] 19 0.002% 100.022% ( 9900, 14000 ] 11 0.001% 100.023% ( 14000, 22000 ] 21 0.002% 100.025% ( 22000, 33000 ] 17 0.002% 100.027% ( 33000, 50000 ] 11 0.001% 100.029% ( 50000, 75000 ] 1 0.000% 100.029% ( 75000, 110000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 160848 Average: 13.4737 StdDev: 225.51 Min: 1 Median: 2.2229 Max: 30836 Percentiles: P50: 2.22 P75: 3.07 P99: 136.36 P99.9: 2628.00 P99.99: 6595.45 ------------------------------------------------------ [ 0, 1 ] 3455 2.148% 2.148% ( 1, 2 ] 65750 40.877% 43.025% ######## ( 2, 3 ] 50328 31.289% 74.314% ###### ( 3, 4 ] 14781 9.189% 83.504% ## ( 4, 6 ] 17872 11.111% 94.615% ## ( 6, 10 ] 5684 3.534% 98.149% # ( 10, 15 ] 954 0.593% 98.742% ( 15, 22 ] 137 0.085% 98.827% ( 22, 34 ] 17 0.011% 98.837% ( 34, 51 ] 11 0.007% 98.844% ( 51, 76 ] 9 0.006% 98.850% ( 76, 110 ] 50 0.031% 98.881% ( 110, 170 ] 436 0.271% 99.152% ( 170, 250 ] 368 0.229% 99.381% ( 250, 380 ] 216 0.134% 99.515% ( 380, 580 ] 194 0.121% 99.636% ( 580, 870 ] 133 0.083% 99.718% ( 870, 1300 ] 115 0.071% 99.790% ( 1300, 1900 ] 116 0.072% 99.862% ( 1900, 2900 ] 84 0.052% 99.914% ( 2900, 4400 ] 81 0.050% 99.965% ( 4400, 6600 ] 41 0.025% 99.990% ( 6600, 9900 ] 9 0.006% 99.996% ( 9900, 14000 ] 2 0.001% 99.997% ( 14000, 22000 ] 4 0.002% 99.999% ( 22000, 33000 ] 4 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 247660 Average: 16.9568 StdDev: 209.26 Min: 1 Median: 2.2100 Max: 17935 Percentiles: P50: 2.21 P75: 3.10 P99: 13.00 P99.9: 2823.61 P99.99: 4101.43 ------------------------------------------------------ [ 0, 1 ] 2863 1.156% 1.156% ( 1, 2 ] 105132 42.450% 43.606% ######## ( 2, 3 ] 75390 30.441% 74.047% ###### ( 3, 4 ] 24370 9.840% 83.887% ## ( 4, 6 ] 28724 11.598% 95.485% ## ( 6, 10 ] 7776 3.140% 98.625% # ( 10, 15 ] 1548 0.625% 99.250% ( 15, 22 ] 198 0.080% 99.330% ( 22, 34 ] 18 0.007% 99.337% ( 34, 51 ] 15 0.006% 99.343% ( 51, 76 ] 11 0.004% 99.348% ( 76, 110 ] 9 0.004% 99.352% ( 110, 170 ] 16 0.006% 99.358% ( 170, 250 ] 26 0.010% 99.368% ( 250, 380 ] 52 0.021% 99.389% ( 380, 580 ] 127 0.051% 99.441% ( 580, 870 ] 208 0.084% 99.525% ( 870, 1300 ] 266 0.107% 99.632% ( 1300, 1900 ] 341 0.138% 99.770% ( 1900, 2900 ] 349 0.141% 99.911% ( 2900, 4400 ] 245 0.099% 100.010% ( 4400, 6600 ] 85 0.034% 100.044% ( 6600, 9900 ] 27 0.011% 100.055% ( 9900, 14000 ] 2 0.001% 100.056% ( 14000, 22000 ] 2 0.001% 100.057% ** Level 3 read latency histogram (micros): Count: 1193074 Average: 11.8657 StdDev: 209.89 Min: 1 Median: 2.2171 Max: 39431 Percentiles: P50: 2.22 P75: 3.08 P99: 9.70 P99.9: 1267.83 P99.99: 2042.99 ------------------------------------------------------ [ 0, 1 ] 10148 0.851% 0.851% ( 1, 2 ] 506307 42.437% 43.288% ######## ( 2, 3 ] 368924 30.922% 74.210% ###### ( 3, 4 ] 120979 10.140% 84.350% ## ( 4, 6 ] 143883 12.060% 96.410% ## ( 6, 10 ] 33398 2.799% 99.209% # ( 10, 15 ] 4904 0.411% 99.620% ( 15, 22 ] 546 0.046% 99.666% ( 22, 34 ] 64 0.005% 99.671% ( 34, 51 ] 64 0.005% 99.677% ( 51, 76 ] 77 0.006% 99.683% ( 76, 110 ] 52 0.004% 99.688% ( 110, 170 ] 278 0.023% 99.711% ( 170, 250 ] 276 0.023% 99.734% ( 250, 380 ] 216 0.018% 99.752% ( 380, 580 ] 379 0.032% 99.784% ( 580, 870 ] 606 0.051% 99.835% ( 870, 1300 ] 843 0.071% 99.905% ( 1300, 1900 ] 885 0.074% 99.979% ( 1900, 2900 ] 879 0.074% 100.053% ( 2900, 4400 ] 724 0.061% 100.114% ( 4400, 6600 ] 247 0.021% 100.135% ( 6600, 9900 ] 58 0.005% 100.139% ( 9900, 14000 ] 11 0.001% 100.140% ( 14000, 22000 ] 19 0.002% 100.142% ( 22000, 33000 ] 17 0.001% 100.143% ( 33000, 50000 ] 5 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 1199040 Average: 23.0740 StdDev: 356.86 Min: 1 Median: 2.2189 Max: 78671 Percentiles: P50: 2.22 P75: 3.12 P99: 217.95 P99.9: 2335.36 P99.99: 3066.91 ------------------------------------------------------ [ 0, 1 ] 12777 1.066% 1.066% ( 1, 2 ] 506771 42.265% 43.330% ######## ( 2, 3 ] 365326 30.468% 73.799% ###### ( 3, 4 ] 119387 9.957% 83.755% ## ( 4, 6 ] 137706 11.485% 95.240% ## ( 6, 10 ] 34763 2.899% 98.139% # ( 10, 15 ] 5163 0.431% 98.570% ( 15, 22 ] 532 0.044% 98.614% ( 22, 34 ] 49 0.004% 98.618% ( 34, 51 ] 74 0.006% 98.625% ( 51, 76 ] 86 0.007% 98.632% ( 76, 110 ] 354 0.030% 98.661% ( 110, 170 ] 2677 0.223% 98.885% ( 170, 250 ] 2310 0.193% 99.077% ( 250, 380 ] 1379 0.115% 99.192% ( 380, 580 ] 1709 0.143% 99.335% ( 580, 870 ] 1957 0.163% 99.498% ( 870, 1300 ] 2231 0.186% 99.684% ( 1300, 1900 ] 1869 0.156% 99.840% ( 1900, 2900 ] 1656 0.138% 99.978% ( 2900, 4400 ] 1295 0.108% 100.086% ( 4400, 6600 ] 468 0.039% 100.125% ( 6600, 9900 ] 78 0.007% 100.132% ( 9900, 14000 ] 24 0.002% 100.134% ( 14000, 22000 ] 63 0.005% 100.139% ( 22000, 33000 ] 44 0.004% 100.142% ( 33000, 50000 ] 26 0.002% 100.145% ( 50000, 75000 ] 1 0.000% 100.145% ( 75000, 110000 ] 1 0.000% 100.145% ** Level 5 read latency histogram (micros): Count: 68032 Average: 745.8637 StdDev: 1430.97 Min: 82 Median: 254.4367 Max: 42957 Percentiles: P50: 254.44 P75: 714.94 P99: 6172.80 P99.9: 17993.26 P99.99: 39485.96 ------------------------------------------------------ ( 76, 110 ] 2223 3.268% 3.268% # ( 110, 170 ] 17695 26.010% 29.277% ##### ( 170, 250 ] 13839 20.342% 49.619% #### ( 250, 380 ] 7589 11.155% 60.774% ## ( 380, 580 ] 7063 10.382% 71.156% ## ( 580, 870 ] 5620 8.261% 79.417% ## ( 870, 1300 ] 4271 6.278% 85.695% # ( 1300, 1900 ] 3031 4.455% 90.150% # ( 1900, 2900 ] 2601 3.823% 93.973% # ( 2900, 4400 ] 2356 3.463% 97.437% # ( 4400, 6600 ] 1320 1.940% 99.377% ( 6600, 9900 ] 304 0.447% 99.824% ( 9900, 14000 ] 33 0.049% 99.872% ( 14000, 22000 ] 38 0.056% 99.928% ( 22000, 33000 ] 38 0.056% 99.984% ( 33000, 50000 ] 11 0.016% 100.000% ** DB Stats ** Uptime(secs): 18.2 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 162.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.790 H:M:S, 37.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/12-00:02:53 ... thread 0: (1000000,4000000) ops and (193988.8,172915.9) ops/second in (5.154937,23.132636) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.81 GB 214.0 3.4 0.0 3.4 7.2 3.8 0.0 1.9 90.4 192.2 38.33 25.49 66 0.581 3517K 3811 0.0 0.0 L1 11/11 999.20 MB 0.0 1.0 0.5 0.5 1.0 0.5 0.0 1.9 73.2 72.9 13.70 5.34 1 13.704 1018K 3603 0.0 0.0 L3 12/0 946.51 MB 0.9 2.2 1.5 0.7 2.2 1.4 0.2 1.5 99.3 97.8 22.73 10.71 12 1.894 1014K 660 0.0 0.0 L4 178/0 9.65 GB 1.0 9.1 4.5 4.6 9.0 4.4 0.2 2.0 110.3 108.1 84.81 46.60 45 1.885 3423K 12K 0.0 0.0 L5 1160/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1379/19 110.71 GB 0.0 15.7 6.5 9.2 19.3 10.1 4.9 5.1 100.8 123.8 159.57 88.14 124 1.287 8974K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.7 6.5 9.2 19.3 10.1 4.9 5.1 100.8 123.8 159.57 88.14 124 1.287 8974K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.7 6.5 9.2 15.5 6.3 0.0 0.0 115.7 114.1 138.98 76.75 70 1.985 8974K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 189.7 20.59 11.39 54 0.381 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.3 total, 23.1 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.30 GB write, 846.35 MB/s write, 15.70 GB read, 688.62 MB/s read, 159.6 seconds Interval compaction: 19.30 GB write, 854.15 MB/s write, 15.70 GB read, 694.97 MB/s read, 159.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 2, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 53, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1277189 Average: 15.0873 StdDev: 234.14 Min: 1 Median: 1.7091 Max: 84850 Percentiles: P50: 1.71 P75: 2.45 P99: 223.77 P99.9: 1860.26 P99.99: 3511.58 ------------------------------------------------------ [ 0, 1 ] 125296 9.810% 9.810% ## ( 1, 2 ] 723863 56.676% 66.487% ########### ( 2, 3 ] 242463 18.984% 85.471% #### ( 3, 4 ] 66283 5.190% 90.660% # ( 4, 6 ] 68405 5.356% 96.016% # ( 6, 10 ] 16446 1.288% 97.304% ( 10, 15 ] 2318 0.181% 97.485% ( 15, 22 ] 269 0.021% 97.507% ( 22, 34 ] 34 0.003% 97.509% ( 34, 51 ] 10 0.001% 97.510% ( 51, 76 ] 20 0.002% 97.512% ( 76, 110 ] 1474 0.115% 97.627% ( 110, 170 ] 12041 0.943% 98.570% ( 170, 250 ] 8175 0.640% 99.210% ( 250, 380 ] 2789 0.218% 99.428% ( 380, 580 ] 2256 0.177% 99.605% ( 580, 870 ] 1598 0.125% 99.730% ( 870, 1300 ] 1295 0.101% 99.831% ( 1300, 1900 ] 939 0.074% 99.905% ( 1900, 2900 ] 819 0.064% 99.969% ( 2900, 4400 ] 658 0.052% 100.021% ( 4400, 6600 ] 177 0.014% 100.034% ( 6600, 9900 ] 19 0.001% 100.036% ( 9900, 14000 ] 11 0.001% 100.037% ( 14000, 22000 ] 21 0.002% 100.038% ( 22000, 33000 ] 17 0.001% 100.040% ( 33000, 50000 ] 11 0.001% 100.041% ( 50000, 75000 ] 1 0.000% 100.041% ( 75000, 110000 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 191804 Average: 13.6254 StdDev: 207.83 Min: 1 Median: 2.1574 Max: 30836 Percentiles: P50: 2.16 P75: 3.02 P99: 199.56 P99.9: 2247.57 P99.99: 6375.69 ------------------------------------------------------ [ 0, 1 ] 4906 2.558% 2.558% # ( 1, 2 ] 82104 42.806% 45.364% ######### ( 2, 3 ] 56502 29.458% 74.822% ###### ( 3, 4 ] 17041 8.885% 83.707% ## ( 4, 6 ] 19988 10.421% 94.128% ## ( 6, 10 ] 6423 3.349% 97.477% # ( 10, 15 ] 1076 0.561% 98.038% ( 15, 22 ] 186 0.097% 98.135% ( 22, 34 ] 27 0.014% 98.149% ( 34, 51 ] 12 0.006% 98.155% ( 51, 76 ] 10 0.005% 98.160% ( 76, 110 ] 124 0.065% 98.225% ( 110, 170 ] 1150 0.600% 98.824% ( 170, 250 ] 912 0.475% 99.300% ( 250, 380 ] 389 0.203% 99.503% ( 380, 580 ] 323 0.168% 99.671% ( 580, 870 ] 168 0.088% 99.759% ( 870, 1300 ] 124 0.065% 99.823% ( 1300, 1900 ] 118 0.062% 99.885% ( 1900, 2900 ] 84 0.044% 99.929% ( 2900, 4400 ] 81 0.042% 99.971% ( 4400, 6600 ] 41 0.021% 99.992% ( 6600, 9900 ] 9 0.005% 99.997% ( 9900, 14000 ] 2 0.001% 99.998% ( 14000, 22000 ] 4 0.002% 100.000% ( 22000, 33000 ] 4 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 247693 Average: 16.9821 StdDev: 209.26 Min: 1 Median: 2.2103 Max: 17935 Percentiles: P50: 2.21 P75: 3.10 P99: 13.10 P99.9: 2823.52 P99.99: 4101.41 ------------------------------------------------------ [ 0, 1 ] 2863 1.156% 1.156% ( 1, 2 ] 105132 42.444% 43.600% ######## ( 2, 3 ] 75390 30.437% 74.037% ###### ( 3, 4 ] 24370 9.839% 83.876% ## ( 4, 6 ] 28724 11.597% 95.473% ## ( 6, 10 ] 7776 3.139% 98.612% # ( 10, 15 ] 1548 0.625% 99.237% ( 15, 22 ] 198 0.080% 99.317% ( 22, 34 ] 18 0.007% 99.324% ( 34, 51 ] 15 0.006% 99.330% ( 51, 76 ] 11 0.004% 99.335% ( 76, 110 ] 12 0.005% 99.340% ( 110, 170 ] 28 0.011% 99.351% ( 170, 250 ] 37 0.015% 99.366% ( 250, 380 ] 56 0.023% 99.388% ( 380, 580 ] 129 0.052% 99.440% ( 580, 870 ] 209 0.084% 99.525% ( 870, 1300 ] 266 0.107% 99.632% ( 1300, 1900 ] 341 0.138% 99.770% ( 1900, 2900 ] 349 0.141% 99.911% ( 2900, 4400 ] 245 0.099% 100.010% ( 4400, 6600 ] 85 0.034% 100.044% ( 6600, 9900 ] 27 0.011% 100.055% ( 9900, 14000 ] 2 0.001% 100.056% ( 14000, 22000 ] 2 0.001% 100.057% ** Level 3 read latency histogram (micros): Count: 1194066 Average: 12.0263 StdDev: 209.91 Min: 1 Median: 2.2184 Max: 39431 Percentiles: P50: 2.22 P75: 3.08 P99: 9.82 P99.9: 1267.51 P99.99: 2042.88 ------------------------------------------------------ [ 0, 1 ] 10148 0.850% 0.850% ( 1, 2 ] 506307 42.402% 43.252% ######## ( 2, 3 ] 368924 30.896% 74.148% ###### ( 3, 4 ] 120979 10.132% 84.280% ## ( 4, 6 ] 143883 12.050% 96.330% ## ( 6, 10 ] 33398 2.797% 99.127% # ( 10, 15 ] 4904 0.411% 99.537% ( 15, 22 ] 546 0.046% 99.583% ( 22, 34 ] 64 0.005% 99.589% ( 34, 51 ] 64 0.005% 99.594% ( 51, 76 ] 77 0.006% 99.600% ( 76, 110 ] 111 0.009% 99.610% ( 110, 170 ] 757 0.063% 99.673% ( 170, 250 ] 557 0.047% 99.720% ( 250, 380 ] 297 0.025% 99.745% ( 380, 580 ] 447 0.037% 99.782% ( 580, 870 ] 625 0.052% 99.834% ( 870, 1300 ] 848 0.071% 99.905% ( 1300, 1900 ] 885 0.074% 99.979% ( 1900, 2900 ] 879 0.074% 100.053% ( 2900, 4400 ] 724 0.061% 100.114% ( 4400, 6600 ] 247 0.021% 100.134% ( 6600, 9900 ] 58 0.005% 100.139% ( 9900, 14000 ] 11 0.001% 100.140% ( 14000, 22000 ] 19 0.002% 100.142% ( 22000, 33000 ] 17 0.001% 100.143% ( 33000, 50000 ] 5 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 1210105 Average: 24.6986 StdDev: 355.85 Min: 1 Median: 2.2339 Max: 78671 Percentiles: P50: 2.23 P75: 3.19 P99: 295.85 P99.9: 2330.32 P99.99: 3066.65 ------------------------------------------------------ [ 0, 1 ] 12777 1.056% 1.056% ( 1, 2 ] 506793 41.880% 42.936% ######## ( 2, 3 ] 365401 30.196% 73.132% ###### ( 3, 4 ] 119444 9.871% 83.002% ## ( 4, 6 ] 137761 11.384% 94.387% ## ( 6, 10 ] 34775 2.874% 97.260% # ( 10, 15 ] 5167 0.427% 97.687% ( 15, 22 ] 532 0.044% 97.731% ( 22, 34 ] 49 0.004% 97.735% ( 34, 51 ] 74 0.006% 97.741% ( 51, 76 ] 86 0.007% 97.748% ( 76, 110 ] 932 0.077% 97.825% ( 110, 170 ] 7838 0.648% 98.473% ( 170, 250 ] 5544 0.458% 98.931% ( 250, 380 ] 2356 0.195% 99.126% ( 380, 580 ] 2358 0.195% 99.321% ( 580, 870 ] 2162 0.179% 99.500% ( 870, 1300 ] 2262 0.187% 99.686% ( 1300, 1900 ] 1870 0.155% 99.841% ( 1900, 2900 ] 1659 0.137% 99.978% ( 2900, 4400 ] 1296 0.107% 100.085% ( 4400, 6600 ] 468 0.039% 100.124% ( 6600, 9900 ] 78 0.006% 100.130% ( 9900, 14000 ] 24 0.002% 100.132% ( 14000, 22000 ] 63 0.005% 100.138% ( 22000, 33000 ] 44 0.004% 100.141% ( 33000, 50000 ] 26 0.002% 100.143% ( 50000, 75000 ] 1 0.000% 100.143% ( 75000, 110000 ] 1 0.000% 100.143% ** Level 5 read latency histogram (micros): Count: 130564 Average: 488.4029 StdDev: 1071.86 Min: 81 Median: 200.8493 Max: 42957 Percentiles: P50: 200.85 P75: 375.45 P99: 5130.60 P99.9: 9785.33 P99.99: 32404.73 ------------------------------------------------------ ( 76, 110 ] 5767 4.417% 4.417% # ( 110, 170 ] 47060 36.044% 40.461% ####### ( 170, 250 ] 32299 24.738% 65.199% ##### ( 250, 380 ] 13261 10.157% 75.355% ## ( 380, 580 ] 10958 8.393% 83.748% ## ( 580, 870 ] 6901 5.286% 89.034% # ( 870, 1300 ] 4500 3.447% 92.480% # ( 1300, 1900 ] 3075 2.355% 94.835% ( 1900, 2900 ] 2634 2.017% 96.853% ( 2900, 4400 ] 2365 1.811% 98.664% ( 4400, 6600 ] 1320 1.011% 99.675% ( 6600, 9900 ] 304 0.233% 99.908% ( 9900, 14000 ] 33 0.025% 99.933% ( 14000, 22000 ] 38 0.029% 99.962% ( 22000, 33000 ] 38 0.029% 99.992% ( 33000, 50000 ] 11 0.008% 100.000% ** DB Stats ** Uptime(secs): 23.3 total, 5.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 168.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.381 H:M:S, 35.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 190.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.592 H:M:S, 30.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 290.628 micros/op 13755 ops/sec 60.123 seconds 826996 operations; 13.3 MB/s (207999 of 207999 found) Microseconds per read: Count: 826996 Average: 290.6306 StdDev: 1005.58 Min: 2 Median: 204.9392 Max: 101309 Percentiles: P50: 204.94 P75: 247.63 P99: 1440.85 P99.9: 18169.06 P99.99: 41467.06 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 23 0.003% 0.004% ( 3, 4 ] 43 0.005% 0.009% ( 4, 6 ] 66 0.008% 0.017% ( 6, 10 ] 243 0.029% 0.046% ( 10, 15 ] 1759 0.213% 0.259% ( 15, 22 ] 1450 0.175% 0.434% ( 22, 34 ] 3986 0.482% 0.916% ( 34, 51 ] 1338 0.162% 1.078% ( 51, 76 ] 202 0.024% 1.102% ( 76, 110 ] 2131 0.258% 1.360% ( 110, 170 ] 233059 28.181% 29.541% ###### ( 170, 250 ] 387397 46.844% 76.385% ######### ( 250, 380 ] 109616 13.255% 89.640% ### ( 380, 580 ] 53023 6.412% 96.051% # ( 580, 870 ] 17118 2.070% 98.121% ( 870, 1300 ] 6551 0.792% 98.914% ( 1300, 1900 ] 3046 0.368% 99.282% ( 1900, 2900 ] 2191 0.265% 99.547% ( 2900, 4400 ] 1597 0.193% 99.740% ( 4400, 6600 ] 619 0.075% 99.815% ( 6600, 9900 ] 169 0.020% 99.835% ( 9900, 14000 ] 166 0.020% 99.855% ( 14000, 22000 ] 710 0.086% 99.941% ( 22000, 33000 ] 353 0.043% 99.984% ( 33000, 50000 ] 103 0.012% 99.996% ( 50000, 75000 ] 27 0.003% 100.000% ( 75000, 110000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14973896 rocksdb.bloom.filter.full.positive COUNT : 972973 rocksdb.bloom.filter.full.true.positive COUNT : 826630 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 366 rocksdb.memtable.miss COUNT : 826630 rocksdb.l0.hit COUNT : 35869 rocksdb.l1.hit COUNT : 7851 rocksdb.l2andup.hit COUNT : 782910 rocksdb.compaction.key.drop.new COUNT : 259237 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4987076 rocksdb.number.keys.read COUNT : 826996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5146662432 rocksdb.bytes.read COUNT : 826996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1645 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 40985587 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 21818624396 rocksdb.compact.write.bytes COUNT : 21555153451 rocksdb.flush.write.bytes COUNT : 5086430560 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 35 rocksdb.number.superversion_acquires COUNT : 949 rocksdb.number.superversion_releases COUNT : 917 rocksdb.number.superversion_cleanups COUNT : 237 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 215 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5045397504 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1943552 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25257620015 rocksdb.non.last.level.read.count COUNT : 5957566 rocksdb.block.checksum.compute.count COUNT : 6269376 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 204.017303 P95 : 546.288230 P99 : 1439.515271 P100 : 101305.000000 COUNT : 826996 SUM : 239578691 rocksdb.db.write.micros P50 : 1.538440 P95 : 4.486243 P99 : 9.776347 P100 : 924116.000000 COUNT : 4987076 SUM : 53701184 rocksdb.compaction.times.micros P50 : 1596666.666667 P95 : 4077272.727273 P99 : 10850000.000000 P100 : 13703583.000000 COUNT : 75 SUM : 148877920 rocksdb.compaction.times.cpu_micros P50 : 980416.666667 P95 : 2608333.333333 P99 : 5675000.000000 P100 : 5870654.000000 COUNT : 75 SUM : 86423770 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 848.676471 P95 : 30525.000000 P99 : 55967.000000 P100 : 55967.000000 COUNT : 69 SUM : 346990 rocksdb.compaction.outfile.sync.micros P50 : 24566.666667 P95 : 210444.444444 P99 : 499225.000000 P100 : 847957.000000 COUNT : 249 SUM : 14148138 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 480.000000 P95 : 5665.000000 P99 : 8118.000000 P100 : 9543.000000 COUNT : 162 SUM : 231553 rocksdb.table.open.io.micros P50 : 12129.089219 P95 : 23232.758621 P99 : 31552.298851 P100 : 57500.000000 COUNT : 1645 SUM : 19743597 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.096884 P95 : 12.674705 P99 : 219.035934 P100 : 84855.000000 COUNT : 5284909 SUM : 101743391 rocksdb.read.block.get.micros P50 : 156.495985 P95 : 396.631855 P99 : 1457.077348 P100 : 57824.000000 COUNT : 982807 SUM : 204830741 rocksdb.write.raw.block.micros P50 : 0.530612 P95 : 1.200001 P99 : 3.483847 P100 : 66915.000000 COUNT : 6452689 SUM : 22711258 rocksdb.numfiles.in.singlecompaction P50 : 3.132353 P95 : 6.350000 P99 : 15.490000 P100 : 19.000000 COUNT : 93 SUM : 349 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574294 P95 : 1994.326824 P99 : 2720.674203 P100 : 923950.000000 COUNT : 176684 SUM : 41002735 rocksdb.sst.read.micros P50 : 2.243632 P95 : 201.417833 P99 : 492.013215 P100 : 84850.000000 COUNT : 5957600 SUM : 290189434 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 826996 SUM : 826996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4987076 SUM : 5146662432 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223076.923077 P95 : 1053375.000000 P99 : 1161078.000000 P100 : 1161078.000000 COUNT : 69 SUM : 23597835 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 275 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0