[2024-12-09 15:43:04.948150] Starting SPDK v25.01-pre git sha1 b8248e28c / DPDK 24.03.0 initialization... [2024-12-09 15:43:04.948318] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid637382 ] Set seed to 1733755384944457 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 15:43:05.089236] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 15:43:05.193172] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 15:43:05.193232] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 637382' to capture a snapshot of events at runtime. [2024-12-09 15:43:05.193245] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 15:43:05.193258] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 15:43:05.193268] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid637382 for offline analysis/debug. [2024-12-09 15:43:05.194625] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 15:43:08 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/09-15:43:14 ... thread 0: (1000000,1000000) ops and (155601.7,155601.7) ops/second in (6.426665,6.426665) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.32 GB 50.1 0.3 0.0 0.3 1.2 0.9 0.0 1.4 39.5 149.8 7.96 4.01 12 0.663 319K 1849 0.0 0.0 L1 5/5 397.93 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/3 1.12 GB 1.0 1.9 1.4 0.5 1.9 1.4 0.0 1.3 107.0 105.5 18.37 11.04 9 2.041 1559K 7563 0.0 0.0 L4 148/12 10.63 GB 1.0 3.0 1.7 1.3 2.8 1.5 0.3 1.7 122.9 116.8 24.66 15.26 14 1.761 691K 503 0.0 0.0 L5 132/0 10.58 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 319/29 24.04 GB 0.0 5.2 3.1 2.1 5.9 3.8 2.0 6.8 104.1 117.9 50.99 30.31 35 1.457 2570K 9915 0.0 0.0 Int 0/0 0.00 KB 0.0 5.2 3.1 2.1 5.9 3.8 2.0 6.8 104.1 117.9 50.99 30.31 35 1.457 2570K 9915 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.2 3.1 2.1 5.0 2.9 0.0 0.0 118.0 114.0 45.00 27.63 24 1.875 2570K 9915 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 147.0 5.99 2.68 11 0.544 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.5 total, 6.4 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.87 GB write, 925.62 MB/s write, 5.19 GB read, 817.53 MB/s read, 51.0 seconds Interval compaction: 5.87 GB write, 934.44 MB/s write, 5.19 GB read, 825.33 MB/s read, 51.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 19, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 186743 Average: 44.5758 StdDev: 489.34 Min: 1 Median: 2.1845 Max: 79250 Percentiles: P50: 2.18 P75: 3.19 P99: 952.84 P99.9: 4224.71 P99.99: 9128.74 ------------------------------------------------------ [ 0, 1 ] 3864 2.069% 2.069% ( 1, 2 ] 79712 42.685% 44.755% ######### ( 2, 3 ] 53099 28.434% 73.189% ###### ( 3, 4 ] 17663 9.458% 82.647% ## ( 4, 6 ] 18844 10.091% 92.738% ## ( 6, 10 ] 5068 2.714% 95.452% # ( 10, 15 ] 1177 0.630% 96.082% ( 15, 22 ] 186 0.100% 96.182% ( 22, 34 ] 22 0.012% 96.194% ( 34, 51 ] 30 0.016% 96.210% ( 51, 76 ] 18 0.010% 96.219% ( 76, 110 ] 6 0.003% 96.223% ( 110, 170 ] 47 0.025% 96.248% ( 170, 250 ] 382 0.205% 96.452% ( 250, 380 ] 1060 0.568% 97.020% ( 380, 580 ] 1798 0.963% 97.983% ( 580, 870 ] 1737 0.930% 98.913% ( 870, 1300 ] 849 0.455% 99.368% ( 1300, 1900 ] 313 0.168% 99.535% ( 1900, 2900 ] 329 0.176% 99.711% ( 2900, 4400 ] 400 0.214% 99.926% ( 4400, 6600 ] 106 0.057% 99.982% ( 6600, 9900 ] 20 0.011% 99.993% ( 9900, 14000 ] 6 0.003% 99.996% ( 14000, 22000 ] 19 0.010% 100.006% ( 22000, 33000 ] 11 0.006% 100.012% ( 33000, 50000 ] 3 0.002% 100.014% ( 50000, 75000 ] 2 0.001% 100.015% ( 75000, 110000 ] 1 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 397 Average: 1014.9370 StdDev: 1478.75 Min: 101 Median: 593.0500 Max: 19995 Percentiles: P50: 593.05 P75: 913.58 P99: 6333.25 P99.9: 18824.00 P99.99: 19995.00 ------------------------------------------------------ ( 76, 110 ] 1 0.252% 0.252% ( 110, 170 ] 5 1.259% 1.511% ( 170, 250 ] 20 5.038% 6.549% # ( 250, 380 ] 62 15.617% 22.166% ### ( 380, 580 ] 106 26.700% 48.866% ##### ( 580, 870 ] 100 25.189% 74.055% ##### ( 870, 1300 ] 37 9.320% 83.375% ## ( 1300, 1900 ] 11 2.771% 86.146% # ( 1900, 2900 ] 26 6.549% 92.695% # ( 2900, 4400 ] 18 4.534% 97.229% # ( 4400, 6600 ] 8 2.015% 99.244% ( 6600, 9900 ] 1 0.252% 99.496% ( 9900, 14000 ] 1 0.252% 99.748% ( 14000, 22000 ] 1 0.252% 100.000% ** Level 2 read latency histogram (micros): Count: 303472 Average: 16.7515 StdDev: 351.64 Min: 1 Median: 2.2540 Max: 49425 Percentiles: P50: 2.25 P75: 3.26 P99: 13.63 P99.9: 2078.53 P99.99: 3784.35 ------------------------------------------------------ [ 0, 1 ] 3399 1.120% 1.120% ( 1, 2 ] 125464 41.343% 42.463% ######## ( 2, 3 ] 90052 29.674% 72.137% ###### ( 3, 4 ] 33525 11.047% 83.184% ## ( 4, 6 ] 37098 12.225% 95.408% ## ( 6, 10 ] 9031 2.976% 98.384% # ( 10, 15 ] 2574 0.848% 99.233% ( 15, 22 ] 439 0.145% 99.377% ( 22, 34 ] 61 0.020% 99.397% ( 34, 51 ] 78 0.026% 99.423% ( 51, 76 ] 56 0.018% 99.441% ( 76, 110 ] 22 0.007% 99.449% ( 110, 170 ] 26 0.009% 99.457% ( 170, 250 ] 105 0.035% 99.492% ( 250, 380 ] 269 0.089% 99.581% ( 380, 580 ] 358 0.118% 99.698% ( 580, 870 ] 266 0.088% 99.786% ( 870, 1300 ] 154 0.051% 99.837% ( 1300, 1900 ] 161 0.053% 99.890% ( 1900, 2900 ] 171 0.056% 99.946% ( 2900, 4400 ] 225 0.074% 100.020% ( 4400, 6600 ] 87 0.029% 100.049% ( 6600, 9900 ] 24 0.008% 100.057% ( 9900, 14000 ] 24 0.008% 100.065% ( 14000, 22000 ] 37 0.012% 100.077% ( 22000, 33000 ] 10 0.003% 100.080% ( 33000, 50000 ] 5 0.002% 100.082% ** Level 3 read latency histogram (micros): Count: 476031 Average: 15.5073 StdDev: 280.16 Min: 1 Median: 2.3124 Max: 55398 Percentiles: P50: 2.31 P75: 3.31 P99: 14.42 P99.9: 1298.96 P99.99: 2567.90 ------------------------------------------------------ [ 0, 1 ] 4227 0.888% 0.888% ( 1, 2 ] 187254 39.337% 40.224% ######## ( 2, 3 ] 148936 31.287% 71.512% ###### ( 3, 4 ] 53661 11.273% 82.784% ## ( 4, 6 ] 59396 12.477% 95.261% ## ( 6, 10 ] 14787 3.106% 98.368% # ( 10, 15 ] 3406 0.715% 99.083% ( 15, 22 ] 469 0.099% 99.182% ( 22, 34 ] 77 0.016% 99.198% ( 34, 51 ] 151 0.032% 99.230% ( 51, 76 ] 116 0.024% 99.254% ( 76, 110 ] 51 0.011% 99.265% ( 110, 170 ] 54 0.011% 99.276% ( 170, 250 ] 237 0.050% 99.326% ( 250, 380 ] 563 0.118% 99.444% ( 380, 580 ] 933 0.196% 99.640% ( 580, 870 ] 813 0.171% 99.811% ( 870, 1300 ] 425 0.089% 99.900% ( 1300, 1900 ] 213 0.045% 99.945% ( 1900, 2900 ] 321 0.067% 100.012% ( 2900, 4400 ] 360 0.076% 100.088% ( 4400, 6600 ] 79 0.017% 100.105% ( 6600, 9900 ] 27 0.006% 100.110% ( 9900, 14000 ] 13 0.003% 100.113% ( 14000, 22000 ] 33 0.007% 100.120% ( 22000, 33000 ] 15 0.003% 100.123% ( 33000, 50000 ] 1 0.000% 100.123% ( 50000, 75000 ] 1 0.000% 100.124% ** Level 4 read latency histogram (micros): Count: 525033 Average: 30.5435 StdDev: 443.68 Min: 1 Median: 2.3389 Max: 91092 Percentiles: P50: 2.34 P75: 3.42 P99: 560.55 P99.9: 1558.34 P99.99: 2132.54 ------------------------------------------------------ [ 0, 1 ] 4585 0.873% 0.873% ( 1, 2 ] 203544 38.768% 39.641% ######## ( 2, 3 ] 160491 30.568% 70.209% ###### ( 3, 4 ] 60477 11.519% 81.728% ## ( 4, 6 ] 64704 12.324% 94.051% ## ( 6, 10 ] 15681 2.987% 97.038% # ( 10, 15 ] 3699 0.705% 97.743% ( 15, 22 ] 480 0.091% 97.834% ( 22, 34 ] 79 0.015% 97.849% ( 34, 51 ] 132 0.025% 97.874% ( 51, 76 ] 148 0.028% 97.902% ( 76, 110 ] 35 0.007% 97.909% ( 110, 170 ] 139 0.026% 97.936% ( 170, 250 ] 656 0.125% 98.061% ( 250, 380 ] 1961 0.374% 98.434% ( 380, 580 ] 3294 0.627% 99.061% ( 580, 870 ] 2820 0.537% 99.599% ( 870, 1300 ] 1346 0.256% 99.855% ( 1300, 1900 ] 555 0.106% 99.961% ( 1900, 2900 ] 673 0.128% 100.089% ( 2900, 4400 ] 840 0.160% 100.249% ( 4400, 6600 ] 196 0.037% 100.286% ( 6600, 9900 ] 25 0.005% 100.291% ( 9900, 14000 ] 7 0.001% 100.292% ( 14000, 22000 ] 27 0.005% 100.297% ( 22000, 33000 ] 22 0.004% 100.302% ( 33000, 50000 ] 11 0.002% 100.304% ( 50000, 75000 ] 3 0.001% 100.304% ( 75000, 110000 ] 3 0.001% 100.305% ** Level 5 read latency histogram (micros): Count: 7720 Average: 1047.5850 StdDev: 1751.54 Min: 106 Median: 599.5541 Max: 42954 Percentiles: P50: 599.63 P75: 985.10 P99: 6001.13 P99.9: 26279.00 P99.99: 34937.15 ------------------------------------------------------ ( 76, 110 ] 3 0.039% 0.039% ( 110, 170 ] 66 0.855% 0.894% ( 170, 250 ] 403 5.220% 6.114% # ( 250, 380 ] 1180 15.285% 21.399% ### ( 380, 580 ] 2084 26.995% 48.394% ##### ( 580, 870 ] 1839 23.821% 72.215% ##### ( 870, 1300 ] 806 10.440% 82.655% ## ( 1300, 1900 ] 324 4.197% 86.852% # ( 1900, 2900 ] 365 4.728% 91.580% # ( 2900, 4400 ] 485 6.282% 97.863% # ( 4400, 6600 ] 122 1.580% 99.443% ( 6600, 9900 ] 15 0.194% 99.637% ( 9900, 14000 ] 3 0.039% 99.676% ( 14000, 22000 ] 14 0.181% 99.858% ( 22000, 33000 ] 11 0.142% 100.000% ( 33000, 50000 ] 2 0.026% 100.026% ** DB Stats ** Uptime(secs): 6.5 total, 6.4 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 151.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.858 H:M:S, 28.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 152.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.858 H:M:S, 28.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/09-15:43:18 ... thread 0: (1000000,2000000) ops and (265944.5,196331.6) ops/second in (3.760183,10.186848) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 2.29 GB 162.7 1.4 0.0 1.4 3.2 1.8 0.0 1.8 77.7 178.6 18.61 11.52 32 0.582 1468K 8332 0.0 0.0 L1 5/5 397.93 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 956.77 MB 1.0 1.9 1.4 0.5 1.9 1.4 0.0 1.3 107.0 105.5 18.37 11.04 9 2.041 1559K 7563 0.0 0.0 L4 140/0 9.71 GB 1.0 4.1 1.9 2.3 3.8 1.5 0.3 2.0 136.9 125.9 30.87 19.95 17 1.816 884K 503 0.0 0.0 L5 144/0 11.51 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 324/14 24.83 GB 0.0 7.5 3.3 4.2 8.9 4.8 2.9 4.9 112.6 134.9 67.86 42.51 58 1.170 3912K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.5 3.3 4.2 8.9 4.8 2.9 4.9 112.6 134.9 67.86 42.51 58 1.170 3912K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.5 3.3 4.2 7.1 2.9 0.0 0.0 130.6 124.2 58.51 36.91 31 1.888 3912K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 202.0 9.34 5.60 27 0.346 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.3 total, 10.2 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.94 GB write, 892.42 MB/s write, 7.46 GB read, 744.96 MB/s read, 67.9 seconds Interval compaction: 8.94 GB write, 897.79 MB/s write, 7.46 GB read, 749.44 MB/s read, 67.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 19, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 555269 Average: 26.7600 StdDev: 292.25 Min: 1 Median: 1.7516 Max: 79250 Percentiles: P50: 1.75 P75: 2.62 P99: 475.48 P99.9: 1959.97 P99.99: 3614.27 ------------------------------------------------------ [ 0, 1 ] 52746 9.499% 9.499% ## ( 1, 2 ] 299223 53.888% 63.387% ########### ( 2, 3 ] 104645 18.846% 82.233% #### ( 3, 4 ] 30574 5.506% 87.739% # ( 4, 6 ] 27114 4.883% 92.622% # ( 6, 10 ] 8091 1.457% 94.079% ( 10, 15 ] 1521 0.274% 94.353% ( 15, 22 ] 234 0.042% 94.395% ( 22, 34 ] 36 0.006% 94.402% ( 34, 51 ] 35 0.006% 94.408% ( 51, 76 ] 18 0.003% 94.411% ( 76, 110 ] 177 0.032% 94.443% ( 110, 170 ] 4569 0.823% 95.266% ( 170, 250 ] 13348 2.404% 97.670% ( 250, 380 ] 5775 1.040% 98.710% ( 380, 580 ] 3375 0.608% 99.318% ( 580, 870 ] 2020 0.364% 99.682% ( 870, 1300 ] 876 0.158% 99.839% ( 1300, 1900 ] 318 0.057% 99.897% ( 1900, 2900 ] 329 0.059% 99.956% ( 2900, 4400 ] 400 0.072% 100.028% ( 4400, 6600 ] 106 0.019% 100.047% ( 6600, 9900 ] 22 0.004% 100.051% ( 9900, 14000 ] 10 0.002% 100.053% ( 14000, 22000 ] 20 0.004% 100.056% ( 22000, 33000 ] 11 0.002% 100.058% ( 33000, 50000 ] 3 0.001% 100.059% ( 50000, 75000 ] 2 0.000% 100.059% ( 75000, 110000 ] 1 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 62649 Average: 15.0253 StdDev: 164.33 Min: 1 Median: 2.5764 Max: 19995 Percentiles: P50: 2.58 P75: 3.77 P99: 296.46 P99.9: 1537.33 P99.99: 5977.15 ------------------------------------------------------ [ 0, 1 ] 792 1.264% 1.264% ( 1, 2 ] 18584 29.664% 30.928% ###### ( 2, 3 ] 20730 33.089% 64.017% ####### ( 3, 4 ] 8993 14.355% 78.372% ### ( 4, 6 ] 8448 13.485% 91.856% ### ( 6, 10 ] 2500 3.990% 95.847% # ( 10, 15 ] 649 1.036% 96.883% ( 15, 22 ] 248 0.396% 97.278% ( 22, 34 ] 37 0.059% 97.338% ( 34, 51 ] 13 0.021% 97.358% ( 76, 110 ] 14 0.022% 97.381% ( 110, 170 ] 232 0.370% 97.751% ( 170, 250 ] 661 1.055% 98.806% ( 250, 380 ] 340 0.543% 99.349% ( 380, 580 ] 187 0.298% 99.647% ( 580, 870 ] 115 0.184% 99.831% ( 870, 1300 ] 39 0.062% 99.893% ( 1300, 1900 ] 11 0.018% 99.911% ( 1900, 2900 ] 26 0.042% 99.952% ( 2900, 4400 ] 18 0.029% 99.981% ( 4400, 6600 ] 8 0.013% 99.994% ( 6600, 9900 ] 2 0.003% 99.997% ( 9900, 14000 ] 1 0.002% 99.998% ( 14000, 22000 ] 2 0.003% 100.002% ** Level 2 read latency histogram (micros): Count: 303472 Average: 16.7515 StdDev: 351.64 Min: 1 Median: 2.2540 Max: 49425 Percentiles: P50: 2.25 P75: 3.26 P99: 13.63 P99.9: 2078.53 P99.99: 3784.35 ------------------------------------------------------ [ 0, 1 ] 3399 1.120% 1.120% ( 1, 2 ] 125464 41.343% 42.463% ######## ( 2, 3 ] 90052 29.674% 72.137% ###### ( 3, 4 ] 33525 11.047% 83.184% ## ( 4, 6 ] 37098 12.225% 95.408% ## ( 6, 10 ] 9031 2.976% 98.384% # ( 10, 15 ] 2574 0.848% 99.233% ( 15, 22 ] 439 0.145% 99.377% ( 22, 34 ] 61 0.020% 99.397% ( 34, 51 ] 78 0.026% 99.423% ( 51, 76 ] 56 0.018% 99.441% ( 76, 110 ] 22 0.007% 99.449% ( 110, 170 ] 26 0.009% 99.457% ( 170, 250 ] 105 0.035% 99.492% ( 250, 380 ] 269 0.089% 99.581% ( 380, 580 ] 358 0.118% 99.698% ( 580, 870 ] 266 0.088% 99.786% ( 870, 1300 ] 154 0.051% 99.837% ( 1300, 1900 ] 161 0.053% 99.890% ( 1900, 2900 ] 171 0.056% 99.946% ( 2900, 4400 ] 225 0.074% 100.020% ( 4400, 6600 ] 87 0.029% 100.049% ( 6600, 9900 ] 24 0.008% 100.057% ( 9900, 14000 ] 24 0.008% 100.065% ( 14000, 22000 ] 37 0.012% 100.077% ( 22000, 33000 ] 10 0.003% 100.080% ( 33000, 50000 ] 5 0.002% 100.082% ** Level 3 read latency histogram (micros): Count: 490136 Average: 16.6499 StdDev: 277.12 Min: 1 Median: 2.3051 Max: 55398 Percentiles: P50: 2.31 P75: 3.32 P99: 214.23 P99.9: 1284.76 P99.99: 2560.39 ------------------------------------------------------ [ 0, 1 ] 5095 1.040% 1.040% ( 1, 2 ] 193885 39.557% 40.597% ######## ( 2, 3 ] 151056 30.819% 71.416% ###### ( 3, 4 ] 54255 11.069% 82.485% ## ( 4, 6 ] 59863 12.214% 94.699% ## ( 6, 10 ] 15006 3.062% 97.761% # ( 10, 15 ] 3435 0.701% 98.461% ( 15, 22 ] 475 0.097% 98.558% ( 22, 34 ] 77 0.016% 98.574% ( 34, 51 ] 152 0.031% 98.605% ( 51, 76 ] 116 0.024% 98.629% ( 76, 110 ] 76 0.016% 98.644% ( 110, 170 ] 691 0.141% 98.785% ( 170, 250 ] 1904 0.388% 99.174% ( 250, 380 ] 1159 0.236% 99.410% ( 380, 580 ] 1147 0.234% 99.644% ( 580, 870 ] 842 0.172% 99.816% ( 870, 1300 ] 427 0.087% 99.903% ( 1300, 1900 ] 214 0.044% 99.947% ( 1900, 2900 ] 321 0.065% 100.012% ( 2900, 4400 ] 360 0.073% 100.086% ( 4400, 6600 ] 80 0.016% 100.102% ( 6600, 9900 ] 28 0.006% 100.108% ( 9900, 14000 ] 13 0.003% 100.110% ( 14000, 22000 ] 33 0.007% 100.117% ( 22000, 33000 ] 15 0.003% 100.120% ( 33000, 50000 ] 1 0.000% 100.120% ( 50000, 75000 ] 1 0.000% 100.121% ** Level 4 read latency histogram (micros): Count: 608631 Average: 36.0970 StdDev: 418.27 Min: 1 Median: 2.3405 Max: 91092 Percentiles: P50: 2.34 P75: 3.57 P99: 541.13 P99.9: 1418.46 P99.99: 2047.09 ------------------------------------------------------ [ 0, 1 ] 6875 1.130% 1.130% ( 1, 2 ] 237847 39.079% 40.209% ######## ( 2, 3 ] 174998 28.753% 68.961% ###### ( 3, 4 ] 64241 10.555% 79.516% ## ( 4, 6 ] 67482 11.088% 90.604% ## ( 6, 10 ] 16940 2.783% 93.387% # ( 10, 15 ] 3895 0.640% 94.027% ( 15, 22 ] 515 0.085% 94.112% ( 22, 34 ] 81 0.013% 94.125% ( 34, 51 ] 132 0.022% 94.147% ( 51, 76 ] 148 0.024% 94.171% ( 76, 110 ] 236 0.039% 94.210% ( 110, 170 ] 5093 0.837% 95.047% ( 170, 250 ] 13919 2.287% 97.334% ( 250, 380 ] 6266 1.030% 98.363% ( 380, 580 ] 4812 0.791% 99.154% ( 580, 870 ] 3077 0.506% 99.659% ( 870, 1300 ] 1355 0.223% 99.882% ( 1300, 1900 ] 559 0.092% 99.974% ( 1900, 2900 ] 674 0.111% 100.084% ( 2900, 4400 ] 845 0.139% 100.223% ( 4400, 6600 ] 196 0.032% 100.255% ( 6600, 9900 ] 29 0.005% 100.260% ( 9900, 14000 ] 8 0.001% 100.262% ( 14000, 22000 ] 32 0.005% 100.267% ( 22000, 33000 ] 22 0.004% 100.270% ( 33000, 50000 ] 11 0.002% 100.272% ( 50000, 75000 ] 3 0.000% 100.273% ( 75000, 110000 ] 3 0.000% 100.273% ** Level 5 read latency histogram (micros): Count: 25500 Average: 478.1373 StdDev: 1039.71 Min: 94 Median: 241.7430 Max: 42954 Percentiles: P50: 241.74 P75: 440.92 P99: 4131.48 P99.9: 14285.71 P99.99: 31450.00 ------------------------------------------------------ ( 76, 110 ] 151 0.592% 0.592% ( 110, 170 ] 3693 14.482% 15.075% ### ( 170, 250 ] 9931 38.945% 54.020% ######## ( 250, 380 ] 4382 17.184% 71.204% ### ( 380, 580 ] 3178 12.463% 83.667% ## ( 580, 870 ] 2000 7.843% 91.510% ## ( 870, 1300 ] 818 3.208% 94.718% # ( 1300, 1900 ] 326 1.278% 95.996% ( 1900, 2900 ] 367 1.439% 97.435% ( 2900, 4400 ] 486 1.906% 99.341% ( 4400, 6600 ] 122 0.478% 99.820% ( 6600, 9900 ] 17 0.067% 99.886% ( 9900, 14000 ] 3 0.012% 99.898% ( 14000, 22000 ] 14 0.055% 99.953% ( 22000, 33000 ] 11 0.043% 99.996% ( 33000, 50000 ] 2 0.008% 100.004% ** DB Stats ** Uptime(secs): 10.3 total, 3.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 191.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.903 H:M:S, 18.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 261.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.045 H:M:S, 1.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/09-15:43:22 ... thread 0: (1000000,3000000) ops and (272681.0,216541.8) ops/second in (3.667289,13.854137) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.75 GB 256.5 2.4 0.0 2.4 5.1 2.8 0.0 1.9 96.3 207.0 25.47 17.94 51 0.499 2490K 13K 0.0 0.0 L1 9/0 856.17 MB 85.6 0.8 0.5 0.4 0.8 0.4 0.0 1.8 68.7 67.7 12.65 5.45 1 12.651 882K 13K 0.0 0.0 L3 18/0 956.77 MB 1.0 1.9 1.4 0.5 1.9 1.4 0.0 1.3 107.0 105.5 18.37 11.04 9 2.041 1559K 7563 0.0 0.0 L4 140/0 9.71 GB 1.0 4.1 1.9 2.3 3.8 1.5 0.3 2.0 136.9 125.9 30.87 19.95 17 1.816 884K 503 0.0 0.0 L5 144/0 11.51 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 326/4 25.74 GB 0.0 9.3 3.7 5.6 11.7 6.1 2.9 4.2 108.9 136.8 87.36 54.38 78 1.120 5817K 34K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.3 3.7 5.6 11.7 6.1 2.9 4.2 108.9 136.8 87.36 54.38 78 1.120 5817K 34K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.3 3.7 5.6 8.9 3.4 0.0 0.0 126.8 121.6 75.05 46.16 36 2.085 5817K 34K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 229.9 12.31 8.22 42 0.293 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.9 total, 13.9 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.67 GB write, 858.57 MB/s write, 9.29 GB read, 683.47 MB/s read, 87.4 seconds Interval compaction: 11.67 GB write, 862.37 MB/s write, 9.29 GB read, 686.49 MB/s read, 87.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 19, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 820790 Average: 22.3764 StdDev: 242.12 Min: 0 Median: 1.6602 Max: 79250 Percentiles: P50: 1.66 P75: 2.39 P99: 369.65 P99.9: 1284.01 P99.99: 3117.20 ------------------------------------------------------ [ 0, 1 ] 110643 13.480% 13.480% ### ( 1, 2 ] 454025 55.316% 68.796% ########### ( 2, 3 ] 129316 15.755% 84.551% ### ( 3, 4 ] 37996 4.629% 89.180% # ( 4, 6 ] 31845 3.880% 93.060% # ( 6, 10 ] 9205 1.121% 94.181% ( 10, 15 ] 1789 0.218% 94.399% ( 15, 22 ] 282 0.034% 94.434% ( 22, 34 ] 48 0.006% 94.439% ( 34, 51 ] 38 0.005% 94.444% ( 51, 76 ] 20 0.002% 94.446% ( 76, 110 ] 411 0.050% 94.497% ( 110, 170 ] 9030 1.100% 95.597% ( 170, 250 ] 21118 2.573% 98.170% # ( 250, 380 ] 7406 0.902% 99.072% ( 380, 580 ] 3867 0.471% 99.543% ( 580, 870 ] 2081 0.254% 99.797% ( 870, 1300 ] 882 0.107% 99.904% ( 1300, 1900 ] 319 0.039% 99.943% ( 1900, 2900 ] 329 0.040% 99.983% ( 2900, 4400 ] 400 0.049% 100.032% ( 4400, 6600 ] 106 0.013% 100.045% ( 6600, 9900 ] 22 0.003% 100.047% ( 9900, 14000 ] 10 0.001% 100.048% ( 14000, 22000 ] 20 0.002% 100.051% ( 22000, 33000 ] 11 0.001% 100.052% ( 33000, 50000 ] 3 0.000% 100.053% ( 50000, 75000 ] 2 0.000% 100.053% ( 75000, 110000 ] 1 0.000% 100.053% ** Level 1 read latency histogram (micros): Count: 104173 Average: 13.7046 StdDev: 130.71 Min: 1 Median: 2.7010 Max: 19995 Percentiles: P50: 2.70 P75: 4.02 P99: 247.06 P99.9: 963.90 P99.99: 4560.24 ------------------------------------------------------ [ 0, 1 ] 1333 1.280% 1.280% ( 1, 2 ] 28822 27.667% 28.947% ###### ( 2, 3 ] 31285 30.032% 58.979% ###### ( 3, 4 ] 16549 15.886% 74.865% ### ( 4, 6 ] 16721 16.051% 90.916% ### ( 6, 10 ] 4351 4.177% 95.093% # ( 10, 15 ] 1248 1.198% 96.291% ( 15, 22 ] 515 0.494% 96.785% ( 22, 34 ] 99 0.095% 96.880% ( 34, 51 ] 27 0.026% 96.906% ( 51, 76 ] 1 0.001% 96.907% ( 76, 110 ] 45 0.043% 96.950% ( 110, 170 ] 699 0.671% 97.621% ( 170, 250 ] 1491 1.431% 99.053% ( 250, 380 ] 513 0.492% 99.545% ( 380, 580 ] 234 0.225% 99.770% ( 580, 870 ] 126 0.121% 99.891% ( 870, 1300 ] 45 0.043% 99.934% ( 1300, 1900 ] 12 0.012% 99.945% ( 1900, 2900 ] 28 0.027% 99.972% ( 2900, 4400 ] 18 0.017% 99.989% ( 4400, 6600 ] 8 0.008% 99.997% ( 6600, 9900 ] 2 0.002% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ( 14000, 22000 ] 2 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 303472 Average: 16.7515 StdDev: 351.64 Min: 1 Median: 2.2540 Max: 49425 Percentiles: P50: 2.25 P75: 3.26 P99: 13.63 P99.9: 2078.53 P99.99: 3784.35 ------------------------------------------------------ [ 0, 1 ] 3399 1.120% 1.120% ( 1, 2 ] 125464 41.343% 42.463% ######## ( 2, 3 ] 90052 29.674% 72.137% ###### ( 3, 4 ] 33525 11.047% 83.184% ## ( 4, 6 ] 37098 12.225% 95.408% ## ( 6, 10 ] 9031 2.976% 98.384% # ( 10, 15 ] 2574 0.848% 99.233% ( 15, 22 ] 439 0.145% 99.377% ( 22, 34 ] 61 0.020% 99.397% ( 34, 51 ] 78 0.026% 99.423% ( 51, 76 ] 56 0.018% 99.441% ( 76, 110 ] 22 0.007% 99.449% ( 110, 170 ] 26 0.009% 99.457% ( 170, 250 ] 105 0.035% 99.492% ( 250, 380 ] 269 0.089% 99.581% ( 380, 580 ] 358 0.118% 99.698% ( 580, 870 ] 266 0.088% 99.786% ( 870, 1300 ] 154 0.051% 99.837% ( 1300, 1900 ] 161 0.053% 99.890% ( 1900, 2900 ] 171 0.056% 99.946% ( 2900, 4400 ] 225 0.074% 100.020% ( 4400, 6600 ] 87 0.029% 100.049% ( 6600, 9900 ] 24 0.008% 100.057% ( 9900, 14000 ] 24 0.008% 100.065% ( 14000, 22000 ] 37 0.012% 100.077% ( 22000, 33000 ] 10 0.003% 100.080% ( 33000, 50000 ] 5 0.002% 100.082% ** Level 3 read latency histogram (micros): Count: 493467 Average: 17.9067 StdDev: 276.68 Min: 1 Median: 2.3161 Max: 55398 Percentiles: P50: 2.32 P75: 3.37 P99: 240.98 P99.9: 1281.53 P99.99: 2559.36 ------------------------------------------------------ [ 0, 1 ] 5095 1.032% 1.032% ( 1, 2 ] 193885 39.290% 40.323% ######## ( 2, 3 ] 151056 30.611% 70.934% ###### ( 3, 4 ] 54255 10.995% 81.929% ## ( 4, 6 ] 59863 12.131% 94.060% ## ( 6, 10 ] 15006 3.041% 97.101% # ( 10, 15 ] 3435 0.696% 97.797% ( 15, 22 ] 475 0.096% 97.893% ( 22, 34 ] 77 0.016% 97.909% ( 34, 51 ] 152 0.031% 97.939% ( 51, 76 ] 116 0.024% 97.963% ( 76, 110 ] 138 0.028% 97.991% ( 110, 170 ] 1725 0.350% 98.341% ( 170, 250 ] 3668 0.743% 99.084% ( 250, 380 ] 1493 0.303% 99.386% ( 380, 580 ] 1268 0.257% 99.643% ( 580, 870 ] 855 0.173% 99.817% ( 870, 1300 ] 430 0.087% 99.904% ( 1300, 1900 ] 214 0.043% 99.947% ( 1900, 2900 ] 321 0.065% 100.012% ( 2900, 4400 ] 360 0.073% 100.085% ( 4400, 6600 ] 80 0.016% 100.101% ( 6600, 9900 ] 28 0.006% 100.107% ( 9900, 14000 ] 13 0.003% 100.110% ( 14000, 22000 ] 33 0.007% 100.116% ( 22000, 33000 ] 15 0.003% 100.119% ( 33000, 50000 ] 1 0.000% 100.120% ( 50000, 75000 ] 1 0.000% 100.120% ** Level 4 read latency histogram (micros): Count: 636049 Average: 43.1615 StdDev: 410.78 Min: 1 Median: 2.4188 Max: 91092 Percentiles: P50: 2.42 P75: 3.89 P99: 540.65 P99.9: 1389.79 P99.99: 2041.54 ------------------------------------------------------ [ 0, 1 ] 6875 1.081% 1.081% ( 1, 2 ] 237853 37.395% 38.476% ####### ( 2, 3 ] 175007 27.515% 65.991% ###### ( 3, 4 ] 64250 10.101% 76.092% ## ( 4, 6 ] 67488 10.611% 86.703% ## ( 6, 10 ] 16940 2.663% 89.366% # ( 10, 15 ] 3897 0.613% 89.979% ( 15, 22 ] 515 0.081% 90.060% ( 22, 34 ] 81 0.013% 90.073% ( 34, 51 ] 132 0.021% 90.093% ( 51, 76 ] 148 0.023% 90.117% ( 76, 110 ] 692 0.109% 90.225% ( 110, 170 ] 13970 2.196% 92.422% ( 170, 250 ] 28421 4.468% 96.890% # ( 250, 380 ] 8923 1.403% 98.293% ( 380, 580 ] 5598 0.880% 99.173% ( 580, 870 ] 3173 0.499% 99.672% ( 870, 1300 ] 1366 0.215% 99.887% ( 1300, 1900 ] 561 0.088% 99.975% ( 1900, 2900 ] 674 0.106% 100.081% ( 2900, 4400 ] 845 0.133% 100.214% ( 4400, 6600 ] 196 0.031% 100.245% ( 6600, 9900 ] 29 0.005% 100.249% ( 9900, 14000 ] 8 0.001% 100.250% ( 14000, 22000 ] 32 0.005% 100.255% ( 22000, 33000 ] 22 0.003% 100.259% ( 33000, 50000 ] 11 0.002% 100.261% ( 50000, 75000 ] 3 0.000% 100.261% ( 75000, 110000 ] 3 0.000% 100.262% ** Level 5 read latency histogram (micros): Count: 44418 Average: 359.5283 StdDev: 801.13 Min: 91 Median: 217.5956 Max: 42954 Percentiles: P50: 217.60 P75: 313.96 P99: 3547.59 P99.9: 6907.09 P99.99: 29558.20 ------------------------------------------------------ ( 76, 110 ] 512 1.153% 1.153% ( 110, 170 ] 9858 22.194% 23.346% #### ( 170, 250 ] 19901 44.804% 68.150% ######### ( 250, 380 ] 6186 13.927% 82.077% ### ( 380, 580 ] 3714 8.361% 90.439% ## ( 580, 870 ] 2068 4.656% 95.094% # ( 870, 1300 ] 832 1.873% 96.967% ( 1300, 1900 ] 327 0.736% 97.704% ( 1900, 2900 ] 367 0.826% 98.530% ( 2900, 4400 ] 486 1.094% 99.624% ( 4400, 6600 ] 122 0.275% 99.899% ( 6600, 9900 ] 17 0.038% 99.937% ( 9900, 14000 ] 3 0.007% 99.944% ( 14000, 22000 ] 14 0.032% 99.975% ( 22000, 33000 ] 11 0.025% 100.000% ( 33000, 50000 ] 2 0.005% 100.005% ** DB Stats ** Uptime(secs): 13.9 total, 3.7 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 212.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.958 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 268.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.055 H:M:S, 1.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/09-15:43:25 ... thread 0: (1000000,4000000) ops and (273487.1,228432.8) ops/second in (3.656480,17.510617) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.73 GB 356.7 3.4 0.0 3.4 7.1 3.7 0.0 1.9 107.2 225.6 32.26 24.37 71 0.454 3513K 18K 0.0 0.0 L1 9/0 856.17 MB 85.6 0.8 0.5 0.4 0.8 0.4 0.0 1.8 68.7 67.7 12.65 5.45 1 12.651 882K 13K 0.0 0.0 L3 18/0 956.77 MB 1.0 1.9 1.4 0.5 1.9 1.4 0.0 1.3 107.0 105.5 18.37 11.04 9 2.041 1559K 7563 0.0 0.0 L4 140/0 9.71 GB 1.0 4.1 1.9 2.3 3.8 1.5 0.3 2.0 136.9 125.9 30.87 19.95 17 1.816 884K 503 0.0 0.0 L5 144/0 11.51 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 330/4 26.71 GB 0.0 10.3 3.7 6.5 13.6 7.1 2.9 3.6 111.8 148.3 94.15 60.80 98 0.961 6840K 39K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.3 3.7 6.5 13.6 7.1 2.9 3.6 111.8 148.3 94.15 60.80 98 0.961 6840K 39K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.3 3.7 6.5 9.9 3.3 0.0 0.0 133.4 128.4 78.86 49.90 40 1.971 6840K 39K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 250.9 15.30 10.90 58 0.264 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.6 total, 17.5 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.63 GB write, 794.22 MB/s write, 10.28 GB read, 598.57 MB/s read, 94.2 seconds Interval compaction: 13.63 GB write, 797.01 MB/s write, 10.28 GB read, 600.66 MB/s read, 94.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 19, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1094967 Average: 19.1214 StdDev: 210.62 Min: 0 Median: 1.5992 Max: 79250 Percentiles: P50: 1.60 P75: 2.19 P99: 329.39 P99.9: 1092.78 P99.99: 2622.74 ------------------------------------------------------ [ 0, 1 ] 180049 16.443% 16.443% ### ( 1, 2 ] 613231 56.005% 72.448% ########### ( 2, 3 ] 150458 13.741% 86.189% ### ( 3, 4 ] 45434 4.149% 90.338% # ( 4, 6 ] 36589 3.342% 93.680% # ( 6, 10 ] 10388 0.949% 94.628% ( 10, 15 ] 2188 0.200% 94.828% ( 15, 22 ] 328 0.030% 94.858% ( 22, 34 ] 80 0.007% 94.865% ( 34, 51 ] 40 0.004% 94.869% ( 51, 76 ] 21 0.002% 94.871% ( 76, 110 ] 627 0.057% 94.928% ( 110, 170 ] 12975 1.185% 96.113% ( 170, 250 ] 26647 2.434% 98.547% ( 250, 380 ] 8127 0.742% 99.289% ( 380, 580 ] 4120 0.376% 99.665% ( 580, 870 ] 2112 0.193% 99.858% ( 870, 1300 ] 886 0.081% 99.939% ( 1300, 1900 ] 320 0.029% 99.968% ( 1900, 2900 ] 330 0.030% 99.998% ( 2900, 4400 ] 400 0.037% 100.035% ( 4400, 6600 ] 106 0.010% 100.045% ( 6600, 9900 ] 22 0.002% 100.047% ( 9900, 14000 ] 10 0.001% 100.048% ( 14000, 22000 ] 20 0.002% 100.049% ( 22000, 33000 ] 11 0.001% 100.050% ( 33000, 50000 ] 3 0.000% 100.051% ( 50000, 75000 ] 2 0.000% 100.051% ( 75000, 110000 ] 1 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 106931 Average: 17.7563 StdDev: 132.12 Min: 1 Median: 2.7428 Max: 19995 Percentiles: P50: 2.74 P75: 4.24 P99: 279.73 P99.9: 945.43 P99.99: 4484.40 ------------------------------------------------------ [ 0, 1 ] 1333 1.247% 1.247% ( 1, 2 ] 28836 26.967% 28.214% ##### ( 2, 3 ] 31364 29.331% 57.545% ###### ( 3, 4 ] 16640 15.561% 73.106% ### ( 4, 6 ] 16818 15.728% 88.834% ### ( 6, 10 ] 4361 4.078% 92.912% # ( 10, 15 ] 1257 1.176% 94.088% ( 15, 22 ] 517 0.483% 94.571% ( 22, 34 ] 99 0.093% 94.664% ( 34, 51 ] 27 0.025% 94.689% ( 51, 76 ] 1 0.001% 94.690% ( 76, 110 ] 100 0.094% 94.784% ( 110, 170 ] 1625 1.520% 96.303% ( 170, 250 ] 2725 2.548% 98.852% # ( 250, 380 ] 694 0.649% 99.501% ( 380, 580 ] 285 0.267% 99.767% ( 580, 870 ] 134 0.125% 99.892% ( 870, 1300 ] 46 0.043% 99.935% ( 1300, 1900 ] 12 0.011% 99.947% ( 1900, 2900 ] 28 0.026% 99.973% ( 2900, 4400 ] 18 0.017% 99.990% ( 4400, 6600 ] 8 0.007% 99.997% ( 6600, 9900 ] 2 0.002% 99.999% ( 9900, 14000 ] 1 0.001% 100.000% ( 14000, 22000 ] 2 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 303472 Average: 16.7515 StdDev: 351.64 Min: 1 Median: 2.2540 Max: 49425 Percentiles: P50: 2.25 P75: 3.26 P99: 13.63 P99.9: 2078.53 P99.99: 3784.35 ------------------------------------------------------ [ 0, 1 ] 3399 1.120% 1.120% ( 1, 2 ] 125464 41.343% 42.463% ######## ( 2, 3 ] 90052 29.674% 72.137% ###### ( 3, 4 ] 33525 11.047% 83.184% ## ( 4, 6 ] 37098 12.225% 95.408% ## ( 6, 10 ] 9031 2.976% 98.384% # ( 10, 15 ] 2574 0.848% 99.233% ( 15, 22 ] 439 0.145% 99.377% ( 22, 34 ] 61 0.020% 99.397% ( 34, 51 ] 78 0.026% 99.423% ( 51, 76 ] 56 0.018% 99.441% ( 76, 110 ] 22 0.007% 99.449% ( 110, 170 ] 26 0.009% 99.457% ( 170, 250 ] 105 0.035% 99.492% ( 250, 380 ] 269 0.089% 99.581% ( 380, 580 ] 358 0.118% 99.698% ( 580, 870 ] 266 0.088% 99.786% ( 870, 1300 ] 154 0.051% 99.837% ( 1300, 1900 ] 161 0.053% 99.890% ( 1900, 2900 ] 171 0.056% 99.946% ( 2900, 4400 ] 225 0.074% 100.020% ( 4400, 6600 ] 87 0.029% 100.049% ( 6600, 9900 ] 24 0.008% 100.057% ( 9900, 14000 ] 24 0.008% 100.065% ( 14000, 22000 ] 37 0.012% 100.077% ( 22000, 33000 ] 10 0.003% 100.080% ( 33000, 50000 ] 5 0.002% 100.082% ** Level 3 read latency histogram (micros): Count: 496744 Average: 19.0563 StdDev: 276.19 Min: 1 Median: 2.3270 Max: 55398 Percentiles: P50: 2.33 P75: 3.42 P99: 247.90 P99.9: 1280.26 P99.99: 2558.34 ------------------------------------------------------ [ 0, 1 ] 5095 1.026% 1.026% ( 1, 2 ] 193885 39.031% 40.057% ######## ( 2, 3 ] 151056 30.409% 70.466% ###### ( 3, 4 ] 54255 10.922% 81.388% ## ( 4, 6 ] 59863 12.051% 93.439% ## ( 6, 10 ] 15006 3.021% 96.460% # ( 10, 15 ] 3435 0.692% 97.152% ( 15, 22 ] 475 0.096% 97.247% ( 22, 34 ] 77 0.016% 97.263% ( 34, 51 ] 152 0.031% 97.293% ( 51, 76 ] 116 0.023% 97.317% ( 76, 110 ] 223 0.045% 97.362% ( 110, 170 ] 2975 0.599% 97.961% ( 170, 250 ] 5304 1.068% 99.028% ( 250, 380 ] 1708 0.344% 99.372% ( 380, 580 ] 1349 0.272% 99.644% ( 580, 870 ] 864 0.174% 99.818% ( 870, 1300 ] 430 0.087% 99.904% ( 1300, 1900 ] 216 0.043% 99.948% ( 1900, 2900 ] 321 0.065% 100.012% ( 2900, 4400 ] 360 0.072% 100.085% ( 4400, 6600 ] 80 0.016% 100.101% ( 6600, 9900 ] 28 0.006% 100.106% ( 9900, 14000 ] 13 0.003% 100.109% ( 14000, 22000 ] 33 0.007% 100.116% ( 22000, 33000 ] 15 0.003% 100.119% ( 33000, 50000 ] 1 0.000% 100.119% ( 50000, 75000 ] 1 0.000% 100.119% ** Level 4 read latency histogram (micros): Count: 662825 Average: 49.0944 StdDev: 403.64 Min: 1 Median: 2.4953 Max: 91092 Percentiles: P50: 2.50 P75: 4.39 P99: 538.18 P99.9: 1361.15 P99.99: 2037.56 ------------------------------------------------------ [ 0, 1 ] 6875 1.037% 1.037% ( 1, 2 ] 237853 35.885% 36.922% ####### ( 2, 3 ] 175007 26.403% 63.325% ##### ( 3, 4 ] 64250 9.693% 73.019% ## ( 4, 6 ] 67488 10.182% 83.200% ## ( 6, 10 ] 16940 2.556% 85.756% # ( 10, 15 ] 3897 0.588% 86.344% ( 15, 22 ] 515 0.078% 86.422% ( 22, 34 ] 81 0.012% 86.434% ( 34, 51 ] 132 0.020% 86.454% ( 51, 76 ] 148 0.022% 86.476% ( 76, 110 ] 1326 0.200% 86.676% ( 110, 170 ] 24086 3.634% 90.310% # ( 170, 250 ] 41996 6.336% 96.646% # ( 250, 380 ] 10715 1.617% 98.263% ( 380, 580 ] 6180 0.932% 99.195% ( 580, 870 ] 3243 0.489% 99.684% ( 870, 1300 ] 1373 0.207% 99.891% ( 1300, 1900 ] 561 0.085% 99.976% ( 1900, 2900 ] 674 0.102% 100.078% ( 2900, 4400 ] 845 0.127% 100.205% ( 4400, 6600 ] 196 0.030% 100.235% ( 6600, 9900 ] 29 0.004% 100.239% ( 9900, 14000 ] 8 0.001% 100.240% ( 14000, 22000 ] 32 0.005% 100.245% ( 22000, 33000 ] 22 0.003% 100.248% ( 33000, 50000 ] 11 0.002% 100.250% ( 50000, 75000 ] 3 0.000% 100.251% ( 75000, 110000 ] 3 0.000% 100.251% ** Level 5 read latency histogram (micros): Count: 62921 Average: 309.6129 StdDev: 678.43 Min: 91 Median: 207.1708 Max: 42954 Percentiles: P50: 207.17 P75: 250.97 P99: 2976.51 P99.9: 6294.87 P99.99: 27707.90 ------------------------------------------------------ ( 76, 110 ] 922 1.465% 1.465% ( 110, 170 ] 16934 26.913% 28.378% ##### ( 170, 250 ] 29280 46.535% 74.913% ######### ( 250, 380 ] 7374 11.719% 86.632% ## ( 380, 580 ] 4106 6.526% 93.158% # ( 580, 870 ] 2125 3.377% 96.535% # ( 870, 1300 ] 832 1.322% 97.858% ( 1300, 1900 ] 327 0.520% 98.377% ( 1900, 2900 ] 367 0.583% 98.961% ( 2900, 4400 ] 486 0.772% 99.733% ( 4400, 6600 ] 122 0.194% 99.927% ( 6600, 9900 ] 17 0.027% 99.954% ( 9900, 14000 ] 3 0.005% 99.959% ( 14000, 22000 ] 14 0.022% 99.981% ( 22000, 33000 ] 11 0.017% 99.998% ( 33000, 50000 ] 2 0.003% 100.002% ** DB Stats ** Uptime(secs): 17.6 total, 3.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 223.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.007 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.049 H:M:S, 1.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 337.695 micros/op 11805 ops/sec 20.160 seconds 237996 operations; 11.4 MB/s (59999 of 59999 found) Microseconds per read: Count: 237996 Average: 337.7045 StdDev: 1130.17 Min: 2 Median: 228.3765 Max: 196695 Percentiles: P50: 228.38 P75: 328.51 P99: 2304.25 P99.9: 15333.58 P99.99: 40109.40 ------------------------------------------------------ ( 1, 2 ] 4 0.002% 0.002% ( 2, 3 ] 41 0.017% 0.019% ( 3, 4 ] 75 0.032% 0.050% ( 4, 6 ] 181 0.076% 0.126% ( 6, 10 ] 420 0.176% 0.303% ( 10, 15 ] 1628 0.684% 0.987% ( 15, 22 ] 3821 1.605% 2.592% ( 22, 34 ] 5260 2.210% 4.803% ( 34, 51 ] 2670 1.122% 5.924% ( 51, 76 ] 464 0.195% 6.119% ( 76, 110 ] 153 0.064% 6.184% ( 110, 170 ] 21293 8.947% 15.131% ## ( 170, 250 ] 113728 47.786% 62.916% ########## ( 250, 380 ] 47622 20.010% 82.926% #### ( 380, 580 ] 24669 10.365% 93.291% ## ( 580, 870 ] 9211 3.870% 97.161% # ( 870, 1300 ] 3060 1.286% 98.447% ( 1300, 1900 ] 989 0.416% 98.863% ( 1900, 2900 ] 809 0.340% 99.203% ( 2900, 4400 ] 1116 0.469% 99.671% ( 4400, 6600 ] 315 0.132% 99.804% ( 6600, 9900 ] 119 0.050% 99.854% ( 9900, 14000 ] 88 0.037% 99.891% ( 14000, 22000 ] 132 0.055% 99.946% ( 22000, 33000 ] 95 0.040% 99.986% ( 33000, 50000 ] 22 0.009% 99.995% ( 50000, 75000 ] 5 0.002% 99.997% ( 75000, 110000 ] 3 0.001% 99.999% ( 110000, 170000 ] 2 0.001% 100.000% ( 170000, 250000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3903866 rocksdb.bloom.filter.full.positive COUNT : 274869 rocksdb.bloom.filter.full.true.positive COUNT : 236991 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 1005 rocksdb.memtable.miss COUNT : 236991 rocksdb.l0.hit COUNT : 31191 rocksdb.l1.hit COUNT : 6734 rocksdb.l2andup.hit COUNT : 199066 rocksdb.compaction.key.drop.new COUNT : 411017 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4227905 rocksdb.number.keys.read COUNT : 237996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4363197960 rocksdb.bytes.read COUNT : 237996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 478 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3779897 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11536106245 rocksdb.compact.write.bytes COUNT : 11106609295 rocksdb.flush.write.bytes COUNT : 4353385478 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 23 rocksdb.number.superversion_acquires COUNT : 715 rocksdb.number.superversion_releases COUNT : 693 rocksdb.number.superversion_cleanups COUNT : 179 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 146 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324644864 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7502848 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 11993013656 rocksdb.non.last.level.read.count COUNT : 2866078 rocksdb.block.checksum.compute.count COUNT : 3072014 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 227.704585 P95 : 706.875395 P99 : 2300.794045 P100 : 196694.000000 COUNT : 237996 SUM : 80144654 rocksdb.db.write.micros P50 : 1.540660 P95 : 4.994174 P99 : 6.872535 P100 : 743960.000000 COUNT : 4227905 SUM : 14951107 rocksdb.compaction.times.micros P50 : 1528125.000000 P95 : 4230000.000000 P99 : 12278000.000000 P100 : 12650927.000000 COUNT : 41 SUM : 79821876 rocksdb.compaction.times.cpu_micros P50 : 1092962.962963 P95 : 1833181.818182 P99 : 5449806.000000 P100 : 5449806.000000 COUNT : 41 SUM : 50845801 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 737.083333 P95 : 4175.000000 P99 : 7821.000000 P100 : 8485.000000 COUNT : 63 SUM : 73806 rocksdb.compaction.outfile.sync.micros P50 : 2150.000000 P95 : 9042.000000 P99 : 30140.000000 P100 : 75977.000000 COUNT : 126 SUM : 456673 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 167.500000 P95 : 1106.500000 P99 : 3545.000000 P100 : 4106.000000 COUNT : 114 SUM : 38707 rocksdb.table.open.io.micros P50 : 6101.886792 P95 : 19234.782609 P99 : 30855.000000 P100 : 168586.000000 COUNT : 478 SUM : 3595370 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.108101 P95 : 9.686628 P99 : 209.479135 P100 : 79254.000000 COUNT : 2793564 SUM : 42093631 rocksdb.read.block.get.micros P50 : 195.817474 P95 : 554.866832 P99 : 1879.926740 P100 : 91101.000000 COUNT : 278040 SUM : 69999664 rocksdb.write.raw.block.micros P50 : 0.535319 P95 : 1.378455 P99 : 4.529565 P100 : 91662.000000 COUNT : 3745559 SUM : 13281726 rocksdb.numfiles.in.singlecompaction P50 : 3.145833 P95 : 5.675000 P99 : 26.000000 P100 : 26.000000 COUNT : 53 SUM : 213 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562877 P95 : 1150.861991 P99 : 2342.704918 P100 : 743789.000000 COUNT : 14198 SUM : 3780814 rocksdb.sst.read.micros P50 : 1.983047 P95 : 204.852247 P99 : 469.728685 P100 : 91092.000000 COUNT : 2866218 SUM : 100141435 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 237996 SUM : 237996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4227905 SUM : 4363197960 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 219411.764706 P95 : 652166.666667 P99 : 985800.000000 P100 : 1028543.000000 COUNT : 63 SUM : 16284690 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 146 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0