[2024-11-27 15:08:08.617442] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 24.03.0 initialization... [2024-11-27 15:08:08.617761] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid327120 ] Set seed to 1732716488610157 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 15:08:08.787601] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 15:08:08.884713] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 15:08:08.884756] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 327120' to capture a snapshot of events at runtime. [2024-11-27 15:08:08.884767] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 15:08:08.884778] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 15:08:08.884789] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid327120 for offline analysis/debug. [2024-11-27 15:08:08.886034] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 15:08:11 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/11/27-15:08:16 ... thread 0: (1000000,1000000) ops and (178673.6,178673.6) ops/second in (5.596797,5.596797) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.26 GB 50.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 46.2 166.2 6.80 3.04 11 0.618 319K 1803 0.0 0.0 L1 3/3 283.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/1 49.31 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 41/17 2.37 GB 1.3 2.3 1.6 0.7 2.3 1.6 0.0 1.4 120.6 119.1 19.35 11.10 12 1.612 2107K 12K 0.0 0.0 L4 154/27 11.24 GB 0.9 2.2 1.5 0.7 2.1 1.5 0.0 1.4 136.9 135.1 16.12 8.90 12 1.344 627K 2272 0.0 0.0 L5 124/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 335/57 24.05 GB 0.0 4.7 3.1 1.6 5.5 3.8 0.0 6.9 114.9 132.8 42.27 23.04 35 1.208 3054K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 3.1 1.6 5.5 3.8 0.0 6.9 114.9 132.8 42.27 23.04 35 1.208 3054K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 3.1 1.6 4.7 3.0 0.0 0.0 130.6 128.9 37.19 21.05 25 1.488 3054K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 160.8 5.08 1.99 10 0.508 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.7 total, 5.6 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.48 GB write, 986.69 MB/s write, 4.74 GB read, 853.57 MB/s read, 42.3 seconds Interval compaction: 5.48 GB write, 1001.74 MB/s write, 4.74 GB read, 866.59 MB/s read, 42.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 22, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 159976 Average: 43.0229 StdDev: 373.85 Min: 0 Median: 1.6446 Max: 46281 Percentiles: P50: 1.64 P75: 2.52 P99: 1114.47 P99.9: 4329.72 P99.99: 12244.26 ------------------------------------------------------ [ 0, 1 ] 28312 17.698% 17.698% #### ( 1, 2 ] 80165 50.111% 67.808% ########## ( 2, 3 ] 22149 13.845% 81.653% ### ( 3, 4 ] 13038 8.150% 89.803% ## ( 4, 6 ] 8930 5.582% 95.386% # ( 6, 10 ] 1898 1.186% 96.572% ( 10, 15 ] 119 0.074% 96.646% ( 15, 22 ] 9 0.006% 96.652% ( 22, 34 ] 11 0.007% 96.659% ( 34, 51 ] 23 0.014% 96.673% ( 51, 76 ] 9 0.006% 96.679% ( 76, 110 ] 4 0.003% 96.681% ( 110, 170 ] 33 0.021% 96.702% ( 170, 250 ] 86 0.054% 96.756% ( 250, 380 ] 399 0.249% 97.005% ( 380, 580 ] 1116 0.698% 97.703% ( 580, 870 ] 1563 0.977% 98.680% ( 870, 1300 ] 901 0.563% 99.243% ( 1300, 1900 ] 349 0.218% 99.461% ( 1900, 2900 ] 377 0.236% 99.697% ( 2900, 4400 ] 341 0.213% 99.910% ( 4400, 6600 ] 106 0.066% 99.976% ( 6600, 9900 ] 18 0.011% 99.987% ( 9900, 14000 ] 7 0.004% 99.992% ( 14000, 22000 ] 10 0.006% 99.998% ( 22000, 33000 ] 4 0.003% 100.001% ( 33000, 50000 ] 2 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 212 Average: 1216.8774 StdDev: 1189.84 Min: 137 Median: 738.1818 Max: 6390 Percentiles: P50: 738.18 P75: 1392.31 P99: 5822.67 P99.9: 6390.00 P99.99: 6390.00 ------------------------------------------------------ ( 110, 170 ] 2 0.943% 0.943% ( 170, 250 ] 6 2.830% 3.774% # ( 250, 380 ] 20 9.434% 13.208% ## ( 380, 580 ] 54 25.472% 38.679% ##### ( 580, 870 ] 44 20.755% 59.434% #### ( 870, 1300 ] 31 14.623% 74.057% ### ( 1300, 1900 ] 13 6.132% 80.189% # ( 1900, 2900 ] 19 8.962% 89.151% ## ( 2900, 4400 ] 17 8.019% 97.170% ## ( 4400, 6600 ] 6 2.830% 100.000% # ** Level 2 read latency histogram (micros): Count: 320699 Average: 15.4252 StdDev: 260.91 Min: 1 Median: 1.6989 Max: 35294 Percentiles: P50: 1.70 P75: 2.66 P99: 9.72 P99.9: 3150.73 P99.99: 5881.93 ------------------------------------------------------ [ 0, 1 ] 45527 14.196% 14.196% ### ( 1, 2 ] 164293 51.230% 65.426% ########## ( 2, 3 ] 46580 14.525% 79.950% ### ( 3, 4 ] 31155 9.715% 89.665% ## ( 4, 6 ] 24703 7.703% 97.368% ## ( 6, 10 ] 5627 1.755% 99.123% ( 10, 15 ] 450 0.140% 99.263% ( 15, 22 ] 126 0.039% 99.302% ( 22, 34 ] 47 0.015% 99.317% ( 34, 51 ] 66 0.021% 99.337% ( 51, 76 ] 31 0.010% 99.347% ( 76, 110 ] 9 0.003% 99.350% ( 110, 170 ] 13 0.004% 99.354% ( 170, 250 ] 38 0.012% 99.366% ( 250, 380 ] 124 0.039% 99.404% ( 380, 580 ] 339 0.106% 99.510% ( 580, 870 ] 447 0.139% 99.650% ( 870, 1300 ] 272 0.085% 99.734% ( 1300, 1900 ] 191 0.060% 99.794% ( 1900, 2900 ] 294 0.092% 99.886% ( 2900, 4400 ] 277 0.086% 99.972% ( 4400, 6600 ] 86 0.027% 99.999% ( 6600, 9900 ] 39 0.012% 100.011% ( 9900, 14000 ] 16 0.005% 100.016% ( 14000, 22000 ] 13 0.004% 100.020% ( 22000, 33000 ] 4 0.001% 100.021% ( 33000, 50000 ] 2 0.001% 100.022% ** Level 3 read latency histogram (micros): Count: 725224 Average: 14.1497 StdDev: 233.37 Min: 0 Median: 1.6120 Max: 38509 Percentiles: P50: 1.61 P75: 2.45 P99: 9.58 P99.9: 2528.82 P99.99: 4041.48 ------------------------------------------------------ [ 0, 1 ] 148054 20.415% 20.415% #### ( 1, 2 ] 350585 48.342% 68.757% ########## ( 2, 3 ] 100652 13.879% 82.635% ### ( 3, 4 ] 65378 9.015% 91.650% ## ( 4, 6 ] 45467 6.269% 97.920% # ( 6, 10 ] 8765 1.209% 99.128% ( 10, 15 ] 618 0.085% 99.213% ( 15, 22 ] 183 0.025% 99.239% ( 22, 34 ] 76 0.010% 99.249% ( 34, 51 ] 148 0.020% 99.269% ( 51, 76 ] 58 0.008% 99.277% ( 76, 110 ] 30 0.004% 99.282% ( 110, 170 ] 68 0.009% 99.291% ( 170, 250 ] 122 0.017% 99.308% ( 250, 380 ] 387 0.053% 99.361% ( 380, 580 ] 1018 0.140% 99.502% ( 580, 870 ] 1265 0.174% 99.676% ( 870, 1300 ] 803 0.111% 99.787% ( 1300, 1900 ] 447 0.062% 99.848% ( 1900, 2900 ] 596 0.082% 99.931% ( 2900, 4400 ] 567 0.078% 100.009% ( 4400, 6600 ] 165 0.023% 100.031% ( 6600, 9900 ] 40 0.006% 100.037% ( 9900, 14000 ] 16 0.002% 100.039% ( 14000, 22000 ] 22 0.003% 100.042% ( 22000, 33000 ] 8 0.001% 100.043% ( 33000, 50000 ] 5 0.001% 100.044% ** Level 4 read latency histogram (micros): Count: 444131 Average: 30.4680 StdDev: 326.88 Min: 0 Median: 1.4798 Max: 44149 Percentiles: P50: 1.48 P75: 2.24 P99: 808.94 P99.9: 3639.65 P99.99: 4661.53 ------------------------------------------------------ [ 0, 1 ] 132510 29.836% 29.836% ###### ( 1, 2 ] 186668 42.030% 71.866% ######## ( 2, 3 ] 57007 12.836% 84.701% ### ( 3, 4 ] 36114 8.131% 92.833% ## ( 4, 6 ] 19490 4.388% 97.221% # ( 6, 10 ] 2591 0.583% 97.804% ( 10, 15 ] 324 0.073% 97.877% ( 15, 22 ] 34 0.008% 97.885% ( 22, 34 ] 45 0.010% 97.895% ( 34, 51 ] 58 0.013% 97.908% ( 51, 76 ] 29 0.007% 97.915% ( 76, 110 ] 21 0.005% 97.920% ( 110, 170 ] 47 0.011% 97.930% ( 170, 250 ] 164 0.037% 97.967% ( 250, 380 ] 699 0.157% 98.124% ( 380, 580 ] 1877 0.423% 98.547% ( 580, 870 ] 2552 0.575% 99.122% ( 870, 1300 ] 1581 0.356% 99.478% ( 1300, 1900 ] 685 0.154% 99.632% ( 1900, 2900 ] 827 0.186% 99.818% ( 2900, 4400 ] 744 0.168% 99.986% ( 4400, 6600 ] 190 0.043% 100.028% ( 6600, 9900 ] 45 0.010% 100.039% ( 9900, 14000 ] 23 0.005% 100.044% ( 14000, 22000 ] 21 0.005% 100.048% ( 22000, 33000 ] 9 0.002% 100.050% ( 33000, 50000 ] 4 0.001% 100.051% ** Level 5 read latency histogram (micros): Count: 5659 Average: 1282.7920 StdDev: 2028.68 Min: 95 Median: 757.7989 Max: 46122 Percentiles: P50: 757.80 P75: 1287.70 P99: 6491.81 P99.9: 30075.10 P99.99: 43344.92 ------------------------------------------------------ ( 76, 110 ] 10 0.177% 0.177% ( 110, 170 ] 22 0.389% 0.565% ( 170, 250 ] 121 2.138% 2.704% ( 250, 380 ] 528 9.330% 12.034% ## ( 380, 580 ] 1292 22.831% 34.865% ##### ( 580, 870 ] 1397 24.686% 59.551% ##### ( 870, 1300 ] 900 15.904% 75.455% ### ( 1300, 1900 ] 381 6.733% 82.188% # ( 1900, 2900 ] 426 7.528% 89.715% ## ( 2900, 4400 ] 398 7.033% 96.749% # ( 4400, 6600 ] 134 2.368% 99.116% ( 6600, 9900 ] 28 0.495% 99.611% ( 9900, 14000 ] 5 0.088% 99.700% ( 14000, 22000 ] 4 0.071% 99.770% ( 22000, 33000 ] 10 0.177% 99.947% ( 33000, 50000 ] 4 0.071% 100.018% ** DB Stats ** Uptime(secs): 5.7 total, 5.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 173.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.840 H:M:S, 32.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 175.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.840 H:M:S, 32.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/27-15:08:20 ... thread 0: (1000000,2000000) ops and (249451.2,208211.9) ops/second in (4.008800,9.605597) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/5 2.24 GB 181.5 1.5 0.0 1.5 3.2 1.8 0.0 1.8 88.6 195.2 17.03 8.91 29 0.587 1532K 8276 0.0 0.0 L1 3/3 283.54 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 947.53 MB 0.9 3.1 1.6 1.4 3.0 1.6 0.0 1.8 124.5 122.8 25.22 14.24 13 1.940 2107K 12K 0.0 0.0 L4 143/0 9.67 GB 1.0 6.6 2.3 4.3 5.9 1.6 0.7 2.6 183.1 164.1 36.70 21.60 25 1.468 1436K 2272 0.0 0.0 L5 157/0 11.26 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 335/8 24.36 GB 0.0 11.1 3.9 7.2 12.2 5.0 3.1 6.8 144.0 157.6 78.95 44.75 67 1.178 5076K 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.1 3.9 7.2 12.2 5.0 3.1 6.8 144.0 157.6 78.95 44.75 67 1.178 5076K 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.1 3.9 7.2 10.4 3.2 0.0 0.0 161.8 151.2 70.24 40.36 43 1.633 5076K 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 209.3 8.71 4.38 24 0.363 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.7 total, 9.6 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.15 GB write, 1283.21 MB/s write, 11.10 GB read, 1172.30 MB/s read, 78.9 seconds Interval compaction: 12.15 GB write, 1294.62 MB/s write, 11.10 GB read, 1182.73 MB/s read, 78.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 30, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 506569 Average: 30.7910 StdDev: 272.03 Min: 0 Median: 1.3548 Max: 46281 Percentiles: P50: 1.35 P75: 1.92 P99: 780.02 P99.9: 2703.31 P99.99: 3743.50 ------------------------------------------------------ [ 0, 1 ] 173937 34.336% 34.336% ####### ( 1, 2 ] 223631 44.146% 78.482% ######### ( 2, 3 ] 47913 9.458% 87.941% ## ( 3, 4 ] 24940 4.923% 92.864% # ( 4, 6 ] 15315 3.023% 95.887% # ( 6, 10 ] 3055 0.603% 96.491% ( 10, 15 ] 413 0.082% 96.572% ( 15, 22 ] 62 0.012% 96.584% ( 22, 34 ] 29 0.006% 96.590% ( 34, 51 ] 37 0.007% 96.597% ( 51, 76 ] 10 0.002% 96.599% ( 76, 110 ] 47 0.009% 96.609% ( 110, 170 ] 563 0.111% 96.720% ( 170, 250 ] 1433 0.283% 97.003% ( 250, 380 ] 3334 0.658% 97.661% ( 380, 580 ] 3953 0.780% 98.441% ( 580, 870 ] 4105 0.810% 99.251% ( 870, 1300 ] 2067 0.408% 99.659% ( 1300, 1900 ] 677 0.134% 99.793% ( 1900, 2900 ] 674 0.133% 99.926% ( 2900, 4400 ] 575 0.114% 100.040% ( 4400, 6600 ] 142 0.028% 100.068% ( 6600, 9900 ] 26 0.005% 100.073% ( 9900, 14000 ] 11 0.002% 100.075% ( 14000, 22000 ] 13 0.003% 100.078% ( 22000, 33000 ] 7 0.001% 100.079% ( 33000, 50000 ] 3 0.001% 100.080% ** Level 1 read latency histogram (micros): Count: 35203 Average: 16.5530 StdDev: 152.50 Min: 0 Median: 1.7285 Max: 6533 Percentiles: P50: 1.73 P75: 3.30 P99: 424.27 P99.9: 2531.88 P99.99: 5631.92 ------------------------------------------------------ [ 0, 1 ] 9924 28.191% 28.191% ###### ( 1, 2 ] 10539 29.938% 58.129% ###### ( 2, 3 ] 4684 13.306% 71.434% ### ( 3, 4 ] 4166 11.834% 83.268% ## ( 4, 6 ] 3463 9.837% 93.106% ## ( 6, 10 ] 936 2.659% 95.765% # ( 10, 15 ] 500 1.420% 97.185% ( 15, 22 ] 190 0.540% 97.725% ( 22, 34 ] 91 0.259% 97.983% ( 34, 51 ] 12 0.034% 98.017% ( 76, 110 ] 1 0.003% 98.020% ( 110, 170 ] 37 0.105% 98.125% ( 170, 250 ] 99 0.281% 98.406% ( 250, 380 ] 174 0.494% 98.901% ( 380, 580 ] 158 0.449% 99.349% ( 580, 870 ] 105 0.298% 99.648% ( 870, 1300 ] 54 0.153% 99.801% ( 1300, 1900 ] 19 0.054% 99.855% ( 1900, 2900 ] 25 0.071% 99.926% ( 2900, 4400 ] 18 0.051% 99.977% ( 4400, 6600 ] 8 0.023% 100.000% ** Level 2 read latency histogram (micros): Count: 329782 Average: 15.0707 StdDev: 257.34 Min: 1 Median: 1.6903 Max: 35294 Percentiles: P50: 1.69 P75: 2.64 P99: 9.66 P99.9: 3101.54 P99.99: 5858.70 ------------------------------------------------------ [ 0, 1 ] 48874 14.820% 14.820% ### ( 1, 2 ] 168057 50.960% 65.780% ########## ( 2, 3 ] 47609 14.437% 80.217% ### ( 3, 4 ] 31764 9.632% 89.848% ## ( 4, 6 ] 25000 7.581% 97.429% ## ( 6, 10 ] 5655 1.715% 99.144% ( 10, 15 ] 454 0.138% 99.282% ( 15, 22 ] 126 0.038% 99.320% ( 22, 34 ] 47 0.014% 99.334% ( 34, 51 ] 66 0.020% 99.354% ( 51, 76 ] 31 0.009% 99.364% ( 76, 110 ] 9 0.003% 99.366% ( 110, 170 ] 13 0.004% 99.370% ( 170, 250 ] 38 0.012% 99.382% ( 250, 380 ] 124 0.038% 99.419% ( 380, 580 ] 340 0.103% 99.522% ( 580, 870 ] 448 0.136% 99.658% ( 870, 1300 ] 274 0.083% 99.741% ( 1300, 1900 ] 192 0.058% 99.800% ( 1900, 2900 ] 294 0.089% 99.889% ( 2900, 4400 ] 277 0.084% 99.973% ( 4400, 6600 ] 86 0.026% 99.999% ( 6600, 9900 ] 39 0.012% 100.011% ( 9900, 14000 ] 16 0.005% 100.015% ( 14000, 22000 ] 13 0.004% 100.019% ( 22000, 33000 ] 4 0.001% 100.021% ( 33000, 50000 ] 2 0.001% 100.021% ** Level 3 read latency histogram (micros): Count: 889526 Average: 14.4508 StdDev: 228.84 Min: 0 Median: 1.5874 Max: 38509 Percentiles: P50: 1.59 P75: 2.40 P99: 12.94 P99.9: 2432.57 P99.99: 4027.47 ------------------------------------------------------ [ 0, 1 ] 196978 22.144% 22.144% #### ( 1, 2 ] 421865 47.426% 69.570% ######### ( 2, 3 ] 121128 13.617% 83.187% ### ( 3, 4 ] 78521 8.827% 92.014% ## ( 4, 6 ] 52240 5.873% 97.887% # ( 6, 10 ] 9502 1.068% 98.955% ( 10, 15 ] 675 0.076% 99.031% ( 15, 22 ] 187 0.021% 99.052% ( 22, 34 ] 87 0.010% 99.062% ( 34, 51 ] 162 0.018% 99.080% ( 51, 76 ] 64 0.007% 99.087% ( 76, 110 ] 36 0.004% 99.092% ( 110, 170 ] 186 0.021% 99.112% ( 170, 250 ] 373 0.042% 99.154% ( 250, 380 ] 995 0.112% 99.266% ( 380, 580 ] 1699 0.191% 99.457% ( 580, 870 ] 1888 0.212% 99.669% ( 870, 1300 ] 1136 0.128% 99.797% ( 1300, 1900 ] 547 0.061% 99.859% ( 1900, 2900 ] 690 0.078% 99.936% ( 2900, 4400 ] 636 0.071% 100.008% ( 4400, 6600 ] 180 0.020% 100.028% ( 6600, 9900 ] 42 0.005% 100.033% ( 9900, 14000 ] 18 0.002% 100.035% ( 14000, 22000 ] 23 0.003% 100.037% ( 22000, 33000 ] 11 0.001% 100.039% ( 33000, 50000 ] 6 0.001% 100.039% ** Level 4 read latency histogram (micros): Count: 1125785 Average: 21.3762 StdDev: 246.67 Min: 0 Median: 1.4411 Max: 44149 Percentiles: P50: 1.44 P75: 2.18 P99: 564.68 P99.9: 2601.97 P99.99: 3863.00 ------------------------------------------------------ [ 0, 1 ] 360537 32.025% 32.025% ###### ( 1, 2 ] 458793 40.753% 72.779% ######## ( 2, 3 ] 141452 12.565% 85.343% ### ( 3, 4 ] 88389 7.851% 93.195% ## ( 4, 6 ] 46499 4.130% 97.325% # ( 6, 10 ] 5990 0.532% 97.857% ( 10, 15 ] 717 0.064% 97.921% ( 15, 22 ] 87 0.008% 97.928% ( 22, 34 ] 108 0.010% 97.938% ( 34, 51 ] 138 0.012% 97.950% ( 51, 76 ] 56 0.005% 97.955% ( 76, 110 ] 87 0.008% 97.963% ( 110, 170 ] 807 0.072% 98.035% ( 170, 250 ] 1922 0.171% 98.205% ( 250, 380 ] 4425 0.393% 98.598% ( 380, 580 ] 4895 0.435% 99.033% ( 580, 870 ] 5065 0.450% 99.483% ( 870, 1300 ] 2787 0.248% 99.731% ( 1300, 1900 ] 1046 0.093% 99.824% ( 1900, 2900 ] 1224 0.109% 99.932% ( 2900, 4400 ] 1010 0.090% 100.022% ( 4400, 6600 ] 244 0.022% 100.044% ( 6600, 9900 ] 53 0.005% 100.048% ( 9900, 14000 ] 34 0.003% 100.052% ( 14000, 22000 ] 26 0.002% 100.054% ( 22000, 33000 ] 13 0.001% 100.055% ( 33000, 50000 ] 6 0.001% 100.056% ** Level 5 read latency histogram (micros): Count: 13991 Average: 829.2917 StdDev: 1456.68 Min: 91 Median: 501.2848 Max: 46122 Percentiles: P50: 501.28 P75: 834.63 P99: 5331.53 P99.9: 23009.00 P99.99: 41843.06 ------------------------------------------------------ ( 76, 110 ] 49 0.350% 0.350% ( 110, 170 ] 563 4.024% 4.374% # ( 170, 250 ] 1368 9.778% 14.152% ## ( 250, 380 ] 3118 22.286% 36.438% #### ( 380, 580 ] 3129 22.364% 58.802% #### ( 580, 870 ] 2581 18.448% 77.250% #### ( 870, 1300 ] 1447 10.342% 87.592% ## ( 1300, 1900 ] 495 3.538% 91.130% # ( 1900, 2900 ] 566 4.045% 95.175% # ( 2900, 4400 ] 472 3.374% 98.549% # ( 4400, 6600 ] 149 1.065% 99.614% ( 6600, 9900 ] 30 0.214% 99.828% ( 9900, 14000 ] 5 0.036% 99.864% ( 14000, 22000 ] 4 0.029% 99.893% ( 22000, 33000 ] 11 0.079% 99.971% ( 33000, 50000 ] 5 0.036% 100.007% ** DB Stats ** Uptime(secs): 9.7 total, 4.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 202.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.755 H:M:S, 28.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 245.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.916 H:M:S, 22.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-15:08:24 ... thread 0: (1000000,3000000) ops and (288348.6,229469.7) ops/second in (3.468025,13.073622) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.75 GB 250.3 2.2 0.0 2.2 5.0 2.8 0.0 1.8 100.3 225.2 22.57 14.04 47 0.480 2299K 12K 0.0 0.0 L1 10/0 749.12 MB 74.9 0.7 0.5 0.3 0.7 0.5 0.0 1.6 59.8 59.0 12.70 4.56 1 12.700 771K 10K 0.0 0.0 L3 18/0 947.53 MB 0.9 3.1 1.6 1.4 3.0 1.6 0.0 1.8 124.5 122.8 25.22 14.24 13 1.940 2107K 12K 0.0 0.0 L4 143/0 9.67 GB 1.0 6.6 2.3 4.3 5.9 1.6 0.7 2.6 183.1 164.1 36.70 21.60 25 1.468 1436K 2272 0.0 0.0 L5 157/0 11.26 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 343/4 25.33 GB 0.0 12.6 4.4 8.2 14.6 6.4 3.1 5.3 132.6 153.8 97.19 54.43 86 1.130 6615K 37K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.6 4.4 8.2 14.6 6.4 3.1 5.3 132.6 153.8 97.19 54.43 86 1.130 6615K 37K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.6 4.4 8.2 11.8 3.6 0.0 0.0 151.1 142.2 85.25 47.19 47 1.814 6615K 37K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 237.1 11.94 7.24 39 0.306 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.2 total, 13.1 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.60 GB write, 1135.58 MB/s write, 12.58 GB read, 978.55 MB/s read, 97.2 seconds Interval compaction: 14.60 GB write, 1143.00 MB/s write, 12.58 GB read, 984.94 MB/s read, 97.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 32, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 769039 Average: 25.2932 StdDev: 224.05 Min: 0 Median: 1.3151 Max: 46281 Percentiles: P50: 1.32 P75: 1.86 P99: 599.35 P99.9: 2148.83 P99.99: 3382.02 ------------------------------------------------------ [ 0, 1 ] 273057 35.506% 35.506% ####### ( 1, 2 ] 353707 45.993% 81.500% ######### ( 2, 3 ] 60048 7.808% 89.308% ## ( 3, 4 ] 29602 3.849% 93.157% # ( 4, 6 ] 17693 2.301% 95.458% ( 6, 10 ] 4175 0.543% 96.001% ( 10, 15 ] 1414 0.184% 96.184% ( 15, 22 ] 147 0.019% 96.204% ( 22, 34 ] 73 0.009% 96.213% ( 34, 51 ] 45 0.006% 96.219% ( 51, 76 ] 12 0.002% 96.220% ( 76, 110 ] 163 0.021% 96.242% ( 110, 170 ] 2178 0.283% 96.525% ( 170, 250 ] 4267 0.555% 97.080% ( 250, 380 ] 8957 1.165% 98.244% ( 380, 580 ] 5526 0.719% 98.963% ( 580, 870 ] 4281 0.557% 99.520% ( 870, 1300 ] 2077 0.270% 99.790% ( 1300, 1900 ] 681 0.089% 99.878% ( 1900, 2900 ] 675 0.088% 99.966% ( 2900, 4400 ] 576 0.075% 100.041% ( 4400, 6600 ] 142 0.018% 100.059% ( 6600, 9900 ] 26 0.003% 100.063% ( 9900, 14000 ] 11 0.001% 100.064% ( 14000, 22000 ] 13 0.002% 100.066% ( 22000, 33000 ] 7 0.001% 100.067% ( 33000, 50000 ] 3 0.000% 100.067% ** Level 1 read latency histogram (micros): Count: 73252 Average: 12.7907 StdDev: 109.99 Min: 0 Median: 2.5569 Max: 6533 Percentiles: P50: 2.56 P75: 3.94 P99: 311.16 P99.9: 1283.86 P99.99: 4585.57 ------------------------------------------------------ [ 0, 1 ] 13680 18.675% 18.675% #### ( 1, 2 ] 16801 22.936% 41.611% ##### ( 2, 3 ] 11034 15.063% 56.674% ### ( 3, 4 ] 14276 19.489% 76.163% #### ( 4, 6 ] 9812 13.395% 89.558% ### ( 6, 10 ] 3266 4.459% 94.017% # ( 10, 15 ] 1963 2.680% 96.696% # ( 15, 22 ] 643 0.878% 97.574% ( 22, 34 ] 357 0.487% 98.061% ( 34, 51 ] 55 0.075% 98.137% ( 51, 76 ] 8 0.011% 98.147% ( 76, 110 ] 8 0.011% 98.158% ( 110, 170 ] 134 0.183% 98.341% ( 170, 250 ] 259 0.354% 98.695% ( 250, 380 ] 475 0.648% 99.343% ( 380, 580 ] 233 0.318% 99.661% ( 580, 870 ] 117 0.160% 99.821% ( 870, 1300 ] 60 0.082% 99.903% ( 1300, 1900 ] 20 0.027% 99.930% ( 1900, 2900 ] 25 0.034% 99.965% ( 2900, 4400 ] 18 0.025% 99.989% ( 4400, 6600 ] 8 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 329782 Average: 15.0707 StdDev: 257.34 Min: 1 Median: 1.6903 Max: 35294 Percentiles: P50: 1.69 P75: 2.64 P99: 9.66 P99.9: 3101.54 P99.99: 5858.70 ------------------------------------------------------ [ 0, 1 ] 48874 14.820% 14.820% ### ( 1, 2 ] 168057 50.960% 65.780% ########## ( 2, 3 ] 47609 14.437% 80.217% ### ( 3, 4 ] 31764 9.632% 89.848% ## ( 4, 6 ] 25000 7.581% 97.429% ## ( 6, 10 ] 5655 1.715% 99.144% ( 10, 15 ] 454 0.138% 99.282% ( 15, 22 ] 126 0.038% 99.320% ( 22, 34 ] 47 0.014% 99.334% ( 34, 51 ] 66 0.020% 99.354% ( 51, 76 ] 31 0.009% 99.364% ( 76, 110 ] 9 0.003% 99.366% ( 110, 170 ] 13 0.004% 99.370% ( 170, 250 ] 38 0.012% 99.382% ( 250, 380 ] 124 0.038% 99.419% ( 380, 580 ] 340 0.103% 99.522% ( 580, 870 ] 448 0.136% 99.658% ( 870, 1300 ] 274 0.083% 99.741% ( 1300, 1900 ] 192 0.058% 99.800% ( 1900, 2900 ] 294 0.089% 99.889% ( 2900, 4400 ] 277 0.084% 99.973% ( 4400, 6600 ] 86 0.026% 99.999% ( 6600, 9900 ] 39 0.012% 100.011% ( 9900, 14000 ] 16 0.005% 100.015% ( 14000, 22000 ] 13 0.004% 100.019% ( 22000, 33000 ] 4 0.001% 100.021% ( 33000, 50000 ] 2 0.001% 100.021% ** Level 3 read latency histogram (micros): Count: 892079 Average: 15.2319 StdDev: 229.05 Min: 0 Median: 1.5904 Max: 38509 Percentiles: P50: 1.59 P75: 2.41 P99: 262.10 P99.9: 2428.87 P99.99: 4026.87 ------------------------------------------------------ [ 0, 1 ] 196978 22.081% 22.081% #### ( 1, 2 ] 421865 47.290% 69.371% ######### ( 2, 3 ] 121128 13.578% 82.949% ### ( 3, 4 ] 78521 8.802% 91.751% ## ( 4, 6 ] 52240 5.856% 97.607% # ( 6, 10 ] 9502 1.065% 98.672% ( 10, 15 ] 675 0.076% 98.748% ( 15, 22 ] 187 0.021% 98.769% ( 22, 34 ] 87 0.010% 98.779% ( 34, 51 ] 162 0.018% 98.797% ( 51, 76 ] 64 0.007% 98.804% ( 76, 110 ] 60 0.007% 98.811% ( 110, 170 ] 524 0.059% 98.869% ( 170, 250 ] 959 0.108% 98.977% ( 250, 380 ] 2215 0.248% 99.225% ( 380, 580 ] 2043 0.229% 99.454% ( 580, 870 ] 1926 0.216% 99.670% ( 870, 1300 ] 1139 0.128% 99.798% ( 1300, 1900 ] 547 0.061% 99.859% ( 1900, 2900 ] 690 0.077% 99.936% ( 2900, 4400 ] 636 0.071% 100.008% ( 4400, 6600 ] 180 0.020% 100.028% ( 6600, 9900 ] 42 0.005% 100.033% ( 9900, 14000 ] 18 0.002% 100.035% ( 14000, 22000 ] 23 0.003% 100.037% ( 22000, 33000 ] 11 0.001% 100.038% ( 33000, 50000 ] 6 0.001% 100.039% ** Level 4 read latency histogram (micros): Count: 1142663 Average: 25.2742 StdDev: 247.30 Min: 0 Median: 1.4594 Max: 44149 Percentiles: P50: 1.46 P75: 2.27 P99: 572.40 P99.9: 2584.92 P99.99: 3854.55 ------------------------------------------------------ [ 0, 1 ] 360539 31.553% 31.553% ###### ( 1, 2 ] 458806 40.152% 71.705% ######## ( 2, 3 ] 141460 12.380% 84.085% ## ( 3, 4 ] 88415 7.738% 91.822% ## ( 4, 6 ] 46530 4.072% 95.894% # ( 6, 10 ] 6009 0.526% 96.420% ( 10, 15 ] 734 0.064% 96.485% ( 15, 22 ] 89 0.008% 96.492% ( 22, 34 ] 109 0.010% 96.502% ( 34, 51 ] 139 0.012% 96.514% ( 51, 76 ] 56 0.005% 96.519% ( 76, 110 ] 257 0.022% 96.541% ( 110, 170 ] 2981 0.261% 96.802% ( 170, 250 ] 5892 0.516% 97.318% ( 250, 380 ] 12316 1.078% 98.396% ( 380, 580 ] 7177 0.628% 99.024% ( 580, 870 ] 5321 0.466% 99.490% ( 870, 1300 ] 2797 0.245% 99.734% ( 1300, 1900 ] 1055 0.092% 99.827% ( 1900, 2900 ] 1224 0.107% 99.934% ( 2900, 4400 ] 1010 0.088% 100.022% ( 4400, 6600 ] 244 0.021% 100.043% ( 6600, 9900 ] 53 0.005% 100.048% ( 9900, 14000 ] 34 0.003% 100.051% ( 14000, 22000 ] 26 0.002% 100.053% ( 22000, 33000 ] 13 0.001% 100.055% ( 33000, 50000 ] 6 0.001% 100.055% ** Level 5 read latency histogram (micros): Count: 25554 Average: 585.0193 StdDev: 1113.83 Min: 90 Median: 348.6050 Max: 46122 Percentiles: P50: 348.60 P75: 563.08 P99: 4233.38 P99.9: 9729.06 P99.99: 37911.64 ------------------------------------------------------ ( 76, 110 ] 164 0.642% 0.642% ( 110, 170 ] 2066 8.085% 8.727% ## ( 170, 250 ] 4055 15.868% 24.595% ### ( 250, 380 ] 8559 33.494% 58.089% ####### ( 380, 580 ] 4721 18.475% 76.563% #### ( 580, 870 ] 2788 10.910% 87.474% ## ( 870, 1300 ] 1460 5.713% 93.187% # ( 1300, 1900 ] 497 1.945% 95.132% ( 1900, 2900 ] 568 2.223% 97.355% ( 2900, 4400 ] 473 1.851% 99.206% ( 4400, 6600 ] 149 0.583% 99.789% ( 6600, 9900 ] 30 0.117% 99.906% ( 9900, 14000 ] 5 0.020% 99.926% ( 14000, 22000 ] 4 0.016% 99.941% ( 22000, 33000 ] 11 0.043% 99.984% ( 33000, 50000 ] 5 0.020% 100.004% ** DB Stats ** Uptime(secs): 13.2 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 224.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.975 H:M:S, 22.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.220 H:M:S, 6.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-15:08:29 ... thread 0: (1000000,4000000) ops and (209484.7,224124.3) ops/second in (4.773619,17.847241) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.73 GB 69.0 3.3 0.0 3.3 7.0 3.7 0.0 1.9 113.8 244.2 29.29 20.32 67 0.437 3385K 17K 0.0 0.0 L1 10/10 749.12 MB 0.0 0.7 0.5 0.3 0.7 0.5 0.0 1.6 59.8 59.0 12.70 4.56 1 12.700 771K 10K 0.0 0.0 L3 18/0 947.53 MB 0.9 3.1 1.6 1.4 3.0 1.6 0.0 1.8 124.5 122.8 25.22 14.24 13 1.940 2107K 12K 0.0 0.0 L4 143/0 9.67 GB 1.0 6.6 2.3 4.3 5.9 1.6 0.7 2.6 183.1 164.1 36.70 21.60 25 1.468 1436K 2272 0.0 0.0 L5 157/0 11.26 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 347/24 26.31 GB 0.0 13.6 4.4 9.2 16.6 7.4 3.1 4.4 134.3 163.8 103.91 60.71 106 0.980 7701K 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.6 4.4 9.2 16.6 7.4 3.1 4.4 134.3 163.8 103.91 60.71 106 0.980 7701K 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.6 4.4 9.2 12.9 3.6 0.0 0.0 156.7 148.1 89.04 50.87 51 1.746 7701K 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 258.0 14.87 9.85 55 0.270 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.9 total, 17.9 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.62 GB write, 948.82 MB/s write, 13.62 GB read, 777.76 MB/s read, 103.9 seconds Interval compaction: 16.62 GB write, 953.36 MB/s write, 13.62 GB read, 781.48 MB/s read, 103.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 32, interval: 38 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1018568 Average: 24.4309 StdDev: 197.95 Min: 0 Median: 1.3477 Max: 46281 Percentiles: P50: 1.35 P75: 1.86 P99: 513.07 P99.9: 1717.39 P99.99: 2988.91 ------------------------------------------------------ [ 0, 1 ] 337948 33.179% 33.179% ####### ( 1, 2 ] 492795 48.381% 81.560% ########## ( 2, 3 ] 71014 6.972% 88.532% # ( 3, 4 ] 35840 3.519% 92.051% # ( 4, 6 ] 21159 2.077% 94.128% ( 6, 10 ] 5616 0.551% 94.679% ( 10, 15 ] 5038 0.495% 95.174% ( 15, 22 ] 359 0.035% 95.209% ( 22, 34 ] 228 0.022% 95.231% ( 34, 51 ] 57 0.006% 95.237% ( 51, 76 ] 14 0.001% 95.238% ( 76, 110 ] 474 0.047% 95.285% ( 110, 170 ] 6156 0.604% 95.889% ( 170, 250 ] 9325 0.916% 96.805% ( 250, 380 ] 17932 1.761% 98.565% ( 380, 580 ] 6654 0.653% 99.219% ( 580, 870 ] 4382 0.430% 99.649% ( 870, 1300 ] 2084 0.205% 99.853% ( 1300, 1900 ] 682 0.067% 99.920% ( 1900, 2900 ] 675 0.066% 99.987% ( 2900, 4400 ] 576 0.057% 100.043% ( 4400, 6600 ] 142 0.014% 100.057% ( 6600, 9900 ] 26 0.003% 100.060% ( 9900, 14000 ] 11 0.001% 100.061% ( 14000, 22000 ] 13 0.001% 100.062% ( 22000, 33000 ] 7 0.001% 100.063% ( 33000, 50000 ] 3 0.000% 100.063% ** Level 1 read latency histogram (micros): Count: 77750 Average: 25.1043 StdDev: 121.15 Min: 0 Median: 2.7455 Max: 6533 Percentiles: P50: 2.75 P75: 4.45 P99: 377.61 P99.9: 1252.42 P99.99: 4461.87 ------------------------------------------------------ [ 0, 1 ] 13721 17.648% 17.648% #### ( 1, 2 ] 16862 21.687% 39.335% #### ( 2, 3 ] 11122 14.305% 53.640% ### ( 3, 4 ] 14392 18.511% 72.150% #### ( 4, 6 ] 9877 12.704% 84.854% ### ( 6, 10 ] 3301 4.246% 89.100% # ( 10, 15 ] 2084 2.680% 91.780% # ( 15, 22 ] 651 0.837% 92.617% ( 22, 34 ] 360 0.463% 93.080% ( 34, 51 ] 57 0.073% 93.154% ( 51, 76 ] 8 0.010% 93.164% ( 76, 110 ] 67 0.086% 93.250% ( 110, 170 ] 900 1.158% 94.408% ( 170, 250 ] 1302 1.675% 96.082% ( 250, 380 ] 2311 2.972% 99.055% # ( 380, 580 ] 462 0.594% 99.649% ( 580, 870 ] 141 0.181% 99.830% ( 870, 1300 ] 61 0.078% 99.909% ( 1300, 1900 ] 20 0.026% 99.934% ( 1900, 2900 ] 25 0.032% 99.967% ( 2900, 4400 ] 18 0.023% 99.990% ( 4400, 6600 ] 8 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 329782 Average: 15.0707 StdDev: 257.34 Min: 1 Median: 1.6903 Max: 35294 Percentiles: P50: 1.69 P75: 2.64 P99: 9.66 P99.9: 3101.54 P99.99: 5858.70 ------------------------------------------------------ [ 0, 1 ] 48874 14.820% 14.820% ### ( 1, 2 ] 168057 50.960% 65.780% ########## ( 2, 3 ] 47609 14.437% 80.217% ### ( 3, 4 ] 31764 9.632% 89.848% ## ( 4, 6 ] 25000 7.581% 97.429% ## ( 6, 10 ] 5655 1.715% 99.144% ( 10, 15 ] 454 0.138% 99.282% ( 15, 22 ] 126 0.038% 99.320% ( 22, 34 ] 47 0.014% 99.334% ( 34, 51 ] 66 0.020% 99.354% ( 51, 76 ] 31 0.009% 99.364% ( 76, 110 ] 9 0.003% 99.366% ( 110, 170 ] 13 0.004% 99.370% ( 170, 250 ] 38 0.012% 99.382% ( 250, 380 ] 124 0.038% 99.419% ( 380, 580 ] 340 0.103% 99.522% ( 580, 870 ] 448 0.136% 99.658% ( 870, 1300 ] 274 0.083% 99.741% ( 1300, 1900 ] 192 0.058% 99.800% ( 1900, 2900 ] 294 0.089% 99.889% ( 2900, 4400 ] 277 0.084% 99.973% ( 4400, 6600 ] 86 0.026% 99.999% ( 6600, 9900 ] 39 0.012% 100.011% ( 9900, 14000 ] 16 0.005% 100.015% ( 14000, 22000 ] 13 0.004% 100.019% ( 22000, 33000 ] 4 0.001% 100.021% ( 33000, 50000 ] 2 0.001% 100.021% ** Level 3 read latency histogram (micros): Count: 895848 Average: 16.2492 StdDev: 229.18 Min: 0 Median: 1.5948 Max: 38509 Percentiles: P50: 1.59 P75: 2.44 P99: 321.86 P99.9: 2423.41 P99.99: 4025.98 ------------------------------------------------------ [ 0, 1 ] 196978 21.988% 21.988% #### ( 1, 2 ] 421865 47.091% 69.079% ######### ( 2, 3 ] 121128 13.521% 82.600% ### ( 3, 4 ] 78521 8.765% 91.365% ## ( 4, 6 ] 52240 5.831% 97.196% # ( 6, 10 ] 9502 1.061% 98.257% ( 10, 15 ] 675 0.075% 98.332% ( 15, 22 ] 187 0.021% 98.353% ( 22, 34 ] 87 0.010% 98.363% ( 34, 51 ] 162 0.018% 98.381% ( 51, 76 ] 64 0.007% 98.388% ( 76, 110 ] 119 0.013% 98.402% ( 110, 170 ] 1214 0.136% 98.537% ( 170, 250 ] 1905 0.213% 98.750% ( 250, 380 ] 4057 0.453% 99.203% ( 380, 580 ] 2257 0.252% 99.454% ( 580, 870 ] 1944 0.217% 99.671% ( 870, 1300 ] 1139 0.127% 99.799% ( 1300, 1900 ] 547 0.061% 99.860% ( 1900, 2900 ] 690 0.077% 99.937% ( 2900, 4400 ] 636 0.071% 100.008% ( 4400, 6600 ] 180 0.020% 100.028% ( 6600, 9900 ] 42 0.005% 100.032% ( 9900, 14000 ] 18 0.002% 100.034% ( 14000, 22000 ] 23 0.003% 100.037% ( 22000, 33000 ] 11 0.001% 100.038% ( 33000, 50000 ] 6 0.001% 100.039% ** Level 4 read latency histogram (micros): Count: 1167352 Average: 30.1758 StdDev: 247.30 Min: 0 Median: 1.4863 Max: 44149 Percentiles: P50: 1.49 P75: 2.40 P99: 571.85 P99.9: 2563.11 P99.99: 3847.92 ------------------------------------------------------ [ 0, 1 ] 360539 30.885% 30.885% ###### ( 1, 2 ] 458806 39.303% 70.188% ######## ( 2, 3 ] 141460 12.118% 82.306% ## ( 3, 4 ] 88415 7.574% 89.880% ## ( 4, 6 ] 46530 3.986% 93.866% # ( 6, 10 ] 6009 0.515% 94.381% ( 10, 15 ] 734 0.063% 94.444% ( 15, 22 ] 89 0.008% 94.452% ( 22, 34 ] 109 0.009% 94.461% ( 34, 51 ] 139 0.012% 94.473% ( 51, 76 ] 56 0.005% 94.478% ( 76, 110 ] 606 0.052% 94.529% ( 110, 170 ] 7593 0.650% 95.180% ( 170, 250 ] 12357 1.059% 96.238% ( 250, 380 ] 23912 2.048% 98.287% ( 380, 580 ] 8678 0.743% 99.030% ( 580, 870 ] 5470 0.469% 99.499% ( 870, 1300 ] 2815 0.241% 99.740% ( 1300, 1900 ] 1056 0.090% 99.830% ( 1900, 2900 ] 1224 0.105% 99.935% ( 2900, 4400 ] 1010 0.087% 100.022% ( 4400, 6600 ] 244 0.021% 100.043% ( 6600, 9900 ] 53 0.005% 100.047% ( 9900, 14000 ] 34 0.003% 100.050% ( 14000, 22000 ] 26 0.002% 100.052% ( 22000, 33000 ] 13 0.001% 100.054% ( 33000, 50000 ] 6 0.001% 100.054% ** Level 5 read latency histogram (micros): Count: 42663 Average: 453.7142 StdDev: 878.89 Min: 89 Median: 305.8294 Max: 46122 Percentiles: P50: 305.83 P75: 420.02 P99: 3684.47 P99.9: 7627.07 P99.99: 30733.70 ------------------------------------------------------ ( 76, 110 ] 443 1.038% 1.038% ( 110, 170 ] 5272 12.357% 13.396% ## ( 170, 250 ] 8448 19.802% 33.197% #### ( 250, 380 ] 16692 39.125% 72.323% ######## ( 380, 580 ] 5709 13.382% 85.704% ### ( 580, 870 ] 2891 6.776% 92.481% # ( 870, 1300 ] 1468 3.441% 95.922% # ( 1300, 1900 ] 497 1.165% 97.086% ( 1900, 2900 ] 569 1.334% 98.420% ( 2900, 4400 ] 473 1.109% 99.529% ( 4400, 6600 ] 149 0.349% 99.878% ( 6600, 9900 ] 30 0.070% 99.948% ( 9900, 14000 ] 5 0.012% 99.960% ( 14000, 22000 ] 4 0.009% 99.970% ( 22000, 33000 ] 11 0.026% 99.995% ( 33000, 50000 ] 5 0.012% 100.007% ** DB Stats ** Uptime(secs): 17.9 total, 4.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 219.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.831 H:M:S, 21.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 206.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.856 H:M:S, 17.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 508.723 micros/op 7853 ops/sec 20.119 seconds 157996 operations; 7.6 MB/s (38999 of 38999 found) Microseconds per read: Count: 157996 Average: 508.7482 StdDev: 1228.18 Min: 2 Median: 367.8529 Max: 107316 Percentiles: P50: 367.85 P75: 530.59 P99: 3705.15 P99.9: 16518.81 P99.99: 49284.57 ------------------------------------------------------ ( 1, 2 ] 5 0.003% 0.003% ( 2, 3 ] 12 0.008% 0.011% ( 3, 4 ] 17 0.011% 0.022% ( 4, 6 ] 73 0.046% 0.068% ( 6, 10 ] 277 0.175% 0.243% ( 10, 15 ] 814 0.515% 0.758% ( 15, 22 ] 1003 0.635% 1.393% ( 22, 34 ] 2472 1.565% 2.958% ( 34, 51 ] 1700 1.076% 4.034% ( 51, 76 ] 2394 1.515% 5.549% ( 76, 110 ] 872 0.552% 6.101% ( 110, 170 ] 5946 3.763% 9.864% # ( 170, 250 ] 26506 16.776% 26.641% ### ( 250, 380 ] 40711 25.767% 52.408% ##### ( 380, 580 ] 47407 30.005% 82.413% ###### ( 580, 870 ] 15686 9.928% 92.341% ## ( 870, 1300 ] 6338 4.011% 96.352% # ( 1300, 1900 ] 1951 1.235% 97.587% ( 1900, 2900 ] 1538 0.973% 98.561% ( 2900, 4400 ] 1293 0.818% 99.379% ( 4400, 6600 ] 460 0.291% 99.670% ( 6600, 9900 ] 226 0.143% 99.813% ( 9900, 14000 ] 103 0.065% 99.878% ( 14000, 22000 ] 108 0.068% 99.947% ( 22000, 33000 ] 50 0.032% 99.978% ( 33000, 50000 ] 19 0.012% 99.991% ( 50000, 75000 ] 11 0.007% 99.997% ( 75000, 110000 ] 4 0.003% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2600565 rocksdb.bloom.filter.full.positive COUNT : 182575 rocksdb.bloom.filter.full.true.positive COUNT : 157230 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 766 rocksdb.memtable.miss COUNT : 157230 rocksdb.l0.hit COUNT : 21617 rocksdb.l1.hit COUNT : 3744 rocksdb.l2andup.hit COUNT : 131869 rocksdb.compaction.key.drop.new COUNT : 793359 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4226387 rocksdb.number.keys.read COUNT : 157996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4361631384 rocksdb.bytes.read COUNT : 157996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 538 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5133769 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15337063046 rocksdb.compact.write.bytes COUNT : 14516016239 rocksdb.flush.write.bytes COUNT : 4352782447 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 776 rocksdb.number.superversion_releases COUNT : 747 rocksdb.number.superversion_cleanups COUNT : 190 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 178 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324639744 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8056832 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 15517372494 rocksdb.non.last.level.read.count COUNT : 3720335 rocksdb.block.checksum.compute.count COUNT : 3900657 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 364.404037 P95 : 1152.704607 P99 : 3702.372093 P100 : 107314.000000 COUNT : 157996 SUM : 80003602 rocksdb.db.write.micros P50 : 1.468380 P95 : 3.854161 P99 : 5.995933 P100 : 534724.000000 COUNT : 4226387 SUM : 15142599 rocksdb.compaction.times.micros P50 : 1448387.096774 P95 : 2750000.000000 P99 : 11816000.000000 P100 : 12699941.000000 COUNT : 52 SUM : 89904151 rocksdb.compaction.times.cpu_micros P50 : 899230.769231 P95 : 1480000.000000 P99 : 4557300.000000 P100 : 4557300.000000 COUNT : 52 SUM : 51721917 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 895.294118 P95 : 6600.000000 P99 : 16410.000000 P100 : 16410.000000 COUNT : 60 SUM : 101912 rocksdb.compaction.outfile.sync.micros P50 : 2650.000000 P95 : 22660.000000 P99 : 53250.000000 P100 : 61205.000000 COUNT : 174 SUM : 879700 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 280.333333 P95 : 1825.000000 P99 : 4275.000000 P100 : 24908.000000 COUNT : 125 SUM : 84568 rocksdb.table.open.io.micros P50 : 5166.972477 P95 : 19445.161290 P99 : 58100.000000 P100 : 82917.000000 COUNT : 538 SUM : 3671250 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.789168 P95 : 7.144403 P99 : 242.353530 P100 : 46287.000000 COUNT : 3715680 SUM : 51484054 rocksdb.read.block.get.micros P50 : 282.487434 P95 : 886.185168 P99 : 3073.690896 P100 : 46128.000000 COUNT : 185092 SUM : 69473938 rocksdb.write.raw.block.micros P50 : 0.520756 P95 : 0.989436 P99 : 3.690941 P100 : 99205.000000 COUNT : 4572239 SUM : 13204007 rocksdb.numfiles.in.singlecompaction P50 : 3.192308 P95 : 5.933333 P99 : 24.000000 P100 : 24.000000 COUNT : 66 SUM : 257 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.574821 P95 : 1109.024013 P99 : 1299.619104 P100 : 534526.000000 COUNT : 20766 SUM : 5137608 rocksdb.sst.read.micros P50 : 1.518673 P95 : 164.619948 P99 : 555.719288 P100 : 46281.000000 COUNT : 3721392 SUM : 110495397 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 157996 SUM : 157996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4226387 SUM : 4361631384 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223333.333333 P95 : 642500.000000 P99 : 790063.000000 P100 : 790063.000000 COUNT : 60 SUM : 15826752 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 189 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0