[2024-12-06 00:40:17.325757] Starting SPDK v25.01-pre git sha1 a5e6ecf28 / DPDK 24.03.0 initialization... [2024-12-06 00:40:17.325853] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1849376 ] Set seed to 1733442017323417 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 00:40:17.434434] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 00:40:17.543376] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 00:40:17.543420] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1849376' to capture a snapshot of events at runtime. [2024-12-06 00:40:17.543432] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-06 00:40:17.543458] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-06 00:40:17.543466] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1849376 for offline analysis/debug. [2024-12-06 00:40:17.544753] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 00:40:23 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/06-00:40:29 ... thread 0: (1000000,1000000) ops and (171516.9,171516.9) ops/second in (5.830328,5.830328) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.56 GB 50.1 0.3 0.0 0.3 1.1 0.8 0.0 1.4 40.7 146.3 7.72 3.58 11 0.702 319K 1752 0.0 0.0 L1 5/5 367.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 18/18 2.26 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 24/6 1.28 GB 1.0 1.6 1.6 0.0 1.6 1.6 0.0 1.0 132.0 131.5 12.46 7.77 5 2.492 0 0 0.0 0.0 L4 128/15 9.69 GB 0.9 2.0 0.4 1.6 1.6 0.0 0.8 4.5 129.4 105.9 15.46 7.90 7 2.209 369K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 304/54 24.68 GB 0.0 3.9 1.9 1.9 4.3 2.4 1.5 5.4 111.1 123.6 35.64 19.26 23 1.550 688K 1752 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.9 1.9 4.3 2.4 1.5 5.4 111.1 123.6 35.64 19.26 23 1.550 688K 1752 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.9 1.9 3.5 1.6 0.0 0.0 130.1 117.9 30.45 17.00 13 2.342 688K 1752 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 157.3 5.20 2.26 10 0.520 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.30 GB write, 744.62 MB/s write, 3.87 GB read, 669.13 MB/s read, 35.6 seconds Interval compaction: 4.30 GB write, 755.28 MB/s write, 3.87 GB read, 678.71 MB/s read, 35.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 196819 Average: 40.6944 StdDev: 285.85 Min: 1 Median: 1.9811 Max: 27503 Percentiles: P50: 1.98 P75: 2.98 P99: 1200.73 P99.9: 3793.35 P99.99: 4808.19 ------------------------------------------------------ [ 0, 1 ] 5751 2.922% 2.922% # ( 1, 2 ] 94444 47.985% 50.907% ########## ( 2, 3 ] 48259 24.519% 75.427% ##### ( 3, 4 ] 17011 8.643% 84.070% ## ( 4, 6 ] 18691 9.497% 93.566% ## ( 6, 10 ] 5070 2.576% 96.142% # ( 10, 15 ] 957 0.486% 96.628% ( 15, 22 ] 112 0.057% 96.685% ( 22, 34 ] 8 0.004% 96.689% ( 34, 51 ] 7 0.004% 96.693% ( 51, 76 ] 5 0.003% 96.695% ( 76, 110 ] 5 0.003% 96.698% ( 110, 170 ] 86 0.044% 96.742% ( 170, 250 ] 267 0.136% 96.877% ( 250, 380 ] 632 0.321% 97.198% ( 380, 580 ] 1082 0.550% 97.748% ( 580, 870 ] 1477 0.750% 98.499% ( 870, 1300 ] 1283 0.652% 99.150% ( 1300, 1900 ] 714 0.363% 99.513% ( 1900, 2900 ] 517 0.263% 99.776% ( 2900, 4400 ] 410 0.208% 99.984% ( 4400, 6600 ] 61 0.031% 100.015% ( 6600, 9900 ] 11 0.006% 100.021% ( 9900, 14000 ] 2 0.001% 100.022% ( 14000, 22000 ] 3 0.002% 100.023% ( 22000, 33000 ] 1 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 267 Average: 1493.0150 StdDev: 2321.57 Min: 126 Median: 867.4107 Max: 28436 Percentiles: P50: 867.41 P75: 1686.36 P99: 10576.50 P99.9: 28436.00 P99.99: 28436.00 ------------------------------------------------------ ( 110, 170 ] 2 0.749% 0.749% ( 170, 250 ] 14 5.243% 5.993% # ( 250, 380 ] 23 8.614% 14.607% ## ( 380, 580 ] 39 14.607% 29.213% ### ( 580, 870 ] 56 20.974% 50.187% #### ( 870, 1300 ] 45 16.854% 67.041% ### ( 1300, 1900 ] 33 12.360% 79.401% ## ( 1900, 2900 ] 23 8.614% 88.015% ## ( 2900, 4400 ] 21 7.865% 95.880% ## ( 4400, 6600 ] 4 1.498% 97.378% ( 6600, 9900 ] 4 1.498% 98.876% ( 9900, 14000 ] 2 0.749% 99.625% ( 22000, 33000 ] 1 0.375% 100.000% ** Level 2 read latency histogram (micros): Count: 472455 Average: 14.9935 StdDev: 164.17 Min: 1 Median: 2.0598 Max: 25758 Percentiles: P50: 2.06 P75: 2.99 P99: 14.59 P99.9: 1241.30 P99.99: 1639.73 ------------------------------------------------------ [ 0, 1 ] 7436 1.574% 1.574% ( 1, 2 ] 221208 46.821% 48.395% ######### ( 2, 3 ] 126851 26.849% 75.244% ##### ( 3, 4 ] 47072 9.963% 85.207% ## ( 4, 6 ] 49666 10.512% 95.720% ## ( 6, 10 ] 13097 2.772% 98.492% # ( 10, 15 ] 2617 0.554% 99.046% ( 15, 22 ] 377 0.080% 99.126% ( 22, 34 ] 37 0.008% 99.133% ( 34, 51 ] 19 0.004% 99.137% ( 51, 76 ] 29 0.006% 99.144% ( 76, 110 ] 15 0.003% 99.147% ( 110, 170 ] 87 0.018% 99.165% ( 170, 250 ] 238 0.050% 99.216% ( 250, 380 ] 552 0.117% 99.332% ( 380, 580 ] 889 0.188% 99.521% ( 580, 870 ] 1037 0.219% 99.740% ( 870, 1300 ] 875 0.185% 99.925% ( 1300, 1900 ] 540 0.114% 100.040% ( 1900, 2900 ] 395 0.084% 100.123% ( 2900, 4400 ] 312 0.066% 100.189% ( 4400, 6600 ] 69 0.015% 100.204% ( 6600, 9900 ] 9 0.002% 100.206% ( 9900, 14000 ] 4 0.001% 100.207% ( 22000, 33000 ] 1 0.000% 100.207% ** Level 3 read latency histogram (micros): Count: 133597 Average: 25.5362 StdDev: 209.11 Min: 1 Median: 2.1878 Max: 8552 Percentiles: P50: 2.19 P75: 3.22 P99: 778.33 P99.9: 2755.62 P99.99: 3755.10 ------------------------------------------------------ [ 0, 1 ] 2492 1.865% 1.865% ( 1, 2 ] 57310 42.898% 44.763% ######### ( 2, 3 ] 37252 27.884% 72.647% ###### ( 3, 4 ] 14108 10.560% 83.207% ## ( 4, 6 ] 15358 11.496% 94.703% ## ( 6, 10 ] 3660 2.740% 97.442% # ( 10, 15 ] 671 0.502% 97.945% ( 15, 22 ] 94 0.070% 98.015% ( 22, 34 ] 10 0.007% 98.022% ( 34, 51 ] 10 0.007% 98.030% ( 51, 76 ] 10 0.007% 98.037% ( 76, 110 ] 6 0.004% 98.042% ( 110, 170 ] 46 0.034% 98.076% ( 170, 250 ] 116 0.087% 98.163% ( 250, 380 ] 242 0.181% 98.344% ( 380, 580 ] 465 0.348% 98.692% ( 580, 870 ] 601 0.450% 99.142% ( 870, 1300 ] 554 0.415% 99.557% ( 1300, 1900 ] 283 0.212% 99.769% ( 1900, 2900 ] 205 0.153% 99.922% ( 2900, 4400 ] 159 0.119% 100.041% ( 4400, 6600 ] 27 0.020% 100.061% ( 6600, 9900 ] 7 0.005% 100.067% ** Level 4 read latency histogram (micros): Count: 586509 Average: 26.1147 StdDev: 239.35 Min: 1 Median: 2.1787 Max: 28708 Percentiles: P50: 2.18 P75: 3.23 P99: 566.87 P99.9: 1725.75 P99.99: 2078.00 ------------------------------------------------------ [ 0, 1 ] 9007 1.536% 1.536% ( 1, 2 ] 255654 43.589% 45.125% ######### ( 2, 3 ] 160038 27.287% 72.411% ##### ( 3, 4 ] 64651 11.023% 83.434% ## ( 4, 6 ] 67458 11.502% 94.936% ## ( 6, 10 ] 16668 2.842% 97.778% # ( 10, 15 ] 3491 0.595% 98.373% ( 15, 22 ] 500 0.085% 98.458% ( 22, 34 ] 43 0.007% 98.466% ( 34, 51 ] 67 0.011% 98.477% ( 51, 76 ] 56 0.010% 98.487% ( 76, 110 ] 24 0.004% 98.491% ( 110, 170 ] 129 0.022% 98.513% ( 170, 250 ] 394 0.067% 98.580% ( 250, 380 ] 857 0.146% 98.726% ( 380, 580 ] 1723 0.294% 99.020% ( 580, 870 ] 2272 0.387% 99.407% ( 870, 1300 ] 2020 0.344% 99.752% ( 1300, 1900 ] 1231 0.210% 99.961% ( 1900, 2900 ] 957 0.163% 100.125% ( 2900, 4400 ] 889 0.152% 100.276% ( 4400, 6600 ] 185 0.032% 100.308% ( 6600, 9900 ] 28 0.005% 100.313% ( 9900, 14000 ] 4 0.001% 100.313% ( 14000, 22000 ] 4 0.001% 100.314% ( 22000, 33000 ] 3 0.001% 100.314% ** Level 5 read latency histogram (micros): Count: 5755 Average: 1192.3981 StdDev: 1134.09 Min: 94 Median: 833.2983 Max: 28731 Percentiles: P50: 833.30 P75: 1446.14 P99: 5510.76 P99.9: 8660.85 P99.99: 12820.22 ------------------------------------------------------ ( 76, 110 ] 7 0.122% 0.122% ( 110, 170 ] 101 1.755% 1.877% ( 170, 250 ] 207 3.597% 5.474% # ( 250, 380 ] 530 9.209% 14.683% ## ( 380, 580 ] 911 15.830% 30.513% ### ( 580, 870 ] 1284 22.311% 52.824% #### ( 870, 1300 ] 1125 19.548% 72.372% #### ( 1300, 1900 ] 621 10.791% 83.162% ## ( 1900, 2900 ] 460 7.993% 91.156% ## ( 2900, 4400 ] 405 7.037% 98.193% # ( 4400, 6600 ] 92 1.599% 99.791% ( 6600, 9900 ] 10 0.174% 99.965% ( 9900, 14000 ] 2 0.035% 100.000% ( 22000, 33000 ] 1 0.017% 100.017% ** DB Stats ** Uptime(secs): 5.9 total, 5.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 166.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.075 H:M:S, 35.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 168.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.075 H:M:S, 35.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/12/06-00:40:33 ... thread 0: (1000000,2000000) ops and (248338.0,202899.5) ops/second in (4.026770,9.857098) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 2.60 GB 162.6 1.5 0.0 1.5 3.3 1.8 0.0 1.8 81.3 182.4 18.57 11.28 31 0.599 1532K 8599 0.0 0.0 L1 5/5 367.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 18/18 2.26 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/1 1.01 GB 1.0 1.6 1.6 0.0 1.6 1.6 0.0 1.0 132.0 131.5 12.46 7.77 5 2.492 0 0 0.0 0.0 L4 133/0 9.69 GB 1.0 3.5 0.6 2.8 2.8 0.0 0.8 4.5 148.4 121.5 23.85 13.83 12 1.988 651K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 308/34 25.45 GB 0.0 6.5 2.2 4.3 7.7 3.4 1.5 4.2 121.9 144.4 54.89 32.88 48 1.143 2184K 8599 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.2 4.3 7.7 3.4 1.5 4.2 121.9 144.4 54.89 32.88 48 1.143 2184K 8599 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.2 4.3 5.9 1.6 0.0 0.0 146.1 131.8 45.82 27.66 22 2.083 2184K 8599 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 208.1 9.07 5.21 26 0.349 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.9 total, 9.9 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.74 GB write, 796.76 MB/s write, 6.54 GB read, 672.99 MB/s read, 54.9 seconds Interval compaction: 7.74 GB write, 803.51 MB/s write, 6.54 GB read, 678.69 MB/s read, 54.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 551989 Average: 29.2907 StdDev: 198.55 Min: 1 Median: 1.7954 Max: 27503 Percentiles: P50: 1.80 P75: 2.67 P99: 725.87 P99.9: 2258.79 P99.99: 3136.55 ------------------------------------------------------ [ 0, 1 ] 33414 6.053% 6.053% # ( 1, 2 ] 304973 55.250% 61.303% ########### ( 2, 3 ] 112817 20.438% 81.741% #### ( 3, 4 ] 32784 5.939% 87.681% # ( 4, 6 ] 32022 5.801% 93.482% # ( 6, 10 ] 8919 1.616% 95.098% ( 10, 15 ] 1527 0.277% 95.374% ( 15, 22 ] 179 0.032% 95.407% ( 22, 34 ] 11 0.002% 95.409% ( 34, 51 ] 7 0.001% 95.410% ( 51, 76 ] 6 0.001% 95.411% ( 76, 110 ] 302 0.055% 95.466% ( 110, 170 ] 3836 0.695% 96.161% ( 170, 250 ] 5577 1.010% 97.171% ( 250, 380 ] 4412 0.799% 97.970% ( 380, 580 ] 3998 0.724% 98.695% ( 580, 870 ] 3354 0.608% 99.302% ( 870, 1300 ] 2109 0.382% 99.684% ( 1300, 1900 ] 957 0.173% 99.858% ( 1900, 2900 ] 655 0.119% 99.976% ( 2900, 4400 ] 487 0.088% 100.065% ( 4400, 6600 ] 66 0.012% 100.077% ( 6600, 9900 ] 12 0.002% 100.079% ( 9900, 14000 ] 4 0.001% 100.080% ( 14000, 22000 ] 3 0.001% 100.080% ( 22000, 33000 ] 1 0.000% 100.080% ** Level 1 read latency histogram (micros): Count: 964 Average: 667.6826 StdDev: 1354.35 Min: 92 Median: 343.6000 Max: 28436 Percentiles: P50: 343.60 P75: 663.65 P99: 5438.40 P99.9: 22396.00 P99.99: 28436.00 ------------------------------------------------------ ( 76, 110 ] 6 0.622% 0.622% ( 110, 170 ] 141 14.627% 15.249% ### ( 170, 250 ] 209 21.680% 36.929% #### ( 250, 380 ] 175 18.154% 55.083% #### ( 380, 580 ] 162 16.805% 71.888% ### ( 580, 870 ] 104 10.788% 82.676% ## ( 870, 1300 ] 69 7.158% 89.834% # ( 1300, 1900 ] 38 3.942% 93.776% # ( 1900, 2900 ] 26 2.697% 96.473% # ( 2900, 4400 ] 22 2.282% 98.755% ( 4400, 6600 ] 5 0.519% 99.274% ( 6600, 9900 ] 4 0.415% 99.689% ( 9900, 14000 ] 2 0.207% 99.896% ( 22000, 33000 ] 1 0.104% 100.000% ** Level 2 read latency histogram (micros): Count: 668283 Average: 13.8622 StdDev: 144.01 Min: 1 Median: 1.9821 Max: 25758 Percentiles: P50: 1.98 P75: 2.90 P99: 214.24 P99.9: 1191.86 P99.99: 1650.18 ------------------------------------------------------ [ 0, 1 ] 13843 2.071% 2.071% ( 1, 2 ] 326132 48.801% 50.873% ########## ( 2, 3 ] 178232 26.670% 77.543% ##### ( 3, 4 ] 59165 8.853% 86.396% ## ( 4, 6 ] 60683 9.080% 95.477% ## ( 6, 10 ] 17721 2.652% 98.128% # ( 10, 15 ] 3187 0.477% 98.605% ( 15, 22 ] 470 0.070% 98.676% ( 22, 34 ] 46 0.007% 98.683% ( 34, 51 ] 19 0.003% 98.685% ( 51, 76 ] 29 0.004% 98.690% ( 76, 110 ] 77 0.012% 98.701% ( 110, 170 ] 1086 0.163% 98.864% ( 170, 250 ] 1646 0.246% 99.110% ( 250, 380 ] 1476 0.221% 99.331% ( 380, 580 ] 1587 0.237% 99.568% ( 580, 870 ] 1447 0.217% 99.785% ( 870, 1300 ] 1027 0.154% 99.939% ( 1300, 1900 ] 588 0.088% 100.027% ( 1900, 2900 ] 417 0.062% 100.089% ( 2900, 4400 ] 317 0.047% 100.136% ( 4400, 6600 ] 70 0.010% 100.147% ( 6600, 9900 ] 9 0.001% 100.148% ( 9900, 14000 ] 5 0.001% 100.149% ( 22000, 33000 ] 1 0.000% 100.149% ** Level 3 read latency histogram (micros): Count: 173030 Average: 27.8518 StdDev: 195.65 Min: 1 Median: 2.1660 Max: 8552 Percentiles: P50: 2.17 P75: 3.25 P99: 739.31 P99.9: 2532.15 P99.99: 3561.95 ------------------------------------------------------ [ 0, 1 ] 3352 1.937% 1.937% ( 1, 2 ] 75400 43.576% 45.513% ######### ( 2, 3 ] 46783 27.038% 72.551% ##### ( 3, 4 ] 17260 9.975% 82.526% ## ( 4, 6 ] 18516 10.701% 93.227% ## ( 6, 10 ] 4574 2.643% 95.871% # ( 10, 15 ] 784 0.453% 96.324% ( 15, 22 ] 109 0.063% 96.387% ( 22, 34 ] 12 0.007% 96.394% ( 34, 51 ] 11 0.006% 96.400% ( 51, 76 ] 11 0.006% 96.406% ( 76, 110 ] 55 0.032% 96.438% ( 110, 170 ] 756 0.437% 96.875% ( 170, 250 ] 1132 0.654% 97.529% ( 250, 380 ] 994 0.574% 98.104% ( 380, 580 ] 1043 0.603% 98.707% ( 580, 870 ] 926 0.535% 99.242% ( 870, 1300 ] 683 0.395% 99.636% ( 1300, 1900 ] 316 0.183% 99.819% ( 1900, 2900 ] 223 0.129% 99.948% ( 2900, 4400 ] 167 0.097% 100.045% ( 4400, 6600 ] 27 0.016% 100.060% ( 6600, 9900 ] 7 0.004% 100.064% ** Level 4 read latency histogram (micros): Count: 752018 Average: 28.0508 StdDev: 222.38 Min: 1 Median: 2.1736 Max: 28708 Percentiles: P50: 2.17 P75: 3.27 P99: 586.16 P99.9: 1573.11 P99.99: 1861.93 ------------------------------------------------------ [ 0, 1 ] 11385 1.514% 1.514% ( 1, 2 ] 329660 43.837% 45.351% ######### ( 2, 3 ] 201463 26.790% 72.140% ##### ( 3, 4 ] 79452 10.565% 82.705% ## ( 4, 6 ] 81693 10.863% 93.569% ## ( 6, 10 ] 20548 2.732% 96.301% # ( 10, 15 ] 4029 0.536% 96.837% ( 15, 22 ] 570 0.076% 96.913% ( 22, 34 ] 45 0.006% 96.919% ( 34, 51 ] 79 0.011% 96.929% ( 51, 76 ] 66 0.009% 96.938% ( 76, 110 ] 230 0.031% 96.968% ( 110, 170 ] 3088 0.411% 97.379% ( 170, 250 ] 4498 0.598% 97.977% ( 250, 380 ] 3647 0.485% 98.462% ( 380, 580 ] 3968 0.528% 98.990% ( 580, 870 ] 3617 0.481% 99.471% ( 870, 1300 ] 2588 0.344% 99.815% ( 1300, 1900 ] 1406 0.187% 100.002% ( 1900, 2900 ] 1054 0.140% 100.142% ( 2900, 4400 ] 925 0.123% 100.265% ( 4400, 6600 ] 186 0.025% 100.290% ( 6600, 9900 ] 28 0.004% 100.293% ( 9900, 14000 ] 5 0.001% 100.294% ( 14000, 22000 ] 4 0.001% 100.295% ( 22000, 33000 ] 3 0.000% 100.295% ** Level 5 read latency histogram (micros): Count: 17965 Average: 624.1107 StdDev: 806.17 Min: 86 Median: 355.0017 Max: 28731 Percentiles: P50: 355.00 P75: 727.88 P99: 4150.06 P99.9: 6506.20 P99.99: 11544.78 ------------------------------------------------------ ( 76, 110 ] 215 1.197% 1.197% ( 110, 170 ] 2611 14.534% 15.731% ### ( 170, 250 ] 3798 21.141% 36.872% #### ( 250, 380 ] 2920 16.254% 53.126% ### ( 380, 580 ] 2735 15.224% 68.350% ### ( 580, 870 ] 2343 13.042% 81.392% ### ( 870, 1300 ] 1525 8.489% 89.880% ## ( 1300, 1900 ] 750 4.175% 94.055% # ( 1900, 2900 ] 525 2.922% 96.977% # ( 2900, 4400 ] 436 2.427% 99.404% ( 4400, 6600 ] 93 0.518% 99.922% ( 6600, 9900 ] 11 0.061% 99.983% ( 9900, 14000 ] 3 0.017% 100.000% ( 22000, 33000 ] 1 0.006% 100.006% ** DB Stats ** Uptime(secs): 9.9 total, 4.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 197.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.595 H:M:S, 26.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 244.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.520 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/06-00:40:38 ... thread 0: (1000000,3000000) ops and (201670.5,202488.2) ops/second in (4.958583,14.815681) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.57 GB 131.3 2.7 0.0 2.7 5.5 2.8 0.0 2.0 102.6 209.2 26.98 18.98 52 0.519 2810K 14K 0.0 0.0 L1 5/5 367.92 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 20/3 1.08 GB 1.0 3.9 3.8 0.1 3.9 3.8 0.0 1.0 151.3 150.8 26.38 18.53 6 4.396 1177K 0 0.0 0.0 L4 133/8 10.44 GB 1.0 3.6 0.7 2.9 2.9 0.0 3.0 4.3 149.8 122.9 24.43 14.34 13 1.879 708K 0 0.0 0.0 L5 135/0 10.95 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 311/29 26.40 GB 0.0 10.2 4.5 5.7 12.3 6.7 5.0 4.4 133.9 162.3 77.79 51.85 71 1.096 4695K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 4.5 5.7 12.3 6.7 5.0 4.4 133.9 162.3 77.79 51.85 71 1.096 4695K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 4.5 5.7 9.5 3.9 0.0 0.0 159.4 149.0 65.33 43.82 29 2.253 4695K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 232.2 12.46 8.04 42 0.297 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.9 total, 14.8 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.33 GB write, 847.16 MB/s write, 10.17 GB read, 698.86 MB/s read, 77.8 seconds Interval compaction: 12.33 GB write, 851.93 MB/s write, 10.17 GB read, 702.80 MB/s read, 77.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 15, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 874642 Average: 29.1856 StdDev: 169.52 Min: 1 Median: 1.7434 Max: 27503 Percentiles: P50: 1.74 P75: 2.59 P99: 602.75 P99.9: 1759.84 P99.99: 2699.04 ------------------------------------------------------ [ 0, 1 ] 71712 8.199% 8.199% ## ( 1, 2 ] 491813 56.230% 64.429% ########### ( 2, 3 ] 155833 17.817% 82.246% #### ( 3, 4 ] 44233 5.057% 87.303% # ( 4, 6 ] 41073 4.696% 91.999% # ( 6, 10 ] 10450 1.195% 93.194% ( 10, 15 ] 1785 0.204% 93.398% ( 15, 22 ] 215 0.025% 93.423% ( 22, 34 ] 13 0.001% 93.424% ( 34, 51 ] 9 0.001% 93.425% ( 51, 76 ] 9 0.001% 93.426% ( 76, 110 ] 1049 0.120% 93.546% ( 110, 170 ] 13546 1.549% 95.095% ( 170, 250 ] 16474 1.884% 96.978% ( 250, 380 ] 9691 1.108% 98.086% ( 380, 580 ] 7601 0.869% 98.955% ( 580, 870 ] 4966 0.568% 99.523% ( 870, 1300 ] 2519 0.288% 99.811% ( 1300, 1900 ] 1013 0.116% 99.927% ( 1900, 2900 ] 689 0.079% 100.006% ( 2900, 4400 ] 499 0.057% 100.063% ( 4400, 6600 ] 66 0.008% 100.070% ( 6600, 9900 ] 12 0.001% 100.072% ( 9900, 14000 ] 4 0.000% 100.072% ( 14000, 22000 ] 3 0.000% 100.073% ( 22000, 33000 ] 1 0.000% 100.073% ** Level 1 read latency histogram (micros): Count: 1964 Average: 460.0850 StdDev: 979.12 Min: 88 Median: 242.0000 Max: 28436 Percentiles: P50: 242.00 P75: 455.40 P99: 3879.09 P99.9: 12023.80 P99.99: 28436.00 ------------------------------------------------------ ( 76, 110 ] 33 1.680% 1.680% ( 110, 170 ] 463 23.574% 25.255% ##### ( 170, 250 ] 540 27.495% 52.749% ##### ( 250, 380 ] 342 17.413% 70.163% ### ( 380, 580 ] 252 12.831% 82.994% ### ( 580, 870 ] 150 7.637% 90.631% ## ( 870, 1300 ] 83 4.226% 94.857% # ( 1300, 1900 ] 41 2.088% 96.945% ( 1900, 2900 ] 26 1.324% 98.269% ( 2900, 4400 ] 22 1.120% 99.389% ( 4400, 6600 ] 5 0.255% 99.644% ( 6600, 9900 ] 4 0.204% 99.847% ( 9900, 14000 ] 2 0.102% 99.949% ( 22000, 33000 ] 1 0.051% 100.000% ** Level 2 read latency histogram (micros): Count: 877279 Average: 12.7775 StdDev: 127.96 Min: 1 Median: 1.9133 Max: 25758 Percentiles: P50: 1.91 P75: 2.81 P99: 225.19 P99.9: 1104.40 P99.99: 1608.41 ------------------------------------------------------ [ 0, 1 ] 27127 3.092% 3.092% # ( 1, 2 ] 450590 51.362% 54.454% ########## ( 2, 3 ] 223700 25.499% 79.954% ##### ( 3, 4 ] 68104 7.763% 87.717% ## ( 4, 6 ] 67310 7.673% 95.389% ## ( 6, 10 ] 21609 2.463% 97.853% ( 10, 15 ] 3624 0.413% 98.266% ( 15, 22 ] 572 0.065% 98.331% ( 22, 34 ] 50 0.006% 98.337% ( 34, 51 ] 19 0.002% 98.339% ( 51, 76 ] 30 0.003% 98.342% ( 76, 110 ] 198 0.023% 98.365% ( 110, 170 ] 2971 0.339% 98.703% ( 170, 250 ] 3772 0.430% 99.133% ( 250, 380 ] 2375 0.271% 99.404% ( 380, 580 ] 2106 0.240% 99.644% ( 580, 870 ] 1662 0.189% 99.834% ( 870, 1300 ] 1069 0.122% 99.955% ( 1300, 1900 ] 590 0.067% 100.023% ( 1900, 2900 ] 422 0.048% 100.071% ( 2900, 4400 ] 318 0.036% 100.107% ( 4400, 6600 ] 70 0.008% 100.115% ( 6600, 9900 ] 9 0.001% 100.116% ( 9900, 14000 ] 5 0.001% 100.117% ( 22000, 33000 ] 1 0.000% 100.117% ** Level 3 read latency histogram (micros): Count: 220500 Average: 30.0479 StdDev: 182.77 Min: 1 Median: 2.1715 Max: 8552 Percentiles: P50: 2.17 P75: 3.34 P99: 688.87 P99.9: 2262.29 P99.99: 3320.61 ------------------------------------------------------ [ 0, 1 ] 4363 1.979% 1.979% ( 1, 2 ] 95976 43.527% 45.505% ######### ( 2, 3 ] 57803 26.215% 71.720% ##### ( 3, 4 ] 21349 9.682% 81.402% ## ( 4, 6 ] 22694 10.292% 91.694% ## ( 6, 10 ] 5195 2.356% 94.050% ( 10, 15 ] 824 0.374% 94.424% ( 15, 22 ] 116 0.053% 94.476% ( 22, 34 ] 12 0.005% 94.482% ( 34, 51 ] 11 0.005% 94.487% ( 51, 76 ] 12 0.005% 94.492% ( 76, 110 ] 182 0.083% 94.575% ( 110, 170 ] 2444 1.108% 95.683% ( 170, 250 ] 3143 1.425% 97.108% ( 250, 380 ] 2004 0.909% 98.017% ( 380, 580 ] 1701 0.771% 98.789% ( 580, 870 ] 1244 0.564% 99.353% ( 870, 1300 ] 784 0.356% 99.708% ( 1300, 1900 ] 338 0.153% 99.862% ( 1900, 2900 ] 236 0.107% 99.969% ( 2900, 4400 ] 171 0.078% 100.046% ( 4400, 6600 ] 27 0.012% 100.059% ( 6600, 9900 ] 7 0.003% 100.062% ** Level 4 read latency histogram (micros): Count: 901772 Average: 30.2694 StdDev: 209.05 Min: 1 Median: 2.1809 Max: 28708 Percentiles: P50: 2.18 P75: 3.36 P99: 571.15 P99.9: 1407.95 P99.99: 1740.80 ------------------------------------------------------ [ 0, 1 ] 13757 1.526% 1.526% ( 1, 2 ] 394649 43.764% 45.289% ######### ( 2, 3 ] 234842 26.042% 71.332% ##### ( 3, 4 ] 92037 10.206% 81.538% ## ( 4, 6 ] 93353 10.352% 91.890% ## ( 6, 10 ] 23763 2.635% 94.525% # ( 10, 15 ] 4306 0.478% 95.003% ( 15, 22 ] 604 0.067% 95.070% ( 22, 34 ] 48 0.005% 95.075% ( 34, 51 ] 79 0.009% 95.084% ( 51, 76 ] 66 0.007% 95.091% ( 76, 110 ] 728 0.081% 95.172% ( 110, 170 ] 9445 1.047% 96.219% ( 170, 250 ] 11865 1.316% 97.535% ( 250, 380 ] 7195 0.798% 98.333% ( 380, 580 ] 6296 0.698% 99.031% ( 580, 870 ] 4684 0.519% 99.550% ( 870, 1300 ] 2890 0.320% 99.871% ( 1300, 1900 ] 1463 0.162% 100.033% ( 1900, 2900 ] 1075 0.119% 100.152% ( 2900, 4400 ] 933 0.103% 100.256% ( 4400, 6600 ] 186 0.021% 100.276% ( 6600, 9900 ] 28 0.003% 100.279% ( 9900, 14000 ] 5 0.001% 100.280% ( 14000, 22000 ] 4 0.000% 100.280% ( 22000, 33000 ] 3 0.000% 100.281% ** Level 5 read latency histogram (micros): Count: 35627 Average: 446.3761 StdDev: 614.18 Min: 82 Median: 245.3155 Max: 28731 Percentiles: P50: 245.32 P75: 489.32 P99: 3544.38 P99.9: 6088.39 P99.99: 9731.19 ------------------------------------------------------ ( 76, 110 ] 623 1.749% 1.749% ( 110, 170 ] 7970 22.371% 24.119% #### ( 170, 250 ] 9794 27.490% 51.610% ##### ( 250, 380 ] 5774 16.207% 67.817% ### ( 380, 580 ] 4682 13.142% 80.958% ### ( 580, 870 ] 3184 8.937% 89.895% ## ( 870, 1300 ] 1734 4.867% 94.762% # ( 1300, 1900 ] 780 2.189% 96.952% ( 1900, 2900 ] 542 1.521% 98.473% ( 2900, 4400 ] 437 1.227% 99.700% ( 4400, 6600 ] 93 0.261% 99.961% ( 6600, 9900 ] 11 0.031% 99.992% ( 9900, 14000 ] 3 0.008% 100.000% ( 22000, 33000 ] 1 0.003% 100.003% ** DB Stats ** Uptime(secs): 14.9 total, 5.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 198.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.021 H:M:S, 27.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 198.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.426 H:M:S, 28.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 403.454 micros/op 9876 ops/sec 20.149 seconds 198996 operations; 9.6 MB/s (49999 of 49999 found) Microseconds per read: Count: 198996 Average: 403.4636 StdDev: 818.32 Min: 1 Median: 239.9304 Max: 63815 Percentiles: P50: 239.93 P75: 410.48 P99: 2867.10 P99.9: 13281.61 P99.99: 29058.46 ------------------------------------------------------ [ 0, 1 ] 1 0.001% 0.001% ( 1, 2 ] 2 0.001% 0.002% ( 2, 3 ] 44 0.022% 0.024% ( 3, 4 ] 81 0.041% 0.064% ( 4, 6 ] 158 0.079% 0.144% ( 6, 10 ] 422 0.212% 0.356% ( 10, 15 ] 1009 0.507% 0.863% ( 15, 22 ] 1883 0.946% 1.809% ( 22, 34 ] 2691 1.352% 3.161% ( 34, 51 ] 2123 1.067% 4.228% ( 51, 76 ] 221 0.111% 4.339% ( 76, 110 ] 199 0.100% 4.439% ( 110, 170 ] 24120 12.121% 16.560% ## ( 170, 250 ] 76126 38.255% 54.815% ######## ( 250, 380 ] 36324 18.254% 73.069% #### ( 380, 580 ] 25215 12.671% 85.740% ### ( 580, 870 ] 14405 7.239% 92.979% # ( 870, 1300 ] 7225 3.631% 96.609% # ( 1300, 1900 ] 3024 1.520% 98.129% ( 1900, 2900 ] 1792 0.901% 99.030% ( 2900, 4400 ] 1276 0.641% 99.671% ( 4400, 6600 ] 298 0.150% 99.821% ( 6600, 9900 ] 78 0.039% 99.860% ( 9900, 14000 ] 97 0.049% 99.909% ( 14000, 22000 ] 139 0.070% 99.978% ( 22000, 33000 ] 36 0.018% 99.996% ( 33000, 50000 ] 5 0.003% 99.999% ( 50000, 75000 ] 2 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 3463629 rocksdb.bloom.filter.full.positive COUNT : 231866 rocksdb.bloom.filter.full.true.positive COUNT : 198271 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 725 rocksdb.memtable.miss COUNT : 198271 rocksdb.l0.hit COUNT : 29221 rocksdb.l1.hit COUNT : 3225 rocksdb.l2andup.hit COUNT : 165825 rocksdb.compaction.key.drop.new COUNT : 863440 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3336976 rocksdb.number.keys.read COUNT : 198996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3443759232 rocksdb.bytes.read COUNT : 198996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 456 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 8035308 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 12861241737 rocksdb.compact.write.bytes COUNT : 11974117792 rocksdb.flush.write.bytes COUNT : 3429556020 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 38 rocksdb.number.superversion_acquires COUNT : 608 rocksdb.number.superversion_releases COUNT : 580 rocksdb.number.superversion_cleanups COUNT : 150 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3407315968 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6290432 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 13430039649 rocksdb.non.last.level.read.count COUNT : 3215250 rocksdb.block.checksum.compute.count COUNT : 3351701 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 239.294142 P95 : 1108.562951 P99 : 2867.024609 P100 : 63814.000000 COUNT : 198996 SUM : 80105787 rocksdb.db.write.micros P50 : 1.515672 P95 : 3.967678 P99 : 6.278128 P100 : 947668.000000 COUNT : 3336976 SUM : 16040881 rocksdb.compaction.times.micros P50 : 1768750.000000 P95 : 3390000.000000 P99 : 12614000.000000 P100 : 13919171.000000 COUNT : 33 SUM : 69681195 rocksdb.compaction.times.cpu_micros P50 : 1166000.000000 P95 : 1867500.000000 P99 : 10756019.000000 P100 : 10756019.000000 COUNT : 33 SUM : 47827371 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1042.000000 P95 : 43200.000000 P99 : 142125.000000 P100 : 142125.000000 COUNT : 48 SUM : 444283 rocksdb.compaction.outfile.sync.micros P50 : 5912.500000 P95 : 97250.000000 P99 : 225200.000000 P100 : 773461.000000 COUNT : 131 SUM : 3550588 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 225.714286 P95 : 1937.500000 P99 : 4466.000000 P100 : 4661.000000 COUNT : 97 SUM : 42810 rocksdb.table.open.io.micros P50 : 7615.384615 P95 : 19232.432432 P99 : 26398.000000 P100 : 26398.000000 COUNT : 456 SUM : 3514912 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.999006 P95 : 9.936594 P99 : 269.902413 P100 : 28711.000000 COUNT : 3116467 SUM : 52774189 rocksdb.read.block.get.micros P50 : 201.996502 P95 : 888.324727 P99 : 2560.809879 P100 : 28750.000000 COUNT : 234753 SUM : 72769844 rocksdb.write.raw.block.micros P50 : 0.526374 P95 : 1.003507 P99 : 3.811990 P100 : 31057.000000 COUNT : 3731664 SUM : 10594482 rocksdb.numfiles.in.singlecompaction P50 : 3.443182 P95 : 7.000000 P99 : 18.150000 P100 : 19.000000 COUNT : 55 SUM : 232 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564212 P95 : 1189.370765 P99 : 2552.712022 P100 : 947492.000000 COUNT : 38064 SUM : 8038562 rocksdb.sst.read.micros P50 : 1.962676 P95 : 202.505165 P99 : 659.673373 P100 : 28731.000000 COUNT : 3215271 SUM : 115419750 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 198996 SUM : 198996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3336976 SUM : 3443759232 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226470.588235 P95 : 657000.000000 P99 : 1036800.000000 P100 : 1191483.000000 COUNT : 48 SUM : 13656983 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 142 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0