[2024-12-13 11:10:10.707765] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-13 11:10:10.708066] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid591215 ] Set seed to 1734084610700564 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-13 11:10:10.854846] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-13 11:10:11.070514] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-13 11:10:11.070561] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 591215' to capture a snapshot of events at runtime. [2024-12-13 11:10:11.070574] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid591215 for offline analysis/debug. [2024-12-13 11:10:11.070620] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 13 11:10:17 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/12/13-11:10:24 ... thread 0: (1000000,1000000) ops and (151757.3,151757.3) ops/second in (6.589468,6.589468) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 2.62 GB 63.0 0.3 0.0 0.3 1.2 0.9 0.0 1.4 44.2 167.9 7.12 4.10 13 0.548 319K 360 0.0 0.0 L1 14/14 1.52 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 965.92 MB 1.0 1.4 0.9 0.6 1.4 0.9 0.0 1.6 119.0 117.8 12.35 7.18 5 2.471 185K 0 0.0 0.0 L4 174/0 9.74 GB 1.0 3.3 1.9 1.4 3.3 1.9 0.1 1.7 119.2 117.8 28.48 16.37 20 1.424 1299K 1438 0.0 0.0 L5 1124/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/23 106.24 GB 0.0 5.1 2.8 2.3 5.9 3.6 2.0 6.8 108.0 125.2 47.96 27.66 38 1.262 1805K 1798 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 2.8 2.3 5.9 3.6 2.0 6.8 108.0 125.2 47.96 27.66 38 1.262 1805K 1798 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 2.8 2.3 5.0 2.7 0.0 0.0 121.9 120.6 42.49 24.92 26 1.634 1805K 1798 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 161.2 5.47 2.74 12 0.456 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.8 total, 6.6 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.86 GB write, 884.15 MB/s write, 5.06 GB read, 762.87 MB/s read, 48.0 seconds Interval compaction: 5.86 GB write, 911.17 MB/s write, 5.06 GB read, 786.19 MB/s read, 48.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 14, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 321111 Average: 13.5342 StdDev: 191.97 Min: 1 Median: 1.9220 Max: 30757 Percentiles: P50: 1.92 P75: 2.91 P99: 189.59 P99.9: 2354.45 P99.99: 4043.36 ------------------------------------------------------ [ 0, 1 ] 19088 5.944% 5.944% # ( 1, 2 ] 153429 47.781% 53.725% ########## ( 2, 3 ] 75015 23.361% 77.086% ##### ( 3, 4 ] 26582 8.278% 85.364% ## ( 4, 6 ] 31148 9.700% 95.064% ## ( 6, 10 ] 8204 2.555% 97.619% # ( 10, 15 ] 2572 0.801% 98.420% ( 15, 22 ] 433 0.135% 98.555% ( 22, 34 ] 86 0.027% 98.582% ( 34, 51 ] 14 0.004% 98.586% ( 51, 76 ] 10 0.003% 98.589% ( 76, 110 ] 32 0.010% 98.599% ( 110, 170 ] 842 0.262% 98.861% ( 170, 250 ] 1821 0.567% 99.429% ( 250, 380 ] 549 0.171% 99.600% ( 380, 580 ] 295 0.092% 99.691% ( 580, 870 ] 195 0.061% 99.752% ( 870, 1300 ] 210 0.065% 99.818% ( 1300, 1900 ] 175 0.054% 99.872% ( 1900, 2900 ] 200 0.062% 99.934% ( 2900, 4400 ] 236 0.073% 100.008% ( 4400, 6600 ] 77 0.024% 100.032% ( 6600, 9900 ] 17 0.005% 100.037% ( 9900, 14000 ] 1 0.000% 100.037% ( 14000, 22000 ] 2 0.001% 100.038% ( 22000, 33000 ] 3 0.001% 100.039% ** Level 1 read latency histogram (micros): Count: 467 Average: 1070.6124 StdDev: 3451.42 Min: 98 Median: 233.1461 Max: 31069 Percentiles: P50: 233.15 P75: 569.06 P99: 24438.33 P99.9: 31069.00 P99.99: 31069.00 ------------------------------------------------------ ( 76, 110 ] 4 0.857% 0.857% ( 110, 170 ] 89 19.058% 19.914% #### ( 170, 250 ] 178 38.116% 58.030% ######## ( 250, 380 ] 49 10.493% 68.522% ## ( 380, 580 ] 32 6.852% 75.375% # ( 580, 870 ] 20 4.283% 79.657% # ( 870, 1300 ] 31 6.638% 86.296% # ( 1300, 1900 ] 14 2.998% 89.293% # ( 1900, 2900 ] 14 2.998% 92.291% # ( 2900, 4400 ] 17 3.640% 95.931% # ( 4400, 6600 ] 6 1.285% 97.216% ( 6600, 9900 ] 7 1.499% 98.715% ( 22000, 33000 ] 6 1.285% 100.000% ** Level 2 read latency histogram (micros): Count: 98105 Average: 11.4022 StdDev: 171.98 Min: 1 Median: 2.0569 Max: 9767 Percentiles: P50: 2.06 P75: 3.19 P99: 12.05 P99.9: 3190.16 P99.99: 5771.83 ------------------------------------------------------ [ 0, 1 ] 1942 1.980% 1.980% ( 1, 2 ] 45749 46.633% 48.612% ######### ( 2, 3 ] 23942 24.404% 73.017% ##### ( 3, 4 ] 10076 10.271% 83.287% ## ( 4, 6 ] 12315 12.553% 95.840% ### ( 6, 10 ] 2722 2.775% 98.615% # ( 10, 15 ] 920 0.938% 99.553% ( 15, 22 ] 96 0.098% 99.650% ( 22, 34 ] 10 0.010% 99.661% ( 34, 51 ] 7 0.007% 99.668% ( 51, 76 ] 6 0.006% 99.674% ( 76, 110 ] 5 0.005% 99.679% ( 110, 170 ] 1 0.001% 99.680% ( 170, 250 ] 7 0.007% 99.687% ( 250, 380 ] 13 0.013% 99.700% ( 380, 580 ] 13 0.013% 99.714% ( 580, 870 ] 15 0.015% 99.729% ( 870, 1300 ] 46 0.047% 99.776% ( 1300, 1900 ] 41 0.042% 99.818% ( 1900, 2900 ] 66 0.067% 99.885% ( 2900, 4400 ] 77 0.078% 99.963% ( 4400, 6600 ] 42 0.043% 100.006% ( 6600, 9900 ] 3 0.003% 100.009% ** Level 3 read latency histogram (micros): Count: 374187 Average: 7.0023 StdDev: 113.71 Min: 1 Median: 2.0062 Max: 11773 Percentiles: P50: 2.01 P75: 3.02 P99: 9.45 P99.9: 112.77 P99.99: 646.79 ------------------------------------------------------ [ 0, 1 ] 8353 2.232% 2.232% ( 1, 2 ] 178167 47.614% 49.847% ########## ( 2, 3 ] 93240 24.918% 74.765% ##### ( 3, 4 ] 38208 10.211% 84.976% ## ( 4, 6 ] 45675 12.206% 97.182% ## ( 6, 10 ] 7885 2.107% 99.289% ( 10, 15 ] 1994 0.533% 99.822% ( 15, 22 ] 204 0.055% 99.877% ( 22, 34 ] 32 0.009% 99.885% ( 34, 51 ] 23 0.006% 99.891% ( 51, 76 ] 22 0.006% 99.897% ( 76, 110 ] 7 0.002% 99.899% ( 110, 170 ] 61 0.016% 99.916% ( 170, 250 ] 132 0.035% 99.951% ( 250, 380 ] 51 0.014% 99.964% ( 380, 580 ] 79 0.021% 99.986% ( 580, 870 ] 72 0.019% 100.005% ( 870, 1300 ] 97 0.026% 100.031% ( 1300, 1900 ] 100 0.027% 100.057% ( 1900, 2900 ] 117 0.031% 100.089% ( 2900, 4400 ] 138 0.037% 100.126% ( 4400, 6600 ] 44 0.012% 100.137% ( 6600, 9900 ] 11 0.003% 100.140% ( 9900, 14000 ] 1 0.000% 100.141% ** Level 4 read latency histogram (micros): Count: 298889 Average: 29.4459 StdDev: 358.91 Min: 0 Median: 2.1383 Max: 45078 Percentiles: P50: 2.14 P75: 3.37 P99: 458.11 P99.9: 3685.63 P99.99: 4389.82 ------------------------------------------------------ [ 0, 1 ] 6633 2.219% 2.219% ( 1, 2 ] 132700 44.398% 46.617% ######### ( 2, 3 ] 73102 24.458% 71.075% ##### ( 3, 4 ] 32062 10.727% 81.802% ## ( 4, 6 ] 38059 12.733% 94.535% ### ( 6, 10 ] 7869 2.633% 97.168% # ( 10, 15 ] 2942 0.984% 98.152% ( 15, 22 ] 329 0.110% 98.263% ( 22, 34 ] 48 0.016% 98.279% ( 34, 51 ] 21 0.007% 98.286% ( 51, 76 ] 17 0.006% 98.291% ( 76, 110 ] 43 0.014% 98.306% ( 110, 170 ] 482 0.161% 98.467% ( 170, 250 ] 1043 0.349% 98.816% ( 250, 380 ] 381 0.127% 98.943% ( 380, 580 ] 433 0.145% 99.088% ( 580, 870 ] 436 0.146% 99.234% ( 870, 1300 ] 528 0.177% 99.411% ( 1300, 1900 ] 548 0.183% 99.594% ( 1900, 2900 ] 614 0.205% 99.800% ( 2900, 4400 ] 573 0.192% 99.991% ( 4400, 6600 ] 229 0.077% 100.068% ( 6600, 9900 ] 41 0.014% 100.082% ( 9900, 14000 ] 2 0.001% 100.082% ( 14000, 22000 ] 5 0.002% 100.084% ( 22000, 33000 ] 9 0.003% 100.087% ( 33000, 50000 ] 5 0.002% 100.089% ** Level 5 read latency histogram (micros): Count: 23394 Average: 752.3189 StdDev: 1261.80 Min: 93 Median: 243.2706 Max: 68362 Percentiles: P50: 243.27 P75: 709.55 P99: 5933.75 P99.9: 9106.74 P99.99: 9887.42 ------------------------------------------------------ ( 76, 110 ] 191 0.816% 0.816% ( 110, 170 ] 4015 17.163% 17.979% ### ( 170, 250 ] 8179 34.962% 52.941% ####### ( 250, 380 ] 2678 11.447% 64.388% ## ( 380, 580 ] 1866 7.976% 72.365% ## ( 580, 870 ] 1380 5.899% 78.264% # ( 870, 1300 ] 1290 5.514% 83.778% # ( 1300, 1900 ] 1070 4.574% 88.352% # ( 1900, 2900 ] 1110 4.745% 93.097% # ( 2900, 4400 ] 1052 4.497% 97.593% # ( 4400, 6600 ] 472 2.018% 99.611% ( 6600, 9900 ] 89 0.380% 99.991% ( 22000, 33000 ] 1 0.004% 99.996% ( 33000, 50000 ] 1 0.004% 100.000% ( 50000, 75000 ] 1 0.004% 100.004% ** DB Stats ** Uptime(secs): 6.8 total, 6.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 144.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.358 H:M:S, 34.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 149.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.358 H:M:S, 35.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-11:10:27 ... thread 0: (1000000,2000000) ops and (273657.2,195242.4) ops/second in (3.654207,10.243675) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 3.60 GB 163.7 1.3 0.0 1.3 3.1 1.8 0.0 1.7 93.0 225.8 14.22 10.78 33 0.431 1343K 1314 0.0 0.0 L1 14/14 1.52 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 965.92 MB 1.0 1.4 0.9 0.6 1.4 0.9 0.0 1.6 119.0 117.8 12.35 7.18 5 2.471 185K 0 0.0 0.0 L4 174/0 9.74 GB 1.0 3.3 1.9 1.4 3.3 1.9 0.1 1.7 119.2 117.8 28.48 16.37 20 1.424 1299K 1438 0.0 0.0 L5 1124/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/23 107.22 GB 0.0 6.0 2.8 3.3 7.8 4.6 2.0 4.2 112.4 145.7 55.06 34.34 58 0.949 2828K 2752 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 2.8 3.3 7.8 4.6 2.0 4.2 112.4 145.7 55.06 34.34 58 0.949 2828K 2752 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 2.8 3.3 6.0 2.7 0.0 0.0 133.3 132.1 46.42 28.78 30 1.547 2828K 2752 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 218.8 8.64 5.56 28 0.309 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.4 total, 10.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.83 GB write, 767.76 MB/s write, 6.04 GB read, 592.51 MB/s read, 55.1 seconds Interval compaction: 7.83 GB write, 782.85 MB/s write, 6.04 GB read, 604.16 MB/s read, 55.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 14, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 642539 Average: 12.5870 StdDev: 139.54 Min: 0 Median: 1.7503 Max: 30757 Percentiles: P50: 1.75 P75: 2.69 P99: 228.54 P99.9: 716.53 P99.99: 2166.07 ------------------------------------------------------ [ 0, 1 ] 74920 11.660% 11.660% ## ( 1, 2 ] 328355 51.103% 62.763% ########## ( 2, 3 ] 113886 17.724% 80.487% #### ( 3, 4 ] 44759 6.966% 87.453% # ( 4, 6 ] 45373 7.062% 94.515% # ( 6, 10 ] 11730 1.826% 96.340% ( 10, 15 ] 3641 0.567% 96.907% ( 15, 22 ] 858 0.134% 97.040% ( 22, 34 ] 229 0.036% 97.076% ( 34, 51 ] 37 0.006% 97.082% ( 51, 76 ] 17 0.003% 97.084% ( 76, 110 ] 182 0.028% 97.113% ( 110, 170 ] 4797 0.747% 97.859% ( 170, 250 ] 10016 1.559% 99.418% ( 250, 380 ] 2140 0.333% 99.751% ( 380, 580 ] 835 0.130% 99.881% ( 580, 870 ] 258 0.040% 99.921% ( 870, 1300 ] 213 0.033% 99.954% ( 1300, 1900 ] 175 0.027% 99.982% ( 1900, 2900 ] 202 0.031% 100.013% ( 2900, 4400 ] 236 0.037% 100.050% ( 4400, 6600 ] 77 0.012% 100.062% ( 6600, 9900 ] 17 0.003% 100.064% ( 9900, 14000 ] 1 0.000% 100.065% ( 14000, 22000 ] 2 0.000% 100.065% ( 22000, 33000 ] 3 0.000% 100.065% ** Level 1 read latency histogram (micros): Count: 1529 Average: 470.0085 StdDev: 1949.43 Min: 97 Median: 207.9026 Max: 31069 Percentiles: P50: 207.90 P75: 246.08 P99: 5760.33 P99.9: 30196.83 P99.99: 31069.00 ------------------------------------------------------ ( 76, 110 ] 17 1.112% 1.112% ( 110, 170 ] 368 24.068% 25.180% ##### ( 170, 250 ] 801 52.387% 77.567% ########## ( 250, 380 ] 158 10.334% 87.901% ## ( 380, 580 ] 67 4.382% 92.283% # ( 580, 870 ] 23 1.504% 93.787% ( 870, 1300 ] 31 2.027% 95.814% ( 1300, 1900 ] 14 0.916% 96.730% ( 1900, 2900 ] 14 0.916% 97.646% ( 2900, 4400 ] 17 1.112% 98.757% ( 4400, 6600 ] 6 0.392% 99.150% ( 6600, 9900 ] 7 0.458% 99.608% ( 22000, 33000 ] 6 0.392% 100.000% ** Level 2 read latency histogram (micros): Count: 98105 Average: 11.4022 StdDev: 171.98 Min: 1 Median: 2.0569 Max: 9767 Percentiles: P50: 2.06 P75: 3.19 P99: 12.05 P99.9: 3190.16 P99.99: 5771.83 ------------------------------------------------------ [ 0, 1 ] 1942 1.980% 1.980% ( 1, 2 ] 45749 46.633% 48.612% ######### ( 2, 3 ] 23942 24.404% 73.017% ##### ( 3, 4 ] 10076 10.271% 83.287% ## ( 4, 6 ] 12315 12.553% 95.840% ### ( 6, 10 ] 2722 2.775% 98.615% # ( 10, 15 ] 920 0.938% 99.553% ( 15, 22 ] 96 0.098% 99.650% ( 22, 34 ] 10 0.010% 99.661% ( 34, 51 ] 7 0.007% 99.668% ( 51, 76 ] 6 0.006% 99.674% ( 76, 110 ] 5 0.005% 99.679% ( 110, 170 ] 1 0.001% 99.680% ( 170, 250 ] 7 0.007% 99.687% ( 250, 380 ] 13 0.013% 99.700% ( 380, 580 ] 13 0.013% 99.714% ( 580, 870 ] 15 0.015% 99.729% ( 870, 1300 ] 46 0.047% 99.776% ( 1300, 1900 ] 41 0.042% 99.818% ( 1900, 2900 ] 66 0.067% 99.885% ( 2900, 4400 ] 77 0.078% 99.963% ( 4400, 6600 ] 42 0.043% 100.006% ( 6600, 9900 ] 3 0.003% 100.009% ** Level 3 read latency histogram (micros): Count: 374871 Average: 7.3339 StdDev: 113.94 Min: 1 Median: 2.0098 Max: 11773 Percentiles: P50: 2.01 P75: 3.04 P99: 9.77 P99.9: 233.42 P99.99: 655.45 ------------------------------------------------------ [ 0, 1 ] 8353 2.228% 2.228% ( 1, 2 ] 178172 47.529% 49.757% ########## ( 2, 3 ] 93252 24.876% 74.633% ##### ( 3, 4 ] 38218 10.195% 84.828% ## ( 4, 6 ] 45694 12.189% 97.017% ## ( 6, 10 ] 7890 2.105% 99.122% ( 10, 15 ] 1994 0.532% 99.654% ( 15, 22 ] 204 0.054% 99.708% ( 22, 34 ] 32 0.009% 99.717% ( 34, 51 ] 23 0.006% 99.723% ( 51, 76 ] 22 0.006% 99.729% ( 76, 110 ] 13 0.003% 99.732% ( 110, 170 ] 270 0.072% 99.804% ( 170, 250 ] 453 0.121% 99.925% ( 250, 380 ] 124 0.033% 99.958% ( 380, 580 ] 100 0.027% 99.985% ( 580, 870 ] 75 0.020% 100.005% ( 870, 1300 ] 97 0.026% 100.031% ( 1300, 1900 ] 100 0.027% 100.057% ( 1900, 2900 ] 117 0.031% 100.089% ( 2900, 4400 ] 138 0.037% 100.125% ( 4400, 6600 ] 44 0.012% 100.137% ( 6600, 9900 ] 11 0.003% 100.140% ( 9900, 14000 ] 1 0.000% 100.140% ** Level 4 read latency histogram (micros): Count: 304966 Average: 32.5814 StdDev: 356.24 Min: 0 Median: 2.1791 Max: 45078 Percentiles: P50: 2.18 P75: 3.50 P99: 483.83 P99.9: 3669.72 P99.99: 4388.23 ------------------------------------------------------ [ 0, 1 ] 6633 2.175% 2.175% ( 1, 2 ] 132724 43.521% 45.696% ######### ( 2, 3 ] 73291 24.033% 69.728% ##### ( 3, 4 ] 32187 10.554% 80.283% ## ( 4, 6 ] 38274 12.550% 92.833% ### ( 6, 10 ] 7897 2.589% 95.422% # ( 10, 15 ] 2954 0.969% 96.391% ( 15, 22 ] 332 0.109% 96.500% ( 22, 34 ] 51 0.017% 96.517% ( 34, 51 ] 21 0.007% 96.524% ( 51, 76 ] 17 0.006% 96.529% ( 76, 110 ] 103 0.034% 96.563% ( 110, 170 ] 2010 0.659% 97.222% ( 170, 250 ] 4121 1.351% 98.573% ( 250, 380 ] 980 0.321% 98.895% ( 380, 580 ] 619 0.203% 99.098% ( 580, 870 ] 463 0.152% 99.249% ( 870, 1300 ] 528 0.173% 99.423% ( 1300, 1900 ] 548 0.180% 99.602% ( 1900, 2900 ] 614 0.201% 99.804% ( 2900, 4400 ] 573 0.188% 99.991% ( 4400, 6600 ] 229 0.075% 100.067% ( 6600, 9900 ] 41 0.013% 100.080% ( 9900, 14000 ] 2 0.001% 100.081% ( 14000, 22000 ] 5 0.002% 100.082% ( 22000, 33000 ] 9 0.003% 100.085% ( 33000, 50000 ] 5 0.002% 100.087% ** Level 5 read latency histogram (micros): Count: 69496 Average: 388.6892 StdDev: 778.86 Min: 92 Median: 208.8974 Max: 68362 Percentiles: P50: 208.90 P75: 249.74 P99: 4210.42 P99.9: 7360.26 P99.99: 9679.40 ------------------------------------------------------ ( 76, 110 ] 721 1.037% 1.037% ( 110, 170 ] 17482 25.155% 26.193% ##### ( 170, 250 ] 34028 48.964% 75.157% ########## ( 250, 380 ] 7283 10.480% 85.637% ## ( 380, 580 ] 3315 4.770% 90.407% # ( 580, 870 ] 1574 2.265% 92.672% ( 870, 1300 ] 1294 1.862% 94.533% ( 1300, 1900 ] 1070 1.540% 96.073% ( 1900, 2900 ] 1115 1.604% 97.678% ( 2900, 4400 ] 1052 1.514% 99.191% ( 4400, 6600 ] 472 0.679% 99.870% ( 6600, 9900 ] 89 0.128% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ( 33000, 50000 ] 1 0.001% 100.001% ( 50000, 75000 ] 1 0.001% 100.003% ** DB Stats ** Uptime(secs): 10.4 total, 3.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 188.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.358 H:M:S, 22.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/13-11:10:52 ... thread 0: (1000000,3000000) ops and (39789.0,84802.6) ops/second in (25.132580,35.376255) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 2.76 GB 0.0 3.8 0.0 3.8 6.5 2.8 0.0 2.4 142.9 247.8 26.89 22.98 53 0.507 3900K 11K 0.0 0.0 L1 18/18 2.24 GB 0.0 3.3 1.8 1.5 3.2 1.7 0.0 1.8 107.3 106.3 31.29 17.71 1 31.289 3410K 32K 0.0 0.0 L3 23/0 979.30 MB 1.0 2.8 1.5 1.3 2.8 1.5 0.4 1.8 142.5 141.0 20.19 14.45 12 1.682 1089K 4266 0.0 0.0 L4 176/0 9.70 GB 1.0 5.0 2.8 2.2 4.9 2.7 0.1 1.7 136.8 134.6 37.32 24.58 32 1.166 2377K 5219 0.0 0.0 L5 1136/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1364/29 108.05 GB 0.0 14.8 6.1 8.7 17.4 8.7 3.5 6.3 131.2 154.4 115.69 79.72 98 1.180 10M 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.8 6.1 8.7 17.4 8.7 3.5 6.3 131.2 154.4 115.69 79.72 98 1.180 10M 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.8 6.1 8.7 14.7 5.9 0.0 0.0 145.9 144.4 104.06 71.53 55 1.892 10M 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 243.9 11.63 8.19 43 0.270 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.6 total, 35.4 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.44 GB write, 501.93 MB/s write, 14.82 GB read, 426.63 MB/s read, 115.7 seconds Interval compaction: 17.44 GB write, 504.78 MB/s write, 14.82 GB read, 429.06 MB/s read, 115.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 33, pending-compaction-bytes-stops: 0, total-delays: 35, total-stops: 14, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1541927 Average: 20.7138 StdDev: 118.28 Min: 0 Median: 1.6359 Max: 30757 Percentiles: P50: 1.64 P75: 2.49 P99: 249.80 P99.9: 555.70 P99.99: 940.60 ------------------------------------------------------ [ 0, 1 ] 258043 16.735% 16.735% ### ( 1, 2 ] 806608 52.312% 69.047% ########## ( 2, 3 ] 186188 12.075% 81.122% ## ( 3, 4 ] 71030 4.607% 85.728% # ( 4, 6 ] 65356 4.239% 89.967% # ( 6, 10 ] 16923 1.098% 91.064% ( 10, 15 ] 4820 0.313% 91.377% ( 15, 22 ] 1154 0.075% 91.452% ( 22, 34 ] 306 0.020% 91.472% ( 34, 51 ] 55 0.004% 91.475% ( 51, 76 ] 21 0.001% 91.477% ( 76, 110 ] 3169 0.206% 91.682% ( 110, 170 ] 48156 3.123% 94.805% # ( 170, 250 ] 64841 4.205% 99.011% # ( 250, 380 ] 10210 0.662% 99.673% ( 380, 580 ] 3991 0.259% 99.932% ( 580, 870 ] 857 0.056% 99.987% ( 870, 1300 ] 279 0.018% 100.005% ( 1300, 1900 ] 184 0.012% 100.017% ( 1900, 2900 ] 211 0.014% 100.031% ( 2900, 4400 ] 245 0.016% 100.047% ( 4400, 6600 ] 79 0.005% 100.052% ( 6600, 9900 ] 28 0.002% 100.054% ( 9900, 14000 ] 9 0.001% 100.054% ( 14000, 22000 ] 10 0.001% 100.055% ( 22000, 33000 ] 4 0.000% 100.055% ** Level 1 read latency histogram (micros): Count: 569157 Average: 7.5735 StdDev: 139.91 Min: 1 Median: 1.7034 Max: 31069 Percentiles: P50: 1.70 P75: 2.43 P99: 183.68 P99.9: 366.54 P99.99: 673.46 ------------------------------------------------------ [ 0, 1 ] 52144 9.162% 9.162% ## ( 1, 2 ] 330430 58.056% 67.218% ############ ( 2, 3 ] 103488 18.183% 85.400% #### ( 3, 4 ] 29779 5.232% 90.632% # ( 4, 6 ] 29466 5.177% 95.810% # ( 6, 10 ] 10277 1.806% 97.615% ( 10, 15 ] 2567 0.451% 98.066% ( 15, 22 ] 351 0.062% 98.128% ( 22, 34 ] 52 0.009% 98.137% ( 34, 51 ] 4 0.001% 98.138% ( 76, 110 ] 206 0.036% 98.174% ( 110, 170 ] 3793 0.666% 98.840% ( 170, 250 ] 5311 0.933% 99.774% ( 250, 380 ] 803 0.141% 99.915% ( 380, 580 ] 383 0.067% 99.982% ( 580, 870 ] 143 0.025% 100.007% ( 870, 1300 ] 49 0.009% 100.016% ( 1300, 1900 ] 18 0.003% 100.019% ( 1900, 2900 ] 17 0.003% 100.022% ( 2900, 4400 ] 18 0.003% 100.025% ( 4400, 6600 ] 10 0.002% 100.027% ( 6600, 9900 ] 12 0.002% 100.029% ( 9900, 14000 ] 9 0.002% 100.030% ( 14000, 22000 ] 5 0.001% 100.031% ( 22000, 33000 ] 8 0.001% 100.033% ** Level 2 read latency histogram (micros): Count: 98105 Average: 11.4022 StdDev: 171.98 Min: 1 Median: 2.0569 Max: 9767 Percentiles: P50: 2.06 P75: 3.19 P99: 12.05 P99.9: 3190.16 P99.99: 5771.83 ------------------------------------------------------ [ 0, 1 ] 1942 1.980% 1.980% ( 1, 2 ] 45749 46.633% 48.612% ######### ( 2, 3 ] 23942 24.404% 73.017% ##### ( 3, 4 ] 10076 10.271% 83.287% ## ( 4, 6 ] 12315 12.553% 95.840% ### ( 6, 10 ] 2722 2.775% 98.615% # ( 10, 15 ] 920 0.938% 99.553% ( 15, 22 ] 96 0.098% 99.650% ( 22, 34 ] 10 0.010% 99.661% ( 34, 51 ] 7 0.007% 99.668% ( 51, 76 ] 6 0.006% 99.674% ( 76, 110 ] 5 0.005% 99.679% ( 110, 170 ] 1 0.001% 99.680% ( 170, 250 ] 7 0.007% 99.687% ( 250, 380 ] 13 0.013% 99.700% ( 380, 580 ] 13 0.013% 99.714% ( 580, 870 ] 15 0.015% 99.729% ( 870, 1300 ] 46 0.047% 99.776% ( 1300, 1900 ] 41 0.042% 99.818% ( 1900, 2900 ] 66 0.067% 99.885% ( 2900, 4400 ] 77 0.078% 99.963% ( 4400, 6600 ] 42 0.043% 100.006% ( 6600, 9900 ] 3 0.003% 100.009% ** Level 3 read latency histogram (micros): Count: 811173 Average: 6.7500 StdDev: 110.75 Min: 1 Median: 1.9282 Max: 23089 Percentiles: P50: 1.93 P75: 2.93 P99: 12.56 P99.9: 244.59 P99.99: 353.82 ------------------------------------------------------ [ 0, 1 ] 21260 2.621% 2.621% # ( 1, 2 ] 414074 51.046% 53.667% ########## ( 2, 3 ] 186474 22.988% 76.655% ##### ( 3, 4 ] 76865 9.476% 86.131% ## ( 4, 6 ] 87200 10.750% 96.881% ## ( 6, 10 ] 15284 1.884% 98.765% ( 10, 15 ] 3720 0.459% 99.224% ( 15, 22 ] 334 0.041% 99.265% ( 22, 34 ] 53 0.007% 99.272% ( 34, 51 ] 45 0.006% 99.277% ( 51, 76 ] 29 0.004% 99.281% ( 76, 110 ] 127 0.016% 99.296% ( 110, 170 ] 2111 0.260% 99.557% ( 170, 250 ] 2988 0.368% 99.925% ( 250, 380 ] 661 0.081% 100.006% ( 380, 580 ] 385 0.047% 100.054% ( 580, 870 ] 153 0.019% 100.073% ( 870, 1300 ] 105 0.013% 100.086% ( 1300, 1900 ] 101 0.012% 100.098% ( 1900, 2900 ] 118 0.015% 100.113% ( 2900, 4400 ] 143 0.018% 100.130% ( 4400, 6600 ] 50 0.006% 100.136% ( 6600, 9900 ] 24 0.003% 100.139% ( 9900, 14000 ] 7 0.001% 100.140% ( 14000, 22000 ] 5 0.001% 100.141% ( 22000, 33000 ] 3 0.000% 100.141% ** Level 4 read latency histogram (micros): Count: 545266 Average: 36.6737 StdDev: 291.14 Min: 0 Median: 2.1715 Max: 45078 Percentiles: P50: 2.17 P75: 3.87 P99: 359.57 P99.9: 2745.85 P99.99: 3926.32 ------------------------------------------------------ [ 0, 1 ] 13934 2.555% 2.555% # ( 1, 2 ] 239261 43.880% 46.435% ######### ( 2, 3 ] 113344 20.787% 67.222% #### ( 3, 4 ] 48944 8.976% 76.198% ## ( 4, 6 ] 55474 10.174% 86.372% ## ( 6, 10 ] 11960 2.193% 88.565% ( 10, 15 ] 4492 0.824% 89.389% ( 15, 22 ] 468 0.086% 89.475% ( 22, 34 ] 84 0.015% 89.490% ( 34, 51 ] 30 0.006% 89.496% ( 51, 76 ] 21 0.004% 89.500% ( 76, 110 ] 1082 0.198% 89.698% ( 110, 170 ] 19657 3.605% 93.303% # ( 170, 250 ] 27375 5.020% 98.324% # ( 250, 380 ] 4375 0.802% 99.126% ( 380, 580 ] 1843 0.338% 99.464% ( 580, 870 ] 746 0.137% 99.601% ( 870, 1300 ] 559 0.103% 99.703% ( 1300, 1900 ] 549 0.101% 99.804% ( 1900, 2900 ] 618 0.113% 99.917% ( 2900, 4400 ] 578 0.106% 100.023% ( 4400, 6600 ] 234 0.043% 100.066% ( 6600, 9900 ] 51 0.009% 100.076% ( 9900, 14000 ] 10 0.002% 100.078% ( 14000, 22000 ] 14 0.003% 100.080% ( 22000, 33000 ] 11 0.002% 100.082% ( 33000, 50000 ] 5 0.001% 100.083% ** Level 5 read latency histogram (micros): Count: 407066 Average: 226.9288 StdDev: 374.23 Min: 89 Median: 189.1177 Max: 68362 Percentiles: P50: 189.12 P75: 229.21 P99: 1250.50 P99.9: 5346.53 P99.99: 9842.53 ------------------------------------------------------ ( 76, 110 ] 8134 1.998% 1.998% ( 110, 170 ] 146872 36.081% 38.079% ####### ( 170, 250 ] 203067 49.886% 87.964% ########## ( 250, 380 ] 29067 7.141% 95.105% # ( 380, 580 ] 11342 2.786% 97.891% # ( 580, 870 ] 3218 0.791% 98.682% ( 870, 1300 ] 1465 0.360% 99.042% ( 1300, 1900 ] 1090 0.268% 99.309% ( 1900, 2900 ] 1129 0.277% 99.587% ( 2900, 4400 ] 1072 0.263% 99.850% ( 4400, 6600 ] 474 0.116% 99.967% ( 6600, 9900 ] 98 0.024% 99.991% ( 9900, 14000 ] 17 0.004% 99.995% ( 14000, 22000 ] 20 0.005% 100.000% ( 22000, 33000 ] 4 0.001% 100.001% ( 33000, 50000 ] 1 0.000% 100.001% ( 50000, 75000 ] 1 0.000% 100.001% ** DB Stats ** Uptime(secs): 35.6 total, 25.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 82.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.907 H:M:S, 64.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 39.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:20.549 H:M:S, 81.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 255.615 micros/op 15638 ops/sec 60.171 seconds 940996 operations; 15.2 MB/s (239999 of 239999 found) Microseconds per read: Count: 940996 Average: 255.6175 StdDev: 699.17 Min: 2 Median: 213.6508 Max: 84383 Percentiles: P50: 213.65 P75: 246.59 P99: 720.23 P99.9: 9526.48 P99.99: 31062.95 ------------------------------------------------------ ( 1, 2 ] 11 0.001% 0.001% ( 2, 3 ] 38 0.004% 0.005% ( 3, 4 ] 53 0.006% 0.011% ( 4, 6 ] 71 0.008% 0.018% ( 6, 10 ] 340 0.036% 0.055% ( 10, 15 ] 3378 0.359% 0.413% ( 15, 22 ] 4584 0.487% 0.901% ( 22, 34 ] 7423 0.789% 1.689% ( 34, 51 ] 3079 0.327% 2.017% ( 51, 76 ] 371 0.039% 2.056% ( 76, 110 ] 946 0.101% 2.157% ( 110, 170 ] 138456 14.714% 16.870% ### ( 170, 250 ] 571349 60.717% 77.588% ############ ( 250, 380 ] 132567 14.088% 91.676% ### ( 380, 580 ] 63779 6.778% 98.454% # ( 580, 870 ] 10632 1.130% 99.584% ( 870, 1300 ] 1519 0.161% 99.745% ( 1300, 1900 ] 366 0.039% 99.784% ( 1900, 2900 ] 296 0.031% 99.815% ( 2900, 4400 ] 376 0.040% 99.855% ( 4400, 6600 ] 233 0.025% 99.880% ( 6600, 9900 ] 212 0.023% 99.903% ( 9900, 14000 ] 240 0.026% 99.928% ( 14000, 22000 ] 414 0.044% 99.972% ( 22000, 33000 ] 205 0.022% 99.994% ( 33000, 50000 ] 45 0.005% 99.999% ( 50000, 75000 ] 10 0.001% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12849787 rocksdb.bloom.filter.full.positive COUNT : 1066194 rocksdb.bloom.filter.full.true.positive COUNT : 940609 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 387 rocksdb.memtable.miss COUNT : 940609 rocksdb.l0.hit COUNT : 34980 rocksdb.l1.hit COUNT : 18019 rocksdb.l2andup.hit COUNT : 887610 rocksdb.compaction.key.drop.new COUNT : 167173 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3692210 rocksdb.number.keys.read COUNT : 940996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3810360720 rocksdb.bytes.read COUNT : 940996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1564 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44411143 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18653525046 rocksdb.compact.write.bytes COUNT : 18471085720 rocksdb.flush.write.bytes COUNT : 3765425483 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 48 rocksdb.number.superversion_acquires COUNT : 764 rocksdb.number.superversion_releases COUNT : 729 rocksdb.number.superversion_cleanups COUNT : 187 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 133 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3734884352 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1296384 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 21819870699 rocksdb.non.last.level.read.count COUNT : 5127274 rocksdb.block.checksum.compute.count COUNT : 5590933 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 213.159180 P95 : 476.888580 P99 : 718.563992 P100 : 84380.000000 COUNT : 940996 SUM : 239736091 rocksdb.db.write.micros P50 : 1.655253 P95 : 5.709601 P99 : 21.325243 P100 : 831128.000000 COUNT : 3692210 SUM : 55231607 rocksdb.compaction.times.micros P50 : 1013000.000000 P95 : 4020000.000000 P99 : 26400000.000000 P100 : 31288730.000000 COUNT : 60 SUM : 111743812 rocksdb.compaction.times.cpu_micros P50 : 884285.714286 P95 : 2900000.000000 P99 : 17200000.000000 P100 : 17712068.000000 COUNT : 60 SUM : 79076424 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 765.000000 P95 : 3837.500000 P99 : 8455.000000 P100 : 8455.000000 COUNT : 55 SUM : 64595 rocksdb.compaction.outfile.sync.micros P50 : 1255.897436 P95 : 10537.777778 P99 : 14320.000000 P100 : 16772.000000 COUNT : 192 SUM : 614306 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 195.945946 P95 : 4150.000000 P99 : 7755.000000 P100 : 9416.000000 COUNT : 130 SUM : 88709 rocksdb.table.open.io.micros P50 : 7703.678930 P95 : 20890.666667 P99 : 32145.882353 P100 : 80705.000000 COUNT : 1564 SUM : 13802513 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.843028 P95 : 14.188557 P99 : 233.586709 P100 : 54405.000000 COUNT : 4515135 SUM : 74040672 rocksdb.read.block.get.micros P50 : 186.141617 P95 : 314.179459 P99 : 558.259718 P100 : 68428.000000 COUNT : 1074197 SUM : 206724773 rocksdb.write.raw.block.micros P50 : 0.538127 P95 : 1.449407 P99 : 3.953579 P100 : 44119.000000 COUNT : 5385851 SUM : 14834375 rocksdb.numfiles.in.singlecompaction P50 : 2.821429 P95 : 5.025000 P99 : 24.520000 P100 : 25.000000 COUNT : 79 SUM : 284 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570945 P95 : 1233.069326 P99 : 2631.872439 P100 : 830969.000000 COUNT : 251146 SUM : 44445956 rocksdb.sst.read.micros P50 : 1.960741 P95 : 228.988720 P99 : 347.993107 P100 : 68362.000000 COUNT : 5127291 SUM : 261387736 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 940996 SUM : 940996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3692210 SUM : 3810360720 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217826.086957 P95 : 642500.000000 P99 : 1100311.000000 P100 : 1100311.000000 COUNT : 55 SUM : 14106752 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 203 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0