[2024-07-10 21:17:19.122527] Starting SPDK v24.05.1-pre git sha1 5fa2f5086 / DPDK 22.11.4 initialization... [2024-07-10 21:17:19.122626] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3761547 ] Set seed to 1720639039120138 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-10 21:17:19.207474] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-10 21:17:19.248236] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-10 21:17:19.248283] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3761547' to capture a snapshot of events at runtime. [2024-07-10 21:17:19.248294] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-10 21:17:19.248305] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-10 21:17:19.248312] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3761547 for offline analysis/debug. [2024-07-10 21:17:19.248409] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 10 21:17:23 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/10-21:17:30 ... thread 0: (1000000,1000000) ops and (133497.1,133497.1) ops/second in (7.490799,7.490799) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.33 GB 44.0 0.4 0.0 0.4 1.2 0.8 0.0 1.5 39.0 123.3 9.70 3.94 10 0.970 383K 558 0.0 0.0 L1 4/4 340.81 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 2/0 257.56 MB 2.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 41/9 3.44 GB 2.7 3.2 2.1 1.0 3.1 2.1 0.0 1.5 101.3 100.0 31.99 14.95 17 1.882 1176K 0 0.0 0.0 L4 196/15 11.73 GB 1.1 2.8 2.0 0.8 2.7 1.9 0.1 1.4 114.9 112.8 24.59 12.87 19 1.294 1549K 0 0.0 0.0 L5 1092/0 90.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1346/37 107.08 GB 0.0 6.3 4.1 2.2 7.0 4.8 0.1 8.8 97.2 108.2 66.29 31.76 46 1.441 3109K 558 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 4.1 2.2 7.0 4.8 0.1 8.8 97.2 108.2 66.29 31.76 46 1.441 3109K 558 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 4.1 2.2 6.2 4.0 0.0 0.0 108.4 106.9 59.43 29.36 37 1.606 3109K 558 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 119.4 6.86 2.40 9 0.762 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.6 total, 7.5 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.00 GB write, 937.39 MB/s write, 6.29 GB read, 842.53 MB/s read, 66.3 seconds Interval compaction: 7.00 GB write, 956.95 MB/s write, 6.29 GB read, 860.11 MB/s read, 66.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 28, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 255215 Average: 16.6286 StdDev: 176.59 Min: 1 Median: 1.9180 Max: 8042 Percentiles: P50: 1.92 P75: 2.96 P99: 131.70 P99.9: 2804.67 P99.99: 4360.75 ------------------------------------------------------ [ 0, 1 ] 8723 3.418% 3.418% # ( 1, 2 ] 129510 50.745% 54.163% ########## ( 2, 3 ] 55306 21.670% 75.834% #### ( 3, 4 ] 26282 10.298% 86.132% ## ( 4, 6 ] 24496 9.598% 95.730% ## ( 6, 10 ] 6586 2.581% 98.310% # ( 10, 15 ] 1515 0.594% 98.904% ( 15, 22 ] 168 0.066% 98.970% ( 22, 34 ] 21 0.008% 98.978% ( 34, 51 ] 15 0.006% 98.984% ( 51, 76 ] 20 0.008% 98.992% ( 76, 110 ] 11 0.004% 98.996% ( 110, 170 ] 30 0.012% 99.008% ( 170, 250 ] 82 0.032% 99.040% ( 250, 380 ] 167 0.065% 99.105% ( 380, 580 ] 357 0.140% 99.245% ( 580, 870 ] 537 0.210% 99.456% ( 870, 1300 ] 539 0.211% 99.667% ( 1300, 1900 ] 366 0.143% 99.810% ( 1900, 2900 ] 254 0.100% 99.910% ( 2900, 4400 ] 211 0.083% 99.993% ( 4400, 6600 ] 67 0.026% 100.019% ( 6600, 9900 ] 5 0.002% 100.021% ** Level 1 read latency histogram (micros): Count: 32045 Average: 12.9280 StdDev: 152.04 Min: 1 Median: 2.3148 Max: 6744 Percentiles: P50: 2.31 P75: 3.48 P99: 14.87 P99.9: 2720.88 P99.99: 6061.12 ------------------------------------------------------ [ 0, 1 ] 308 0.961% 0.961% ( 1, 2 ] 12902 40.262% 41.223% ######## ( 2, 3 ] 8933 27.876% 69.100% ###### ( 3, 4 ] 3908 12.195% 81.295% ## ( 4, 6 ] 4132 12.894% 94.189% ### ( 6, 10 ] 1231 3.841% 98.031% # ( 10, 15 ] 319 0.995% 99.026% ( 15, 22 ] 58 0.181% 99.207% ( 22, 34 ] 7 0.022% 99.229% ( 34, 51 ] 5 0.016% 99.245% ( 51, 76 ] 2 0.006% 99.251% ( 76, 110 ] 2 0.006% 99.257% ( 110, 170 ] 1 0.003% 99.260% ( 170, 250 ] 3 0.009% 99.270% ( 250, 380 ] 17 0.053% 99.323% ( 380, 580 ] 44 0.137% 99.460% ( 580, 870 ] 62 0.193% 99.654% ( 870, 1300 ] 42 0.131% 99.785% ( 1300, 1900 ] 23 0.072% 99.856% ( 1900, 2900 ] 17 0.053% 99.910% ( 2900, 4400 ] 19 0.059% 99.969% ( 4400, 6600 ] 9 0.028% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 386061 Average: 13.0825 StdDev: 158.51 Min: 1 Median: 1.9297 Max: 8587 Percentiles: P50: 1.93 P75: 2.96 P99: 12.86 P99.9: 1678.16 P99.99: 2550.44 ------------------------------------------------------ [ 0, 1 ] 12453 3.226% 3.226% # ( 1, 2 ] 194242 50.314% 53.539% ########## ( 2, 3 ] 86262 22.344% 75.884% #### ( 3, 4 ] 39118 10.133% 86.016% ## ( 4, 6 ] 37647 9.752% 95.768% ## ( 6, 10 ] 10902 2.824% 98.592% # ( 10, 15 ] 2755 0.714% 99.305% ( 15, 22 ] 397 0.103% 99.408% ( 22, 34 ] 49 0.013% 99.421% ( 34, 51 ] 25 0.006% 99.427% ( 51, 76 ] 22 0.006% 99.433% ( 76, 110 ] 13 0.003% 99.436% ( 110, 170 ] 33 0.009% 99.445% ( 170, 250 ] 86 0.022% 99.467% ( 250, 380 ] 177 0.046% 99.513% ( 380, 580 ] 325 0.084% 99.597% ( 580, 870 ] 426 0.110% 99.708% ( 870, 1300 ] 511 0.132% 99.840% ( 1300, 1900 ] 368 0.095% 99.935% ( 1900, 2900 ] 325 0.084% 100.019% ( 2900, 4400 ] 295 0.076% 100.096% ( 4400, 6600 ] 83 0.021% 100.117% ( 6600, 9900 ] 6 0.002% 100.119% ** Level 3 read latency histogram (micros): Count: 852659 Average: 9.9176 StdDev: 132.15 Min: 1 Median: 1.9396 Max: 9481 Percentiles: P50: 1.94 P75: 2.97 P99: 10.06 P99.9: 888.50 P99.99: 1328.28 ------------------------------------------------------ [ 0, 1 ] 22669 2.659% 2.659% # ( 1, 2 ] 429611 50.385% 53.043% ########## ( 2, 3 ] 193095 22.646% 75.690% ##### ( 3, 4 ] 89553 10.503% 86.192% ## ( 4, 6 ] 86469 10.141% 96.334% ## ( 6, 10 ] 22675 2.659% 98.993% # ( 10, 15 ] 5288 0.620% 99.613% ( 15, 22 ] 587 0.069% 99.682% ( 22, 34 ] 79 0.009% 99.691% ( 34, 51 ] 51 0.006% 99.697% ( 51, 76 ] 77 0.009% 99.706% ( 76, 110 ] 27 0.003% 99.709% ( 110, 170 ] 61 0.007% 99.717% ( 170, 250 ] 105 0.012% 99.729% ( 250, 380 ] 261 0.031% 99.759% ( 380, 580 ] 479 0.056% 99.816% ( 580, 870 ] 689 0.081% 99.896% ( 870, 1300 ] 775 0.091% 99.987% ( 1300, 1900 ] 546 0.064% 100.051% ( 1900, 2900 ] 496 0.058% 100.110% ( 2900, 4400 ] 431 0.051% 100.160% ( 4400, 6600 ] 128 0.015% 100.175% ( 6600, 9900 ] 10 0.001% 100.176% ** Level 4 read latency histogram (micros): Count: 280769 Average: 23.8244 StdDev: 230.13 Min: 1 Median: 1.9478 Max: 9867 Percentiles: P50: 1.95 P75: 2.99 P99: 599.89 P99.9: 3012.52 P99.99: 3953.06 ------------------------------------------------------ [ 0, 1 ] 7009 2.496% 2.496% ( 1, 2 ] 140719 50.119% 52.615% ########## ( 2, 3 ] 63340 22.559% 75.175% ##### ( 3, 4 ] 29347 10.452% 85.627% ## ( 4, 6 ] 27186 9.683% 95.310% ## ( 6, 10 ] 7514 2.676% 97.986% # ( 10, 15 ] 1733 0.617% 98.603% ( 15, 22 ] 187 0.067% 98.670% ( 22, 34 ] 13 0.005% 98.675% ( 34, 51 ] 22 0.008% 98.683% ( 51, 76 ] 23 0.008% 98.691% ( 76, 110 ] 7 0.002% 98.693% ( 110, 170 ] 33 0.012% 98.705% ( 170, 250 ] 98 0.035% 98.740% ( 250, 380 ] 233 0.083% 98.823% ( 380, 580 ] 448 0.160% 98.982% ( 580, 870 ] 719 0.256% 99.239% ( 870, 1300 ] 834 0.297% 99.536% ( 1300, 1900 ] 572 0.204% 99.739% ( 1900, 2900 ] 421 0.150% 99.889% ( 2900, 4400 ] 403 0.144% 100.033% ( 4400, 6600 ] 134 0.048% 100.080% ( 6600, 9900 ] 20 0.007% 100.088% ** Level 5 read latency histogram (micros): Count: 12979 Average: 1631.3834 StdDev: 1408.04 Min: 79 Median: 1130.8487 Max: 11131 Percentiles: P50: 1130.85 P75: 2208.60 P99: 6502.56 P99.9: 9563.97 P99.99: 11131.00 ------------------------------------------------------ ( 76, 110 ] 7 0.054% 0.054% ( 110, 170 ] 73 0.562% 0.616% ( 170, 250 ] 244 1.880% 2.496% ( 250, 380 ] 698 5.378% 7.874% # ( 380, 580 ] 1536 11.835% 19.709% ## ( 580, 870 ] 2384 18.368% 38.077% #### ( 870, 1300 ] 2551 19.655% 57.732% #### ( 1300, 1900 ] 1791 13.799% 71.531% ### ( 1900, 2900 ] 1459 11.241% 82.772% ## ( 2900, 4400 ] 1485 11.442% 94.214% ## ( 4400, 6600 ] 650 5.008% 99.222% # ( 6600, 9900 ] 98 0.755% 99.977% ( 9900, 14000 ] 3 0.023% 100.000% ** DB Stats ** Uptime(secs): 7.6 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 128.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.482 H:M:S, 45.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.482 H:M:S, 46.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/10-21:17:37 ... thread 0: (1000000,2000000) ops and (163852.7,147125.5) ops/second in (6.103041,13.593840) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 1.84 GB 163.6 1.3 0.0 1.3 3.1 1.8 0.0 1.7 63.7 154.7 20.76 10.91 28 0.741 1343K 1711 0.0 0.0 L1 10/0 879.74 MB 88.0 0.9 0.5 0.3 0.9 0.5 0.0 1.6 71.6 71.3 12.33 4.34 1 12.333 896K 2925 0.0 0.0 L3 12/0 998.26 MB 1.0 3.4 2.2 1.1 3.3 2.2 0.1 1.5 102.8 101.5 33.62 15.93 18 1.868 1380K 0 0.0 0.0 L4 176/0 9.73 GB 1.0 7.9 4.4 3.4 7.7 4.3 0.4 1.7 123.7 121.4 65.03 37.84 44 1.478 3626K 2166 0.0 0.0 L5 1148/0 94.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1358/4 108.02 GB 0.0 13.4 7.2 6.2 15.0 8.9 5.1 8.1 104.0 116.9 131.74 69.03 91 1.448 7247K 6802 0.0 0.0 Int 0/0 0.00 KB 0.0 13.4 7.2 6.2 15.0 8.9 5.1 8.1 104.0 116.9 131.74 69.03 91 1.448 7247K 6802 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.4 7.2 6.2 13.2 7.0 0.0 0.0 115.2 113.5 119.01 63.51 67 1.776 7247K 6802 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 148.4 12.73 5.51 24 0.531 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.8 total, 13.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.04 GB write, 1119.66 MB/s write, 13.38 GB read, 996.67 MB/s read, 131.7 seconds Interval compaction: 15.04 GB write, 1132.53 MB/s write, 13.38 GB read, 1008.13 MB/s read, 131.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 36, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 521173 Average: 20.6215 StdDev: 247.03 Min: 1 Median: 1.8082 Max: 42033 Percentiles: P50: 1.81 P75: 2.78 P99: 521.17 P99.9: 3261.67 P99.99: 5366.93 ------------------------------------------------------ [ 0, 1 ] 36648 7.032% 7.032% # ( 1, 2 ] 277098 53.168% 60.200% ########### ( 2, 3 ] 98997 18.995% 79.195% #### ( 3, 4 ] 46025 8.831% 88.026% ## ( 4, 6 ] 42141 8.086% 96.112% ## ( 6, 10 ] 10057 1.930% 98.042% ( 10, 15 ] 2260 0.434% 98.475% ( 15, 22 ] 238 0.046% 98.521% ( 22, 34 ] 26 0.005% 98.526% ( 34, 51 ] 23 0.004% 98.530% ( 51, 76 ] 23 0.004% 98.535% ( 76, 110 ] 105 0.020% 98.555% ( 110, 170 ] 463 0.089% 98.644% ( 170, 250 ] 462 0.089% 98.732% ( 250, 380 ] 629 0.121% 98.853% ( 380, 580 ] 1087 0.209% 99.062% ( 580, 870 ] 1494 0.287% 99.348% ( 870, 1300 ] 1345 0.258% 99.606% ( 1300, 1900 ] 828 0.159% 99.765% ( 1900, 2900 ] 577 0.111% 99.876% ( 2900, 4400 ] 526 0.101% 99.977% ( 4400, 6600 ] 159 0.031% 100.007% ( 6600, 9900 ] 21 0.004% 100.011% ( 9900, 14000 ] 7 0.001% 100.013% ( 14000, 22000 ] 6 0.001% 100.014% ( 22000, 33000 ] 6 0.001% 100.015% ( 33000, 50000 ] 4 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 86965 Average: 11.1791 StdDev: 159.02 Min: 1 Median: 2.2726 Max: 16642 Percentiles: P50: 2.27 P75: 3.37 P99: 14.99 P99.9: 1974.02 P99.99: 5974.44 ------------------------------------------------------ [ 0, 1 ] 795 0.914% 0.914% ( 1, 2 ] 35959 41.349% 42.263% ######## ( 2, 3 ] 24682 28.382% 70.645% ###### ( 3, 4 ] 10238 11.773% 82.417% ## ( 4, 6 ] 10607 12.197% 94.614% ## ( 6, 10 ] 3058 3.516% 98.130% # ( 10, 15 ] 758 0.872% 99.002% ( 15, 22 ] 114 0.131% 99.133% ( 22, 34 ] 10 0.011% 99.144% ( 34, 51 ] 16 0.018% 99.163% ( 51, 76 ] 6 0.007% 99.170% ( 76, 110 ] 37 0.043% 99.212% ( 110, 170 ] 98 0.113% 99.325% ( 170, 250 ] 59 0.068% 99.393% ( 250, 380 ] 69 0.079% 99.472% ( 380, 580 ] 113 0.130% 99.602% ( 580, 870 ] 121 0.139% 99.741% ( 870, 1300 ] 93 0.107% 99.848% ( 1300, 1900 ] 42 0.048% 99.897% ( 1900, 2900 ] 41 0.047% 99.944% ( 2900, 4400 ] 31 0.036% 99.979% ( 4400, 6600 ] 13 0.015% 99.994% ( 6600, 9900 ] 1 0.001% 99.995% ( 14000, 22000 ] 4 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 418812 Average: 12.7960 StdDev: 156.71 Min: 1 Median: 1.9301 Max: 8587 Percentiles: P50: 1.93 P75: 2.96 P99: 12.76 P99.9: 1700.29 P99.99: 2615.86 ------------------------------------------------------ [ 0, 1 ] 13120 3.133% 3.133% # ( 1, 2 ] 211036 50.389% 53.522% ########## ( 2, 3 ] 93606 22.350% 75.872% #### ( 3, 4 ] 42481 10.143% 86.015% ## ( 4, 6 ] 40899 9.765% 95.781% ## ( 6, 10 ] 11846 2.828% 98.609% # ( 10, 15 ] 2968 0.709% 99.318% ( 15, 22 ] 419 0.100% 99.418% ( 22, 34 ] 50 0.012% 99.430% ( 34, 51 ] 27 0.006% 99.437% ( 51, 76 ] 29 0.007% 99.443% ( 76, 110 ] 21 0.005% 99.448% ( 110, 170 ] 37 0.009% 99.457% ( 170, 250 ] 94 0.022% 99.480% ( 250, 380 ] 183 0.044% 99.523% ( 380, 580 ] 339 0.081% 99.604% ( 580, 870 ] 451 0.108% 99.712% ( 870, 1300 ] 531 0.127% 99.839% ( 1300, 1900 ] 384 0.092% 99.931% ( 1900, 2900 ] 348 0.083% 100.014% ( 2900, 4400 ] 306 0.073% 100.087% ( 4400, 6600 ] 89 0.021% 100.108% ( 6600, 9900 ] 7 0.002% 100.110% ** Level 3 read latency histogram (micros): Count: 1391331 Average: 9.9252 StdDev: 157.86 Min: 1 Median: 1.9333 Max: 40406 Percentiles: P50: 1.93 P75: 2.96 P99: 9.97 P99.9: 889.48 P99.99: 1360.13 ------------------------------------------------------ [ 0, 1 ] 35360 2.541% 2.541% # ( 1, 2 ] 707473 50.849% 53.390% ########## ( 2, 3 ] 312353 22.450% 75.840% #### ( 3, 4 ] 146434 10.525% 86.365% ## ( 4, 6 ] 139230 10.007% 96.372% ## ( 6, 10 ] 36866 2.650% 99.021% # ( 10, 15 ] 8333 0.599% 99.620% ( 15, 22 ] 873 0.063% 99.683% ( 22, 34 ] 92 0.007% 99.690% ( 34, 51 ] 71 0.005% 99.695% ( 51, 76 ] 147 0.011% 99.705% ( 76, 110 ] 69 0.005% 99.710% ( 110, 170 ] 162 0.012% 99.722% ( 170, 250 ] 178 0.013% 99.735% ( 250, 380 ] 393 0.028% 99.763% ( 380, 580 ] 736 0.053% 99.816% ( 580, 870 ] 1114 0.080% 99.896% ( 870, 1300 ] 1229 0.088% 99.984% ( 1300, 1900 ] 787 0.057% 100.041% ( 1900, 2900 ] 741 0.053% 100.094% ( 2900, 4400 ] 665 0.048% 100.142% ( 4400, 6600 ] 207 0.015% 100.157% ( 6600, 9900 ] 29 0.002% 100.159% ( 9900, 14000 ] 2 0.000% 100.159% ( 14000, 22000 ] 14 0.001% 100.160% ( 22000, 33000 ] 3 0.000% 100.160% ( 33000, 50000 ] 3 0.000% 100.160% ** Level 4 read latency histogram (micros): Count: 891727 Average: 17.8616 StdDev: 250.86 Min: 1 Median: 1.9281 Max: 59479 Percentiles: P50: 1.93 P75: 2.95 P99: 143.13 P99.9: 1839.17 P99.99: 2761.38 ------------------------------------------------------ [ 0, 1 ] 21376 2.397% 2.397% ( 1, 2 ] 457389 51.292% 53.690% ########## ( 2, 3 ] 200292 22.461% 76.151% #### ( 3, 4 ] 90825 10.185% 86.336% ## ( 4, 6 ] 83624 9.378% 95.714% ## ( 6, 10 ] 22803 2.557% 98.271% # ( 10, 15 ] 5163 0.579% 98.850% ( 15, 22 ] 508 0.057% 98.907% ( 22, 34 ] 34 0.004% 98.911% ( 34, 51 ] 68 0.008% 98.918% ( 51, 76 ] 82 0.009% 98.928% ( 76, 110 ] 220 0.025% 98.952% ( 110, 170 ] 771 0.086% 99.039% ( 170, 250 ] 667 0.075% 99.114% ( 250, 380 ] 886 0.099% 99.213% ( 380, 580 ] 1450 0.163% 99.375% ( 580, 870 ] 1877 0.210% 99.586% ( 870, 1300 ] 1810 0.203% 99.789% ( 1300, 1900 ] 1102 0.124% 99.913% ( 1900, 2900 ] 802 0.090% 100.002% ( 2900, 4400 ] 753 0.084% 100.087% ( 4400, 6600 ] 223 0.025% 100.112% ( 6600, 9900 ] 48 0.005% 100.117% ( 9900, 14000 ] 9 0.001% 100.118% ( 14000, 22000 ] 20 0.002% 100.121% ( 22000, 33000 ] 19 0.002% 100.123% ( 33000, 50000 ] 3 0.000% 100.123% ( 50000, 75000 ] 1 0.000% 100.123% ** Level 5 read latency histogram (micros): Count: 36210 Average: 1073.3126 StdDev: 1445.44 Min: 79 Median: 664.0939 Max: 56927 Percentiles: P50: 664.09 P75: 1273.80 P99: 6104.62 P99.9: 11312.64 P99.99: 38777.57 ------------------------------------------------------ ( 76, 110 ] 1274 3.518% 3.518% # ( 110, 170 ] 4618 12.753% 16.272% ### ( 170, 250 ] 2842 7.849% 24.120% ## ( 250, 380 ] 3010 8.313% 32.433% ## ( 380, 580 ] 4700 12.980% 45.413% ### ( 580, 870 ] 5728 15.819% 61.232% ### ( 870, 1300 ] 5309 14.662% 75.893% ### ( 1300, 1900 ] 3205 8.851% 84.745% ## ( 1900, 2900 ] 2366 6.534% 91.279% # ( 2900, 4400 ] 2128 5.877% 97.155% # ( 4400, 6600 ] 862 2.381% 99.536% ( 6600, 9900 ] 128 0.353% 99.890% ( 9900, 14000 ] 11 0.030% 99.920% ( 14000, 22000 ] 16 0.044% 99.964% ( 22000, 33000 ] 7 0.019% 99.983% ( 33000, 50000 ] 7 0.019% 100.003% ( 50000, 75000 ] 2 0.006% 100.008% ** DB Stats ** Uptime(secs): 13.8 total, 6.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 143.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.809 H:M:S, 42.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 161.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.327 H:M:S, 38.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/10-21:17:40 ... thread 0: (1000000,3000000) ops and (289495.3,175972.4) ops/second in (3.454287,17.048127) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 2.83 GB 264.3 2.3 0.0 2.3 5.1 2.8 0.0 1.8 84.6 189.6 27.56 17.26 48 0.574 2366K 2706 0.0 0.0 L1 10/0 879.74 MB 88.0 0.9 0.5 0.3 0.9 0.5 0.0 1.6 71.6 71.3 12.33 4.34 1 12.333 896K 2925 0.0 0.0 L3 12/0 998.26 MB 1.0 3.4 2.2 1.1 3.3 2.2 0.1 1.5 102.8 101.5 33.62 15.93 18 1.868 1380K 0 0.0 0.0 L4 176/0 9.73 GB 1.0 7.9 4.4 3.4 7.7 4.3 0.4 1.7 123.7 121.4 65.03 37.84 44 1.478 3626K 2166 0.0 0.0 L5 1148/0 94.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1362/4 109.01 GB 0.0 14.4 7.2 7.2 17.0 9.8 5.1 6.0 106.2 125.7 138.55 75.37 111 1.248 8270K 7797 0.0 0.0 Int 0/0 0.00 KB 0.0 14.4 7.2 7.2 17.0 9.8 5.1 6.0 106.2 125.7 138.55 75.37 111 1.248 8270K 7797 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.4 7.2 7.2 14.2 7.0 0.0 0.0 119.8 118.2 122.77 67.20 71 1.729 8270K 7797 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 183.7 15.77 8.17 40 0.394 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.2 total, 17.0 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.00 GB write, 1011.98 MB/s write, 14.37 GB read, 855.16 MB/s read, 138.5 seconds Interval compaction: 17.00 GB write, 1021.26 MB/s write, 14.37 GB read, 863.01 MB/s read, 138.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 36, interval: 47 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 788070 Average: 15.4008 StdDev: 201.97 Min: 0 Median: 1.6395 Max: 42033 Percentiles: P50: 1.64 P75: 2.36 P99: 218.92 P99.9: 2565.97 P99.99: 4363.62 ------------------------------------------------------ [ 0, 1 ] 118054 14.980% 14.980% ### ( 1, 2 ] 431539 54.759% 69.739% ########### ( 2, 3 ] 116074 14.729% 84.468% ### ( 3, 4 ] 51553 6.542% 91.010% # ( 4, 6 ] 45370 5.757% 96.767% # ( 6, 10 ] 10677 1.355% 98.122% ( 10, 15 ] 2436 0.309% 98.431% ( 15, 22 ] 255 0.032% 98.463% ( 22, 34 ] 28 0.004% 98.467% ( 34, 51 ] 28 0.004% 98.470% ( 51, 76 ] 31 0.004% 98.474% ( 76, 110 ] 701 0.089% 98.563% ( 110, 170 ] 2568 0.326% 98.889% ( 170, 250 ] 1433 0.182% 99.071% ( 250, 380 ] 984 0.125% 99.196% ( 380, 580 ] 1392 0.177% 99.372% ( 580, 870 ] 1581 0.201% 99.573% ( 870, 1300 ] 1358 0.172% 99.745% ( 1300, 1900 ] 834 0.106% 99.851% ( 1900, 2900 ] 581 0.074% 99.925% ( 2900, 4400 ] 528 0.067% 99.992% ( 4400, 6600 ] 159 0.020% 100.012% ( 6600, 9900 ] 21 0.003% 100.015% ( 9900, 14000 ] 7 0.001% 100.015% ( 14000, 22000 ] 6 0.001% 100.016% ( 22000, 33000 ] 6 0.001% 100.017% ( 33000, 50000 ] 4 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 88006 Average: 13.3336 StdDev: 160.26 Min: 1 Median: 2.2937 Max: 16642 Percentiles: P50: 2.29 P75: 3.45 P99: 183.49 P99.9: 1992.88 P99.99: 5956.82 ------------------------------------------------------ [ 0, 1 ] 795 0.903% 0.903% ( 1, 2 ] 35959 40.860% 41.763% ######## ( 2, 3 ] 24683 28.047% 69.810% ###### ( 3, 4 ] 10241 11.637% 81.447% ## ( 4, 6 ] 10613 12.059% 93.506% ## ( 6, 10 ] 3059 3.476% 96.982% # ( 10, 15 ] 758 0.861% 97.843% ( 15, 22 ] 114 0.130% 97.973% ( 22, 34 ] 10 0.011% 97.984% ( 34, 51 ] 16 0.018% 98.002% ( 51, 76 ] 6 0.007% 98.009% ( 76, 110 ] 223 0.253% 98.263% ( 110, 170 ] 610 0.693% 98.956% ( 170, 250 ] 231 0.262% 99.218% ( 250, 380 ] 128 0.145% 99.364% ( 380, 580 ] 183 0.208% 99.572% ( 580, 870 ] 145 0.165% 99.736% ( 870, 1300 ] 97 0.110% 99.847% ( 1300, 1900 ] 43 0.049% 99.895% ( 1900, 2900 ] 43 0.049% 99.944% ( 2900, 4400 ] 31 0.035% 99.980% ( 4400, 6600 ] 13 0.015% 99.994% ( 6600, 9900 ] 1 0.001% 99.995% ( 14000, 22000 ] 4 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 418917 Average: 12.8383 StdDev: 156.73 Min: 1 Median: 1.9304 Max: 8587 Percentiles: P50: 1.93 P75: 2.96 P99: 12.93 P99.9: 1700.65 P99.99: 2615.83 ------------------------------------------------------ [ 0, 1 ] 13120 3.132% 3.132% # ( 1, 2 ] 211036 50.377% 53.508% ########## ( 2, 3 ] 93606 22.345% 75.853% #### ( 3, 4 ] 42481 10.141% 85.994% ## ( 4, 6 ] 40899 9.763% 95.757% ## ( 6, 10 ] 11846 2.828% 98.585% # ( 10, 15 ] 2968 0.708% 99.293% ( 15, 22 ] 419 0.100% 99.393% ( 22, 34 ] 50 0.012% 99.405% ( 34, 51 ] 27 0.006% 99.412% ( 51, 76 ] 29 0.007% 99.419% ( 76, 110 ] 42 0.010% 99.429% ( 110, 170 ] 90 0.021% 99.450% ( 170, 250 ] 114 0.027% 99.477% ( 250, 380 ] 190 0.045% 99.523% ( 380, 580 ] 340 0.081% 99.604% ( 580, 870 ] 453 0.108% 99.712% ( 870, 1300 ] 531 0.127% 99.839% ( 1300, 1900 ] 385 0.092% 99.931% ( 1900, 2900 ] 348 0.083% 100.014% ( 2900, 4400 ] 306 0.073% 100.087% ( 4400, 6600 ] 89 0.021% 100.108% ( 6600, 9900 ] 7 0.002% 100.110% ** Level 3 read latency histogram (micros): Count: 1392196 Average: 10.0394 StdDev: 157.93 Min: 1 Median: 1.9339 Max: 40406 Percentiles: P50: 1.93 P75: 2.96 P99: 10.33 P99.9: 890.21 P99.99: 1361.51 ------------------------------------------------------ [ 0, 1 ] 35360 2.540% 2.540% # ( 1, 2 ] 707473 50.817% 53.357% ########## ( 2, 3 ] 312353 22.436% 75.793% #### ( 3, 4 ] 146434 10.518% 86.311% ## ( 4, 6 ] 139230 10.001% 96.312% ## ( 6, 10 ] 36866 2.648% 98.960% # ( 10, 15 ] 8333 0.599% 99.558% ( 15, 22 ] 873 0.063% 99.621% ( 22, 34 ] 92 0.007% 99.628% ( 34, 51 ] 71 0.005% 99.633% ( 51, 76 ] 147 0.011% 99.643% ( 76, 110 ] 199 0.014% 99.658% ( 110, 170 ] 601 0.043% 99.701% ( 170, 250 ] 331 0.024% 99.725% ( 250, 380 ] 463 0.033% 99.758% ( 380, 580 ] 790 0.057% 99.815% ( 580, 870 ] 1130 0.081% 99.896% ( 870, 1300 ] 1230 0.088% 99.984% ( 1300, 1900 ] 788 0.057% 100.041% ( 1900, 2900 ] 741 0.053% 100.094% ( 2900, 4400 ] 666 0.048% 100.142% ( 4400, 6600 ] 207 0.015% 100.157% ( 6600, 9900 ] 29 0.002% 100.159% ( 9900, 14000 ] 2 0.000% 100.159% ( 14000, 22000 ] 14 0.001% 100.160% ( 22000, 33000 ] 3 0.000% 100.160% ( 33000, 50000 ] 3 0.000% 100.160% ** Level 4 read latency histogram (micros): Count: 899643 Average: 19.1385 StdDev: 250.49 Min: 1 Median: 1.9366 Max: 59479 Percentiles: P50: 1.94 P75: 2.98 P99: 248.83 P99.9: 1837.21 P99.99: 2761.09 ------------------------------------------------------ [ 0, 1 ] 21376 2.376% 2.376% ( 1, 2 ] 457427 50.845% 53.221% ########## ( 2, 3 ] 200628 22.301% 75.522% #### ( 3, 4 ] 91150 10.132% 85.654% ## ( 4, 6 ] 84061 9.344% 94.998% ## ( 6, 10 ] 22854 2.540% 97.538% # ( 10, 15 ] 5180 0.576% 98.114% ( 15, 22 ] 511 0.057% 98.171% ( 22, 34 ] 34 0.004% 98.175% ( 34, 51 ] 68 0.008% 98.182% ( 51, 76 ] 82 0.009% 98.191% ( 76, 110 ] 1261 0.140% 98.331% ( 110, 170 ] 4106 0.456% 98.788% ( 170, 250 ] 1937 0.215% 99.003% ( 250, 380 ] 1392 0.155% 99.158% ( 380, 580 ] 1874 0.208% 99.366% ( 580, 870 ] 1985 0.221% 99.587% ( 870, 1300 ] 1828 0.203% 99.790% ( 1300, 1900 ] 1105 0.123% 99.913% ( 1900, 2900 ] 806 0.090% 100.002% ( 2900, 4400 ] 753 0.084% 100.086% ( 4400, 6600 ] 223 0.025% 100.111% ( 6600, 9900 ] 48 0.005% 100.116% ( 9900, 14000 ] 9 0.001% 100.117% ( 14000, 22000 ] 20 0.002% 100.119% ( 22000, 33000 ] 19 0.002% 100.122% ( 33000, 50000 ] 3 0.000% 100.122% ( 50000, 75000 ] 1 0.000% 100.122% ** Level 5 read latency histogram (micros): Count: 82185 Average: 578.2649 StdDev: 1059.86 Min: 75 Median: 202.1195 Max: 56927 Percentiles: P50: 202.12 P75: 587.80 P99: 4931.24 P99.9: 8812.42 P99.99: 29513.79 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 9095 11.066% 11.068% ## ( 110, 170 ] 27616 33.602% 44.670% ####### ( 170, 250 ] 10913 13.279% 57.949% ### ( 250, 380 ] 6367 7.747% 65.696% ## ( 380, 580 ] 7472 9.092% 74.787% ## ( 580, 870 ] 6537 7.954% 82.741% ## ( 870, 1300 ] 5414 6.588% 89.329% # ( 1300, 1900 ] 3233 3.934% 93.263% # ( 1900, 2900 ] 2378 2.893% 96.156% # ( 2900, 4400 ] 2130 2.592% 98.748% # ( 4400, 6600 ] 862 1.049% 99.797% ( 6600, 9900 ] 128 0.156% 99.953% ( 9900, 14000 ] 11 0.013% 99.966% ( 14000, 22000 ] 16 0.019% 99.985% ( 22000, 33000 ] 7 0.009% 99.994% ( 33000, 50000 ] 7 0.009% 100.002% ( 50000, 75000 ] 2 0.002% 100.005% ** DB Stats ** Uptime(secs): 17.2 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 171.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.809 H:M:S, 33.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 284.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/10-21:17:43 ... thread 0: (1000000,4000000) ops and (285532.4,194643.8) ops/second in (3.502229,20.550356) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.75 GB 358.7 3.3 0.0 3.3 7.0 3.7 0.0 1.9 97.6 209.7 34.22 23.49 67 0.511 3390K 3635 0.0 0.0 L1 10/0 879.74 MB 88.0 0.9 0.5 0.3 0.9 0.5 0.0 1.6 71.6 71.3 12.33 4.34 1 12.333 896K 2925 0.0 0.0 L3 12/0 998.26 MB 1.0 3.4 2.2 1.1 3.3 2.2 0.1 1.5 102.8 101.5 33.62 15.93 18 1.868 1380K 0 0.0 0.0 L4 176/0 9.73 GB 1.0 7.9 4.4 3.4 7.7 4.3 0.4 1.7 123.7 121.4 65.03 37.84 44 1.478 3626K 2166 0.0 0.0 L5 1148/0 94.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/4 109.93 GB 0.0 15.4 7.2 8.1 18.9 10.8 5.1 5.0 108.3 133.4 145.21 81.60 130 1.117 9294K 8726 0.0 0.0 Int 0/0 0.00 KB 0.0 15.4 7.2 8.1 18.9 10.8 5.1 5.0 108.3 133.4 145.21 81.60 130 1.117 9294K 8726 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.4 7.2 8.1 15.2 7.0 0.0 0.0 124.2 122.6 126.58 70.94 75 1.688 9294K 8726 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 206.3 18.63 10.66 55 0.339 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.6 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.91 GB write, 935.10 MB/s write, 15.35 GB read, 759.22 MB/s read, 145.2 seconds Interval compaction: 18.91 GB write, 942.21 MB/s write, 15.35 GB read, 764.99 MB/s read, 145.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 36, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 36, interval: 48 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1053340 Average: 12.8256 StdDev: 175.47 Min: 0 Median: 1.5630 Max: 42033 Percentiles: P50: 1.56 P75: 2.06 P99: 169.37 P99.9: 2000.27 P99.99: 4097.91 ------------------------------------------------------ [ 0, 1 ] 198149 18.811% 18.811% #### ( 1, 2 ] 583549 55.400% 74.211% ########### ( 2, 3 ] 133483 12.672% 86.884% ### ( 3, 4 ] 57924 5.499% 92.383% # ( 4, 6 ] 49604 4.709% 97.092% # ( 6, 10 ] 11344 1.077% 98.169% ( 10, 15 ] 2564 0.243% 98.412% ( 15, 22 ] 271 0.026% 98.438% ( 22, 34 ] 28 0.003% 98.441% ( 34, 51 ] 29 0.003% 98.444% ( 51, 76 ] 32 0.003% 98.447% ( 76, 110 ] 1232 0.117% 98.564% ( 110, 170 ] 4647 0.441% 99.005% ( 170, 250 ] 2486 0.236% 99.241% ( 250, 380 ] 1337 0.127% 99.368% ( 380, 580 ] 1689 0.160% 99.528% ( 580, 870 ] 1642 0.156% 99.684% ( 870, 1300 ] 1379 0.131% 99.815% ( 1300, 1900 ] 840 0.080% 99.895% ( 1900, 2900 ] 585 0.056% 99.950% ( 2900, 4400 ] 528 0.050% 100.000% ( 4400, 6600 ] 159 0.015% 100.015% ( 6600, 9900 ] 21 0.002% 100.017% ( 9900, 14000 ] 7 0.001% 100.018% ( 14000, 22000 ] 6 0.001% 100.019% ( 22000, 33000 ] 6 0.001% 100.019% ( 33000, 50000 ] 4 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 89082 Average: 15.3849 StdDev: 161.07 Min: 1 Median: 2.3155 Max: 16642 Percentiles: P50: 2.32 P75: 3.52 P99: 238.44 P99.9: 1989.05 P99.99: 5938.61 ------------------------------------------------------ [ 0, 1 ] 795 0.892% 0.892% ( 1, 2 ] 35959 40.366% 41.259% ######## ( 2, 3 ] 24683 27.708% 68.967% ###### ( 3, 4 ] 10241 11.496% 80.463% ## ( 4, 6 ] 10613 11.914% 92.377% ## ( 6, 10 ] 3059 3.434% 95.811% # ( 10, 15 ] 758 0.851% 96.662% ( 15, 22 ] 114 0.128% 96.789% ( 22, 34 ] 10 0.011% 96.801% ( 34, 51 ] 16 0.018% 96.819% ( 51, 76 ] 6 0.007% 96.825% ( 76, 110 ] 412 0.462% 97.288% ( 110, 170 ] 1165 1.308% 98.596% ( 170, 250 ] 421 0.473% 99.068% ( 250, 380 ] 194 0.218% 99.286% ( 380, 580 ] 240 0.269% 99.555% ( 580, 870 ] 160 0.180% 99.735% ( 870, 1300 ] 100 0.112% 99.847% ( 1300, 1900 ] 43 0.048% 99.896% ( 1900, 2900 ] 44 0.049% 99.945% ( 2900, 4400 ] 31 0.035% 99.980% ( 4400, 6600 ] 13 0.015% 99.994% ( 6600, 9900 ] 1 0.001% 99.996% ( 14000, 22000 ] 4 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 419005 Average: 12.8710 StdDev: 156.74 Min: 1 Median: 1.9306 Max: 8587 Percentiles: P50: 1.93 P75: 2.96 P99: 13.08 P99.9: 1700.51 P99.99: 2615.80 ------------------------------------------------------ [ 0, 1 ] 13120 3.131% 3.131% # ( 1, 2 ] 211036 50.366% 53.497% ########## ( 2, 3 ] 93606 22.340% 75.837% #### ( 3, 4 ] 42481 10.139% 85.976% ## ( 4, 6 ] 40899 9.761% 95.737% ## ( 6, 10 ] 11846 2.827% 98.564% # ( 10, 15 ] 2968 0.708% 99.272% ( 15, 22 ] 419 0.100% 99.372% ( 22, 34 ] 50 0.012% 99.384% ( 34, 51 ] 27 0.006% 99.391% ( 51, 76 ] 29 0.007% 99.398% ( 76, 110 ] 54 0.013% 99.411% ( 110, 170 ] 139 0.033% 99.444% ( 170, 250 ] 132 0.032% 99.475% ( 250, 380 ] 194 0.046% 99.521% ( 380, 580 ] 345 0.082% 99.604% ( 580, 870 ] 453 0.108% 99.712% ( 870, 1300 ] 531 0.127% 99.839% ( 1300, 1900 ] 385 0.092% 99.931% ( 1900, 2900 ] 348 0.083% 100.014% ( 2900, 4400 ] 306 0.073% 100.087% ( 4400, 6600 ] 89 0.021% 100.108% ( 6600, 9900 ] 7 0.002% 100.110% ** Level 3 read latency histogram (micros): Count: 1393056 Average: 10.1465 StdDev: 157.98 Min: 1 Median: 1.9345 Max: 40406 Percentiles: P50: 1.93 P75: 2.97 P99: 10.85 P99.9: 891.27 P99.99: 1362.97 ------------------------------------------------------ [ 0, 1 ] 35360 2.538% 2.538% # ( 1, 2 ] 707473 50.786% 53.324% ########## ( 2, 3 ] 312353 22.422% 75.746% #### ( 3, 4 ] 146434 10.512% 86.258% ## ( 4, 6 ] 139230 9.995% 96.252% ## ( 6, 10 ] 36866 2.646% 98.899% # ( 10, 15 ] 8333 0.598% 99.497% ( 15, 22 ] 873 0.063% 99.560% ( 22, 34 ] 92 0.007% 99.566% ( 34, 51 ] 71 0.005% 99.571% ( 51, 76 ] 147 0.011% 99.582% ( 76, 110 ] 353 0.025% 99.607% ( 110, 170 ] 1056 0.076% 99.683% ( 170, 250 ] 466 0.033% 99.717% ( 250, 380 ] 521 0.037% 99.754% ( 380, 580 ] 831 0.060% 99.814% ( 580, 870 ] 1143 0.082% 99.896% ( 870, 1300 ] 1232 0.088% 99.984% ( 1300, 1900 ] 788 0.057% 100.041% ( 1900, 2900 ] 743 0.053% 100.094% ( 2900, 4400 ] 666 0.048% 100.142% ( 4400, 6600 ] 207 0.015% 100.157% ( 6600, 9900 ] 29 0.002% 100.159% ( 9900, 14000 ] 2 0.000% 100.159% ( 14000, 22000 ] 14 0.001% 100.160% ( 22000, 33000 ] 3 0.000% 100.160% ( 33000, 50000 ] 3 0.000% 100.160% ** Level 4 read latency histogram (micros): Count: 907661 Average: 20.5177 StdDev: 250.20 Min: 1 Median: 1.9453 Max: 59479 Percentiles: P50: 1.95 P75: 3.01 P99: 320.04 P99.9: 1836.77 P99.99: 2762.36 ------------------------------------------------------ [ 0, 1 ] 21376 2.355% 2.355% ( 1, 2 ] 457458 50.400% 52.755% ########## ( 2, 3 ] 200799 22.123% 74.877% #### ( 3, 4 ] 91341 10.063% 84.941% ## ( 4, 6 ] 84280 9.285% 94.226% ## ( 6, 10 ] 22874 2.520% 96.746% # ( 10, 15 ] 5187 0.571% 97.318% ( 15, 22 ] 512 0.056% 97.374% ( 22, 34 ] 34 0.004% 97.378% ( 34, 51 ] 68 0.007% 97.385% ( 51, 76 ] 82 0.009% 97.394% ( 76, 110 ] 2566 0.283% 97.677% ( 110, 170 ] 7776 0.857% 98.534% ( 170, 250 ] 3198 0.352% 98.886% ( 250, 380 ] 1918 0.211% 99.097% ( 380, 580 ] 2315 0.255% 99.353% ( 580, 870 ] 2127 0.234% 99.587% ( 870, 1300 ] 1852 0.204% 99.791% ( 1300, 1900 ] 1107 0.122% 99.913% ( 1900, 2900 ] 812 0.089% 100.002% ( 2900, 4400 ] 754 0.083% 100.085% ( 4400, 6600 ] 223 0.025% 100.110% ( 6600, 9900 ] 48 0.005% 100.115% ( 9900, 14000 ] 9 0.001% 100.116% ( 14000, 22000 ] 20 0.002% 100.118% ( 22000, 33000 ] 19 0.002% 100.121% ( 33000, 50000 ] 3 0.000% 100.121% ( 50000, 75000 ] 1 0.000% 100.121% ** Level 5 read latency histogram (micros): Count: 128691 Average: 436.5229 StdDev: 871.41 Min: 75 Median: 165.1334 Max: 56927 Percentiles: P50: 165.13 P75: 375.71 P99: 4218.37 P99.9: 7587.65 P99.99: 21565.45 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 17278 13.426% 13.427% ### ( 110, 170 ] 51221 39.802% 53.228% ######## ( 170, 250 ] 18764 14.581% 67.809% ### ( 250, 380 ] 9570 7.436% 75.245% # ( 380, 580 ] 10205 7.930% 83.175% ## ( 580, 870 ] 7329 5.695% 88.870% # ( 870, 1300 ] 5503 4.276% 93.146% # ( 1300, 1900 ] 3255 2.529% 95.676% # ( 1900, 2900 ] 2406 1.870% 97.545% ( 2900, 4400 ] 2130 1.655% 99.200% ( 4400, 6600 ] 862 0.670% 99.870% ( 6600, 9900 ] 128 0.099% 99.970% ( 9900, 14000 ] 11 0.009% 99.978% ( 14000, 22000 ] 16 0.012% 99.991% ( 22000, 33000 ] 7 0.005% 99.996% ( 33000, 50000 ] 7 0.005% 100.002% ( 50000, 75000 ] 2 0.002% 100.003% ** DB Stats ** Uptime(secs): 20.7 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 190.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.883 H:M:S, 28.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 281.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.074 H:M:S, 2.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 235.555 micros/op 16951 ops/sec 60.171 seconds 1019996 operations; 16.4 MB/s (260999 of 260999 found) Microseconds per read: Count: 1019996 Average: 235.5573 StdDev: 704.91 Min: 2 Median: 166.8712 Max: 81998 Percentiles: P50: 166.87 P75: 226.40 P99: 1246.76 P99.9: 10838.48 P99.99: 29838.35 ------------------------------------------------------ ( 1, 2 ] 5 0.000% 0.000% ( 2, 3 ] 37 0.004% 0.004% ( 3, 4 ] 64 0.006% 0.010% ( 4, 6 ] 94 0.009% 0.020% ( 6, 10 ] 564 0.055% 0.075% ( 10, 15 ] 5051 0.495% 0.570% ( 15, 22 ] 5434 0.533% 1.103% ( 22, 34 ] 9484 0.930% 2.033% ( 34, 51 ] 3188 0.313% 2.345% ( 51, 76 ] 459 0.045% 2.390% ( 76, 110 ] 25064 2.457% 4.847% ( 110, 170 ] 485892 47.637% 52.484% ########## ( 170, 250 ] 325776 31.939% 84.423% ###### ( 250, 380 ] 97028 9.513% 93.936% ## ( 380, 580 ] 33127 3.248% 97.183% # ( 580, 870 ] 12812 1.256% 98.440% ( 870, 1300 ] 6525 0.640% 99.079% ( 1300, 1900 ] 3398 0.333% 99.412% ( 1900, 2900 ] 2363 0.232% 99.644% ( 2900, 4400 ] 1575 0.154% 99.798% ( 4400, 6600 ] 617 0.060% 99.859% ( 6600, 9900 ] 316 0.031% 99.890% ( 9900, 14000 ] 450 0.044% 99.934% ( 14000, 22000 ] 452 0.044% 99.978% ( 22000, 33000 ] 167 0.016% 99.995% ( 33000, 50000 ] 38 0.004% 99.998% ( 50000, 75000 ] 15 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 21627625 rocksdb.bloom.filter.full.positive COUNT : 1229941 rocksdb.bloom.filter.full.true.positive COUNT : 1019579 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 417 rocksdb.memtable.miss COUNT : 1019579 rocksdb.l0.hit COUNT : 41775 rocksdb.l1.hit COUNT : 8653 rocksdb.l2andup.hit COUNT : 969151 rocksdb.compaction.key.drop.new COUNT : 239306 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4654557 rocksdb.number.keys.read COUNT : 1019996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4803502824 rocksdb.bytes.read COUNT : 1019996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1609 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 42245412 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 19037610836 rocksdb.compact.write.bytes COUNT : 18794158617 rocksdb.flush.write.bytes COUNT : 4756231996 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 28 rocksdb.number.superversion_acquires COUNT : 939 rocksdb.number.superversion_releases COUNT : 905 rocksdb.number.superversion_cleanups COUNT : 234 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 234 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4717750272 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1713152 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 23936873153 rocksdb.non.last.level.read.count COUNT : 5640289 rocksdb.block.checksum.compute.count COUNT : 5855881 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 166.082795 P95 : 444.132412 P99 : 1246.211342 P100 : 81997.000000 COUNT : 1019996 SUM : 239481270 rocksdb.db.write.micros P50 : 1.555558 P95 : 4.299257 P99 : 9.779522 P100 : 922558.000000 COUNT : 4654557 SUM : 53987785 rocksdb.compaction.times.micros P50 : 1420000.000000 P95 : 2946666.666667 P99 : 10724000.000000 P100 : 12332722.000000 COUNT : 78 SUM : 129401447 rocksdb.compaction.times.cpu_micros P50 : 850937.500000 P95 : 1764666.666667 P99 : 4339610.000000 P100 : 4339610.000000 COUNT : 78 SUM : 73709280 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 805.555556 P95 : 99500.000000 P99 : 337100.000000 P100 : 344816.000000 COUNT : 66 SUM : 1204611 rocksdb.compaction.outfile.sync.micros P50 : 52083.333333 P95 : 318611.111111 P99 : 446500.000000 P100 : 1056911.000000 COUNT : 230 SUM : 20602152 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 341.000000 P95 : 4908.750000 P99 : 7821.000000 P100 : 10705.000000 COUNT : 163 SUM : 196443 rocksdb.table.open.io.micros P50 : 8827.665996 P95 : 19847.963801 P99 : 24571.904762 P100 : 30135.000000 COUNT : 1609 SUM : 14651383 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.983889 P95 : 13.505485 P99 : 175.984631 P100 : 59483.000000 COUNT : 4611440 SUM : 77617079 rocksdb.read.block.get.micros P50 : 133.994290 P95 : 288.658046 P99 : 1165.635238 P100 : 56933.000000 COUNT : 1242822 SUM : 203099397 rocksdb.write.raw.block.micros P50 : 0.540788 P95 : 1.459996 P99 : 3.730877 P100 : 56900.000000 COUNT : 5704187 SUM : 17990527 rocksdb.numfiles.in.singlecompaction P50 : 2.625000 P95 : 5.185714 P99 : 22.360000 P100 : 27.000000 COUNT : 97 SUM : 331 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.588934 P95 : 2244.672304 P99 : 2775.564482 P100 : 922392.000000 COUNT : 156945 SUM : 42260647 rocksdb.sst.read.micros P50 : 2.381079 P95 : 164.570747 P99 : 468.760155 P100 : 59479.000000 COUNT : 5640315 SUM : 264742136 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1019996 SUM : 1019996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4654557 SUM : 4803502824 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 221764.705882 P95 : 1013000.000000 P99 : 1162600.000000 P100 : 1188871.000000 COUNT : 66 SUM : 20822227 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 245 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0