[2024-10-14 17:27:03.413167] Starting SPDK v25.01-pre git sha1 3a02df0b1 / DPDK 24.03.0 initialization... [2024-10-14 17:27:03.413436] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3099242 ] Set seed to 1728919623406469 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-14 17:27:03.531194] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-14 17:27:03.631966] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-14 17:27:03.632019] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3099242' to capture a snapshot of events at runtime. [2024-10-14 17:27:03.632030] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-14 17:27:03.632039] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-14 17:27:03.632048] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3099242 for offline analysis/debug. [2024-10-14 17:27:03.633481] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Oct 14 17:27:11 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/14-17:27:17 ... thread 0: (1000000,1000000) ops and (173850.3,173850.3) ops/second in (5.752074,5.752074) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.03 GB 88.1 0.6 0.0 0.6 1.5 0.9 0.0 1.7 79.7 191.2 7.90 5.11 13 0.608 639K 785 0.0 0.0 L1 3/3 141.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 66.91 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/1 1.06 GB 1.0 0.6 0.1 0.5 0.6 0.1 0.1 8.8 125.7 125.2 4.62 2.78 1 4.620 66K 0 0.0 0.0 L4 162/3 9.73 GB 1.0 2.8 2.0 0.7 2.8 2.0 0.3 1.4 108.0 107.0 26.52 13.76 22 1.205 540K 0 0.0 0.0 L5 1124/0 92.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1322/18 105.42 GB 0.0 4.0 2.1 1.9 4.8 2.9 5.1 5.6 104.4 126.2 39.04 21.65 36 1.085 1247K 785 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 2.1 1.9 4.8 2.9 5.1 5.6 104.4 126.2 39.04 21.65 36 1.085 1247K 785 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 2.1 1.9 3.9 2.1 0.0 0.0 120.5 119.6 33.81 19.07 25 1.352 1247K 785 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 168.5 5.23 2.58 11 0.476 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.81 GB write, 835.59 MB/s write, 3.98 GB read, 691.23 MB/s read, 39.0 seconds Interval compaction: 4.81 GB write, 856.22 MB/s write, 3.98 GB read, 708.30 MB/s read, 39.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 315869 Average: 12.4196 StdDev: 147.01 Min: 1 Median: 1.9034 Max: 8555 Percentiles: P50: 1.90 P75: 2.76 P99: 11.57 P99.9: 1929.03 P99.99: 3004.02 ------------------------------------------------------ [ 0, 1 ] 10491 3.321% 3.321% # ( 1, 2 ] 163212 51.671% 54.992% ########## ( 2, 3 ] 83506 26.437% 81.429% ##### ( 3, 4 ] 23794 7.533% 88.962% ## ( 4, 6 ] 25345 8.024% 96.986% ## ( 6, 10 ] 6046 1.914% 98.900% ( 10, 15 ] 1012 0.320% 99.220% ( 15, 22 ] 161 0.051% 99.271% ( 22, 34 ] 12 0.004% 99.275% ( 34, 51 ] 11 0.003% 99.278% ( 51, 76 ] 8 0.003% 99.281% ( 76, 110 ] 9 0.003% 99.284% ( 110, 170 ] 99 0.031% 99.315% ( 170, 250 ] 153 0.048% 99.364% ( 250, 380 ] 218 0.069% 99.433% ( 380, 580 ] 356 0.113% 99.545% ( 580, 870 ] 413 0.131% 99.676% ( 870, 1300 ] 372 0.118% 99.794% ( 1300, 1900 ] 329 0.104% 99.898% ( 1900, 2900 ] 280 0.089% 99.987% ( 2900, 4400 ] 179 0.057% 100.043% ( 4400, 6600 ] 39 0.012% 100.056% ( 6600, 9900 ] 9 0.003% 100.059% ** Level 1 read latency histogram (micros): Count: 17301 Average: 10.6575 StdDev: 142.84 Min: 1 Median: 2.0372 Max: 8130 Percentiles: P50: 2.04 P75: 2.92 P99: 11.13 P99.9: 1715.67 P99.99: 7045.33 ------------------------------------------------------ [ 0, 1 ] 296 1.711% 1.711% ( 1, 2 ] 8172 47.234% 48.945% ######### ( 2, 3 ] 4903 28.339% 77.285% ###### ( 3, 4 ] 1550 8.959% 86.244% ## ( 4, 6 ] 1707 9.866% 96.110% ## ( 6, 10 ] 486 2.809% 98.919% # ( 10, 15 ] 62 0.358% 99.277% ( 15, 22 ] 6 0.035% 99.312% ( 22, 34 ] 2 0.012% 99.324% ( 76, 110 ] 2 0.012% 99.335% ( 110, 170 ] 3 0.017% 99.353% ( 170, 250 ] 10 0.058% 99.410% ( 250, 380 ] 12 0.069% 99.480% ( 380, 580 ] 16 0.092% 99.572% ( 580, 870 ] 27 0.156% 99.728% ( 870, 1300 ] 20 0.116% 99.844% ( 1300, 1900 ] 14 0.081% 99.925% ( 1900, 2900 ] 3 0.017% 99.942% ( 2900, 4400 ] 4 0.023% 99.965% ( 4400, 6600 ] 4 0.023% 99.988% ( 6600, 9900 ] 2 0.012% 100.000% ** Level 2 read latency histogram (micros): Count: 16788 Average: 18.5810 StdDev: 226.80 Min: 1 Median: 2.1943 Max: 15911 Percentiles: P50: 2.19 P75: 2.98 P99: 283.47 P99.9: 2794.82 P99.99: 7659.96 ------------------------------------------------------ [ 0, 1 ] 293 1.745% 1.745% ( 1, 2 ] 7067 42.096% 43.841% ######## ( 2, 3 ] 5323 31.707% 75.548% ###### ( 3, 4 ] 1535 9.143% 84.691% ## ( 4, 6 ] 1728 10.293% 94.985% ## ( 6, 10 ] 511 3.044% 98.028% # ( 10, 15 ] 122 0.727% 98.755% ( 15, 22 ] 23 0.137% 98.892% ( 22, 34 ] 1 0.006% 98.898% ( 110, 170 ] 7 0.042% 98.940% ( 170, 250 ] 6 0.036% 98.975% ( 250, 380 ] 16 0.095% 99.071% ( 380, 580 ] 26 0.155% 99.226% ( 580, 870 ] 25 0.149% 99.375% ( 870, 1300 ] 36 0.214% 99.589% ( 1300, 1900 ] 37 0.220% 99.809% ( 1900, 2900 ] 17 0.101% 99.911% ( 2900, 4400 ] 5 0.030% 99.940% ( 4400, 6600 ] 8 0.048% 99.988% ( 6600, 9900 ] 1 0.006% 99.994% ( 14000, 22000 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 461832 Average: 14.0588 StdDev: 164.90 Min: 1 Median: 2.1150 Max: 7768 Percentiles: P50: 2.12 P75: 2.93 P99: 10.68 P99.9: 1575.04 P99.99: 2054.89 ------------------------------------------------------ [ 0, 1 ] 5870 1.271% 1.271% ( 1, 2 ] 208743 45.199% 46.470% ######### ( 2, 3 ] 141718 30.686% 77.156% ###### ( 3, 4 ] 41104 8.900% 86.056% ## ( 4, 6 ] 46727 10.118% 96.174% ## ( 6, 10 ] 12719 2.754% 98.928% # ( 10, 15 ] 2434 0.527% 99.455% ( 15, 22 ] 344 0.074% 99.529% ( 22, 34 ] 34 0.007% 99.537% ( 34, 51 ] 26 0.006% 99.542% ( 51, 76 ] 17 0.004% 99.546% ( 76, 110 ] 10 0.002% 99.548% ( 110, 170 ] 32 0.007% 99.555% ( 170, 250 ] 72 0.016% 99.571% ( 250, 380 ] 143 0.031% 99.602% ( 380, 580 ] 230 0.050% 99.652% ( 580, 870 ] 385 0.083% 99.735% ( 870, 1300 ] 494 0.107% 99.842% ( 1300, 1900 ] 585 0.127% 99.969% ( 1900, 2900 ] 638 0.138% 100.107% ( 2900, 4400 ] 369 0.080% 100.187% ( 4400, 6600 ] 75 0.016% 100.203% ( 6600, 9900 ] 8 0.002% 100.205% ** Level 4 read latency histogram (micros): Count: 188219 Average: 28.2732 StdDev: 248.80 Min: 1 Median: 2.0596 Max: 9658 Percentiles: P50: 2.06 P75: 2.93 P99: 813.12 P99.9: 3200.99 P99.99: 4131.75 ------------------------------------------------------ [ 0, 1 ] 3819 2.029% 2.029% ( 1, 2 ] 87068 46.259% 48.288% ######### ( 2, 3 ] 54063 28.723% 77.011% ###### ( 3, 4 ] 16671 8.857% 85.869% ## ( 4, 6 ] 17281 9.181% 95.050% ## ( 6, 10 ] 5014 2.664% 97.714% # ( 10, 15 ] 888 0.472% 98.186% ( 15, 22 ] 129 0.069% 98.254% ( 22, 34 ] 5 0.003% 98.257% ( 34, 51 ] 10 0.005% 98.262% ( 51, 76 ] 8 0.004% 98.266% ( 76, 110 ] 9 0.005% 98.271% ( 110, 170 ] 103 0.055% 98.326% ( 170, 250 ] 185 0.098% 98.424% ( 250, 380 ] 257 0.137% 98.561% ( 380, 580 ] 367 0.195% 98.756% ( 580, 870 ] 572 0.304% 99.060% ( 870, 1300 ] 552 0.293% 99.353% ( 1300, 1900 ] 482 0.256% 99.609% ( 1900, 2900 ] 493 0.262% 99.871% ( 2900, 4400 ] 273 0.145% 100.016% ( 4400, 6600 ] 93 0.049% 100.065% ( 6600, 9900 ] 12 0.006% 100.072% ** Level 5 read latency histogram (micros): Count: 10989 Average: 1463.0717 StdDev: 1480.90 Min: 85 Median: 880.2175 Max: 13634 Percentiles: P50: 880.22 P75: 2015.76 P99: 6532.72 P99.9: 9570.40 P99.99: 11747.25 ------------------------------------------------------ ( 76, 110 ] 52 0.473% 0.473% ( 110, 170 ] 453 4.122% 4.596% # ( 170, 250 ] 768 6.989% 11.584% # ( 250, 380 ] 1083 9.855% 21.440% ## ( 380, 580 ] 1442 13.122% 34.562% ### ( 580, 870 ] 1661 15.115% 49.677% ### ( 870, 1300 ] 1494 13.595% 63.272% ### ( 1300, 1900 ] 1154 10.501% 73.774% ## ( 1900, 2900 ] 1164 10.592% 84.366% ## ( 2900, 4400 ] 1041 9.473% 93.839% ## ( 4400, 6600 ] 585 5.324% 99.163% # ( 6600, 9900 ] 90 0.819% 99.982% ( 9900, 14000 ] 2 0.018% 100.000% ** DB Stats ** Uptime(secs): 5.9 total, 5.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 166.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.896 H:M:S, 32.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 171.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.896 H:M:S, 32.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-17:27:26 ... thread 0: (1000000,2000000) ops and (117779.1,140424.3) ops/second in (8.490473,14.242547) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.01 GB 163.3 2.3 0.0 2.3 4.1 1.8 0.0 2.2 132.8 240.1 17.55 14.13 33 0.532 2366K 4973 0.0 0.0 L1 3/3 141.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 66.91 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 952.44 MB 1.0 0.6 0.1 0.5 0.6 0.1 0.1 8.8 125.7 125.2 4.62 2.78 1 4.620 66K 0 0.0 0.0 L4 160/0 9.55 GB 1.0 3.0 2.2 0.9 3.0 2.1 0.3 1.4 111.4 110.2 27.89 14.89 23 1.213 566K 0 0.0 0.0 L5 1128/0 92.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/18 106.40 GB 0.0 5.9 2.2 3.6 7.7 4.0 5.4 4.2 120.2 157.2 50.06 31.80 57 0.878 2998K 4973 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 2.2 3.6 7.7 4.0 5.4 4.2 120.2 157.2 50.06 31.80 57 0.878 2998K 4973 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 2.2 3.6 5.8 2.2 0.0 0.0 144.7 143.8 41.57 26.50 30 1.386 2998K 4973 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 222.7 8.49 5.30 27 0.314 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.4 total, 14.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.68 GB write, 546.91 MB/s write, 5.88 GB read, 418.24 MB/s read, 50.1 seconds Interval compaction: 7.68 GB write, 552.36 MB/s write, 5.88 GB read, 422.41 MB/s read, 50.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 15, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 854742 Average: 17.8861 StdDev: 105.26 Min: 0 Median: 1.6369 Max: 8555 Percentiles: P50: 1.64 P75: 2.37 P99: 249.00 P99.9: 924.80 P99.99: 1924.36 ------------------------------------------------------ [ 0, 1 ] 132161 15.462% 15.462% ### ( 1, 2 ] 463499 54.227% 69.689% ########### ( 2, 3 ] 124008 14.508% 84.197% ### ( 3, 4 ] 36475 4.267% 88.464% # ( 4, 6 ] 33042 3.866% 92.330% # ( 6, 10 ] 7614 0.891% 93.221% ( 10, 15 ] 1437 0.168% 93.389% ( 15, 22 ] 249 0.029% 93.418% ( 22, 34 ] 27 0.003% 93.421% ( 34, 51 ] 13 0.002% 93.423% ( 51, 76 ] 17 0.002% 93.425% ( 76, 110 ] 2497 0.292% 93.717% ( 110, 170 ] 27668 3.237% 96.954% # ( 170, 250 ] 17710 2.072% 99.026% ( 250, 380 ] 3804 0.445% 99.471% ( 380, 580 ] 2592 0.303% 99.774% ( 580, 870 ] 1017 0.119% 99.893% ( 870, 1300 ] 465 0.054% 99.948% ( 1300, 1900 ] 356 0.042% 99.989% ( 1900, 2900 ] 309 0.036% 100.026% ( 2900, 4400 ] 193 0.023% 100.048% ( 4400, 6600 ] 39 0.005% 100.053% ( 6600, 9900 ] 9 0.001% 100.054% ** Level 1 read latency histogram (micros): Count: 17862 Average: 16.3588 StdDev: 145.55 Min: 1 Median: 2.0944 Max: 8130 Percentiles: P50: 2.09 P75: 3.02 P99: 253.09 P99.9: 1691.63 P99.99: 6952.77 ------------------------------------------------------ [ 0, 1 ] 296 1.657% 1.657% ( 1, 2 ] 8172 45.751% 47.408% ######### ( 2, 3 ] 4903 27.449% 74.857% ##### ( 3, 4 ] 1550 8.678% 83.535% ## ( 4, 6 ] 1707 9.557% 93.091% ## ( 6, 10 ] 486 2.721% 95.812% # ( 10, 15 ] 62 0.347% 96.159% ( 15, 22 ] 6 0.034% 96.193% ( 22, 34 ] 2 0.011% 96.204% ( 76, 110 ] 37 0.207% 96.411% ( 110, 170 ] 291 1.629% 98.041% ( 170, 250 ] 170 0.952% 98.992% ( 250, 380 ] 58 0.325% 99.317% ( 380, 580 ] 39 0.218% 99.535% ( 580, 870 ] 33 0.185% 99.720% ( 870, 1300 ] 23 0.129% 99.849% ( 1300, 1900 ] 14 0.078% 99.927% ( 1900, 2900 ] 3 0.017% 99.944% ( 2900, 4400 ] 4 0.022% 99.966% ( 4400, 6600 ] 4 0.022% 99.989% ( 6600, 9900 ] 2 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 17639 Average: 26.8468 StdDev: 225.84 Min: 1 Median: 2.2742 Max: 15911 Percentiles: P50: 2.27 P75: 3.36 P99: 457.18 P99.9: 2753.39 P99.99: 7379.13 ------------------------------------------------------ [ 0, 1 ] 293 1.661% 1.661% ( 1, 2 ] 7067 40.065% 41.726% ######## ( 2, 3 ] 5323 30.177% 71.903% ###### ( 3, 4 ] 1535 8.702% 80.605% ## ( 4, 6 ] 1728 9.796% 90.402% ## ( 6, 10 ] 511 2.897% 93.299% # ( 10, 15 ] 122 0.692% 93.991% ( 15, 22 ] 23 0.130% 94.121% ( 22, 34 ] 1 0.006% 94.127% ( 76, 110 ] 60 0.340% 94.467% ( 110, 170 ] 432 2.449% 96.916% ( 170, 250 ] 275 1.559% 98.475% ( 250, 380 ] 71 0.403% 98.877% ( 380, 580 ] 56 0.317% 99.195% ( 580, 870 ] 33 0.187% 99.382% ( 870, 1300 ] 39 0.221% 99.603% ( 1300, 1900 ] 37 0.210% 99.813% ( 1900, 2900 ] 18 0.102% 99.915% ( 2900, 4400 ] 5 0.028% 99.943% ( 4400, 6600 ] 8 0.045% 99.989% ( 6600, 9900 ] 1 0.006% 99.994% ( 14000, 22000 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 471370 Average: 14.4198 StdDev: 163.66 Min: 1 Median: 2.1078 Max: 7768 Percentiles: P50: 2.11 P75: 2.93 P99: 13.51 P99.9: 1565.83 P99.99: 2053.39 ------------------------------------------------------ [ 0, 1 ] 6374 1.352% 1.352% ( 1, 2 ] 213840 45.366% 46.718% ######### ( 2, 3 ] 143474 30.438% 77.156% ###### ( 3, 4 ] 41384 8.780% 85.935% ## ( 4, 6 ] 46987 9.968% 95.903% ## ( 6, 10 ] 12873 2.731% 98.634% # ( 10, 15 ] 2455 0.521% 99.155% ( 15, 22 ] 348 0.074% 99.229% ( 22, 34 ] 34 0.007% 99.236% ( 34, 51 ] 26 0.006% 99.242% ( 51, 76 ] 17 0.004% 99.245% ( 76, 110 ] 80 0.017% 99.262% ( 110, 170 ] 777 0.165% 99.427% ( 170, 250 ] 533 0.113% 99.540% ( 250, 380 ] 239 0.051% 99.591% ( 380, 580 ] 293 0.062% 99.653% ( 580, 870 ] 407 0.086% 99.739% ( 870, 1300 ] 498 0.106% 99.845% ( 1300, 1900 ] 586 0.124% 99.969% ( 1900, 2900 ] 638 0.135% 100.105% ( 2900, 4400 ] 369 0.078% 100.183% ( 4400, 6600 ] 75 0.016% 100.199% ( 6600, 9900 ] 8 0.002% 100.200% ** Level 4 read latency histogram (micros): Count: 213492 Average: 38.7744 StdDev: 239.70 Min: 1 Median: 2.1726 Max: 9658 Percentiles: P50: 2.17 P75: 3.39 P99: 741.81 P99.9: 3060.95 P99.99: 4109.00 ------------------------------------------------------ [ 0, 1 ] 4420 2.070% 2.070% ( 1, 2 ] 92599 43.374% 45.444% ######### ( 2, 3 ] 56364 26.401% 71.845% ##### ( 3, 4 ] 17205 8.059% 79.904% ## ( 4, 6 ] 18024 8.442% 88.346% ## ( 6, 10 ] 5214 2.442% 90.788% ( 10, 15 ] 928 0.435% 91.223% ( 15, 22 ] 133 0.062% 91.285% ( 22, 34 ] 6 0.003% 91.288% ( 34, 51 ] 10 0.005% 91.293% ( 51, 76 ] 8 0.004% 91.297% ( 76, 110 ] 781 0.366% 91.662% ( 110, 170 ] 8018 3.756% 95.418% # ( 170, 250 ] 4932 2.310% 97.728% ( 250, 380 ] 1295 0.607% 98.335% ( 380, 580 ] 1015 0.475% 98.810% ( 580, 870 ] 726 0.340% 99.150% ( 870, 1300 ] 577 0.270% 99.421% ( 1300, 1900 ] 491 0.230% 99.651% ( 1900, 2900 ] 503 0.236% 99.886% ( 2900, 4400 ] 275 0.129% 100.015% ( 4400, 6600 ] 93 0.044% 100.059% ( 6600, 9900 ] 12 0.006% 100.064% ** Level 5 read latency histogram (micros): Count: 122444 Average: 305.6709 StdDev: 584.60 Min: 80 Median: 167.2275 Max: 13634 Percentiles: P50: 167.23 P75: 233.90 P99: 3620.91 P99.9: 6485.51 P99.99: 9524.37 ------------------------------------------------------ ( 76, 110 ] 5719 4.671% 4.671% # ( 110, 170 ] 58192 47.525% 52.196% ########## ( 170, 250 ] 34957 28.549% 80.745% ###### ( 250, 380 ] 8495 6.938% 87.683% # ( 380, 580 ] 6239 5.095% 92.779% # ( 580, 870 ] 2984 2.437% 95.216% ( 870, 1300 ] 1717 1.402% 96.618% ( 1300, 1900 ] 1209 0.987% 97.605% ( 1900, 2900 ] 1201 0.981% 98.586% ( 2900, 4400 ] 1054 0.861% 99.447% ( 4400, 6600 ] 585 0.478% 99.925% ( 6600, 9900 ] 90 0.074% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ** DB Stats ** Uptime(secs): 14.4 total, 8.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 136.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.679 H:M:S, 46.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 115.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.783 H:M:S, 56.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-17:27:35 ... thread 0: (1000000,3000000) ops and (111425.3,129214.7) ops/second in (8.974620,23.217167) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.93 GB 282.6 4.1 0.0 4.1 6.9 2.8 0.0 2.4 150.4 255.0 27.64 23.59 54 0.512 4220K 8325 0.0 0.0 L1 3/3 141.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 66.91 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 952.44 MB 1.0 0.6 0.1 0.5 0.6 0.1 0.1 8.8 125.7 125.2 4.62 2.78 1 4.620 66K 0 0.0 0.0 L4 160/0 9.55 GB 1.0 3.0 2.2 0.9 3.0 2.1 0.3 1.4 111.4 110.2 27.89 14.89 23 1.213 566K 0 0.0 0.0 L5 1128/0 92.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1326/14 107.31 GB 0.0 7.7 2.2 5.4 10.4 5.0 5.4 3.7 130.4 177.9 60.15 41.26 78 0.771 4853K 8325 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 2.2 5.4 10.4 5.0 5.4 3.7 130.4 177.9 60.15 41.26 78 0.771 4853K 8325 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 2.2 5.4 7.6 2.2 0.0 0.0 161.9 161.0 48.45 33.27 35 1.384 4853K 8325 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 247.9 11.69 7.99 43 0.272 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.4 total, 23.2 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.45 GB write, 457.98 MB/s write, 7.66 GB read, 335.74 MB/s read, 60.1 seconds Interval compaction: 10.45 GB write, 460.78 MB/s write, 7.66 GB read, 337.79 MB/s read, 60.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 15, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1375332 Average: 20.2122 StdDev: 94.94 Min: 0 Median: 1.5878 Max: 8555 Percentiles: P50: 1.59 P75: 2.21 P99: 269.19 P99.9: 765.87 P99.99: 1447.92 ------------------------------------------------------ [ 0, 1 ] 245262 17.833% 17.833% #### ( 1, 2 ] 752614 54.722% 72.555% ########### ( 2, 3 ] 161752 11.761% 84.316% ## ( 3, 4 ] 47172 3.430% 87.746% # ( 4, 6 ] 40225 2.925% 90.671% # ( 6, 10 ] 8808 0.640% 91.311% ( 10, 15 ] 1802 0.131% 91.442% ( 15, 22 ] 311 0.023% 91.465% ( 22, 34 ] 39 0.003% 91.468% ( 34, 51 ] 14 0.001% 91.469% ( 51, 76 ] 21 0.002% 91.470% ( 76, 110 ] 5437 0.395% 91.866% ( 110, 170 ] 59634 4.336% 96.202% # ( 170, 250 ] 37367 2.717% 98.919% # ( 250, 380 ] 7598 0.552% 99.471% ( 380, 580 ] 4814 0.350% 99.821% ( 580, 870 ] 1697 0.123% 99.944% ( 870, 1300 ] 537 0.039% 99.983% ( 1300, 1900 ] 371 0.027% 100.010% ( 1900, 2900 ] 344 0.025% 100.035% ( 2900, 4400 ] 219 0.016% 100.051% ( 4400, 6600 ] 39 0.003% 100.054% ( 6600, 9900 ] 9 0.001% 100.055% ** Level 1 read latency histogram (micros): Count: 20152 Average: 21.8120 StdDev: 143.63 Min: 1 Median: 2.1908 Max: 8130 Percentiles: P50: 2.19 P75: 3.26 P99: 313.10 P99.9: 1636.34 P99.99: 6591.64 ------------------------------------------------------ [ 0, 1 ] 310 1.538% 1.538% ( 1, 2 ] 8680 43.073% 44.611% ######### ( 2, 3 ] 5693 28.250% 72.861% ###### ( 3, 4 ] 1659 8.232% 81.094% ## ( 4, 6 ] 1737 8.619% 89.713% ## ( 6, 10 ] 526 2.610% 92.323% # ( 10, 15 ] 72 0.357% 92.681% ( 15, 22 ] 7 0.035% 92.715% ( 22, 34 ] 2 0.010% 92.725% ( 76, 110 ] 84 0.417% 93.142% ( 110, 170 ] 735 3.647% 96.789% # ( 170, 250 ] 395 1.960% 98.750% ( 250, 380 ] 104 0.516% 99.266% ( 380, 580 ] 55 0.273% 99.539% ( 580, 870 ] 41 0.203% 99.742% ( 870, 1300 ] 24 0.119% 99.861% ( 1300, 1900 ] 14 0.069% 99.931% ( 1900, 2900 ] 3 0.015% 99.945% ( 2900, 4400 ] 5 0.025% 99.970% ( 4400, 6600 ] 4 0.020% 99.990% ( 6600, 9900 ] 2 0.010% 100.000% ** Level 2 read latency histogram (micros): Count: 18593 Average: 35.1894 StdDev: 224.17 Min: 1 Median: 2.3638 Max: 15911 Percentiles: P50: 2.36 P75: 3.82 P99: 523.58 P99.9: 2700.39 P99.99: 7064.31 ------------------------------------------------------ [ 0, 1 ] 293 1.576% 1.576% ( 1, 2 ] 7067 38.009% 39.585% ######## ( 2, 3 ] 5323 28.629% 68.214% ###### ( 3, 4 ] 1535 8.256% 76.470% ## ( 4, 6 ] 1728 9.294% 85.763% ## ( 6, 10 ] 511 2.748% 88.512% # ( 10, 15 ] 122 0.656% 89.168% ( 15, 22 ] 23 0.124% 89.292% ( 22, 34 ] 1 0.005% 89.297% ( 76, 110 ] 112 0.602% 89.899% ( 110, 170 ] 933 5.018% 94.917% # ( 170, 250 ] 563 3.028% 97.945% # ( 250, 380 ] 125 0.672% 98.618% ( 380, 580 ] 99 0.532% 99.150% ( 580, 870 ] 47 0.253% 99.403% ( 870, 1300 ] 41 0.221% 99.624% ( 1300, 1900 ] 37 0.199% 99.823% ( 1900, 2900 ] 18 0.097% 99.919% ( 2900, 4400 ] 5 0.027% 99.946% ( 4400, 6600 ] 8 0.043% 99.989% ( 6600, 9900 ] 1 0.005% 99.995% ( 14000, 22000 ] 1 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 473303 Average: 15.1311 StdDev: 163.90 Min: 1 Median: 2.1145 Max: 7768 Percentiles: P50: 2.11 P75: 2.94 P99: 128.79 P99.9: 1565.45 P99.99: 2054.41 ------------------------------------------------------ [ 0, 1 ] 6374 1.347% 1.347% ( 1, 2 ] 213844 45.181% 46.528% ######### ( 2, 3 ] 143480 30.315% 76.843% ###### ( 3, 4 ] 41392 8.745% 85.588% ## ( 4, 6 ] 47004 9.931% 95.519% ## ( 6, 10 ] 12874 2.720% 98.239% # ( 10, 15 ] 2455 0.519% 98.758% ( 15, 22 ] 348 0.074% 98.831% ( 22, 34 ] 34 0.007% 98.838% ( 34, 51 ] 26 0.005% 98.844% ( 51, 76 ] 17 0.004% 98.847% ( 76, 110 ] 176 0.037% 98.885% ( 110, 170 ] 1743 0.368% 99.253% ( 170, 250 ] 1135 0.240% 99.493% ( 250, 380 ] 363 0.077% 99.569% ( 380, 580 ] 372 0.079% 99.648% ( 580, 870 ] 432 0.091% 99.739% ( 870, 1300 ] 501 0.106% 99.845% ( 1300, 1900 ] 587 0.124% 99.969% ( 1900, 2900 ] 639 0.135% 100.104% ( 2900, 4400 ] 369 0.078% 100.182% ( 4400, 6600 ] 75 0.016% 100.198% ( 6600, 9900 ] 8 0.002% 100.200% ** Level 4 read latency histogram (micros): Count: 231539 Average: 49.4540 StdDev: 235.37 Min: 1 Median: 2.3292 Max: 9658 Percentiles: P50: 2.33 P75: 4.26 P99: 716.23 P99.9: 2978.03 P99.99: 4102.41 ------------------------------------------------------ [ 0, 1 ] 4420 1.909% 1.909% ( 1, 2 ] 92681 40.028% 41.937% ######## ( 2, 3 ] 56710 24.493% 66.430% ##### ( 3, 4 ] 17456 7.539% 73.969% ## ( 4, 6 ] 18393 7.944% 81.913% ## ( 6, 10 ] 5244 2.265% 84.178% ( 10, 15 ] 942 0.407% 84.584% ( 15, 22 ] 133 0.057% 84.642% ( 22, 34 ] 7 0.003% 84.645% ( 34, 51 ] 10 0.004% 84.649% ( 51, 76 ] 8 0.003% 84.653% ( 76, 110 ] 1658 0.716% 85.369% ( 110, 170 ] 16902 7.300% 92.669% # ( 170, 250 ] 10304 4.450% 97.119% # ( 250, 380 ] 2282 0.986% 98.104% ( 380, 580 ] 1656 0.715% 98.820% ( 580, 870 ] 889 0.384% 99.204% ( 870, 1300 ] 594 0.257% 99.460% ( 1300, 1900 ] 494 0.213% 99.673% ( 1900, 2900 ] 510 0.220% 99.894% ( 2900, 4400 ] 278 0.120% 100.014% ( 4400, 6600 ] 93 0.040% 100.054% ( 6600, 9900 ] 12 0.005% 100.059% ** Level 5 read latency histogram (micros): Count: 241790 Average: 246.4666 StdDev: 426.61 Min: 80 Median: 163.7647 Max: 13634 Percentiles: P50: 163.76 P75: 223.13 P99: 2344.80 P99.9: 6036.69 P99.99: 9086.77 ------------------------------------------------------ ( 76, 110 ] 11888 4.917% 4.917% # ( 110, 170 ] 121649 50.312% 55.229% ########## ( 170, 250 ] 71981 29.770% 84.999% ###### ( 250, 380 ] 15371 6.357% 91.356% # ( 380, 580 ] 10667 4.412% 95.767% # ( 580, 870 ] 4167 1.723% 97.491% ( 870, 1300 ] 1878 0.777% 98.268% ( 1300, 1900 ] 1224 0.506% 98.774% ( 1900, 2900 ] 1230 0.509% 99.282% ( 2900, 4400 ] 1058 0.438% 99.720% ( 4400, 6600 ] 585 0.242% 99.962% ( 6600, 9900 ] 90 0.037% 99.999% ( 9900, 14000 ] 2 0.001% 100.000% ** DB Stats ** Uptime(secs): 23.4 total, 9.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 126.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.953 H:M:S, 51.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 109.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.274 H:M:S, 58.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/14-17:27:45 ... thread 0: (1000000,4000000) ops and (94727.8,118435.3) ops/second in (10.556561,33.773728) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 3.74 GB 357.9 5.6 0.0 5.6 9.3 3.7 0.0 2.5 156.6 261.3 36.59 32.01 73 0.501 5818K 11K 0.0 0.0 L1 14/0 1.30 GB 133.0 1.3 1.2 0.1 1.3 1.2 0.0 1.1 40.6 40.3 32.97 10.23 1 32.973 1358K 7897 0.0 0.0 L2 1/0 66.91 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 952.44 MB 1.0 0.6 0.1 0.5 0.6 0.1 0.1 8.8 125.7 125.2 4.62 2.78 1 4.620 66K 0 0.0 0.0 L4 160/0 9.55 GB 1.0 3.0 2.2 0.9 3.0 2.1 0.3 1.4 111.4 110.2 27.89 14.89 23 1.213 566K 0 0.0 0.0 L5 1128/0 92.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1330/4 108.29 GB 0.0 10.5 3.4 7.1 14.2 7.1 5.4 3.8 105.4 142.5 102.07 59.90 98 1.042 7810K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.5 3.4 7.1 14.2 7.1 5.4 3.8 105.4 142.5 102.07 59.90 98 1.042 7810K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.5 3.4 7.1 10.5 3.4 0.0 0.0 123.2 122.6 87.32 49.31 40 2.183 7810K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 260.5 14.75 10.60 58 0.254 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.9 total, 33.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.20 GB write, 428.83 MB/s write, 10.50 GB read, 317.10 MB/s read, 102.1 seconds Interval compaction: 14.20 GB write, 430.63 MB/s write, 10.50 GB read, 318.44 MB/s read, 102.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 31, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 31, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 31, total-stops: 15, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1919483 Average: 21.5090 StdDev: 88.81 Min: 0 Median: 1.5684 Max: 8555 Percentiles: P50: 1.57 P75: 2.13 P99: 271.93 P99.9: 706.46 P99.99: 1161.70 ------------------------------------------------------ [ 0, 1 ] 363212 18.922% 18.922% #### ( 1, 2 ] 1049562 54.679% 73.602% ########### ( 2, 3 ] 200633 10.452% 84.054% ## ( 3, 4 ] 58458 3.046% 87.100% # ( 4, 6 ] 48769 2.541% 89.640% # ( 6, 10 ] 9945 0.518% 90.159% ( 10, 15 ] 2220 0.116% 90.274% ( 15, 22 ] 371 0.019% 90.294% ( 22, 34 ] 46 0.002% 90.296% ( 34, 51 ] 18 0.001% 90.297% ( 51, 76 ] 21 0.001% 90.298% ( 76, 110 ] 9344 0.487% 90.785% ( 110, 170 ] 97563 5.083% 95.868% # ( 170, 250 ] 58230 3.034% 98.901% # ( 250, 380 ] 11246 0.586% 99.487% ( 380, 580 ] 6907 0.360% 99.847% ( 580, 870 ] 2338 0.122% 99.969% ( 870, 1300 ] 603 0.031% 100.000% ( 1300, 1900 ] 384 0.020% 100.020% ( 1900, 2900 ] 366 0.019% 100.039% ( 2900, 4400 ] 229 0.012% 100.051% ( 4400, 6600 ] 39 0.002% 100.053% ( 6600, 9900 ] 9 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 38152 Average: 18.7540 StdDev: 116.88 Min: 1 Median: 2.6668 Max: 8130 Percentiles: P50: 2.67 P75: 4.23 P99: 257.42 P99.9: 1285.85 P99.99: 5601.64 ------------------------------------------------------ [ 0, 1 ] 347 0.910% 0.910% ( 1, 2 ] 11180 29.304% 30.213% ###### ( 2, 3 ] 11322 29.676% 59.889% ###### ( 3, 4 ] 5054 13.247% 73.136% ### ( 4, 6 ] 6184 16.209% 89.345% ### ( 6, 10 ] 1207 3.164% 92.509% # ( 10, 15 ] 289 0.757% 93.266% ( 15, 22 ] 133 0.349% 93.615% ( 22, 34 ] 16 0.042% 93.657% ( 34, 51 ] 1 0.003% 93.660% ( 76, 110 ] 145 0.380% 94.040% ( 110, 170 ] 1220 3.198% 97.237% # ( 170, 250 ] 663 1.738% 98.975% ( 250, 380 ] 166 0.435% 99.410% ( 380, 580 ] 101 0.265% 99.675% ( 580, 870 ] 52 0.136% 99.811% ( 870, 1300 ] 35 0.092% 99.903% ( 1300, 1900 ] 17 0.045% 99.948% ( 1900, 2900 ] 6 0.016% 99.963% ( 2900, 4400 ] 8 0.021% 99.984% ( 4400, 6600 ] 4 0.010% 99.995% ( 6600, 9900 ] 2 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 19691 Average: 43.0941 StdDev: 221.22 Min: 1 Median: 2.4669 Max: 15911 Percentiles: P50: 2.47 P75: 4.64 P99: 535.69 P99.9: 2639.39 P99.99: 6701.97 ------------------------------------------------------ [ 0, 1 ] 293 1.488% 1.488% ( 1, 2 ] 7067 35.889% 37.377% ####### ( 2, 3 ] 5323 27.033% 64.410% ##### ( 3, 4 ] 1535 7.795% 72.206% ## ( 4, 6 ] 1728 8.776% 80.981% ## ( 6, 10 ] 511 2.595% 83.576% # ( 10, 15 ] 122 0.620% 84.196% ( 15, 22 ] 23 0.117% 84.313% ( 22, 34 ] 1 0.005% 84.318% ( 76, 110 ] 179 0.909% 85.227% ( 110, 170 ] 1566 7.953% 93.180% ## ( 170, 250 ] 857 4.352% 97.532% # ( 250, 380 ] 184 0.934% 98.466% ( 380, 580 ] 135 0.686% 99.152% ( 580, 870 ] 55 0.279% 99.431% ( 870, 1300 ] 42 0.213% 99.645% ( 1300, 1900 ] 37 0.188% 99.832% ( 1900, 2900 ] 18 0.091% 99.924% ( 2900, 4400 ] 5 0.025% 99.949% ( 4400, 6600 ] 8 0.041% 99.990% ( 6600, 9900 ] 1 0.005% 99.995% ( 14000, 22000 ] 1 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 475574 Average: 15.9271 StdDev: 164.05 Min: 1 Median: 2.1224 Max: 7768 Percentiles: P50: 2.12 P75: 2.95 P99: 163.75 P99.9: 1563.70 P99.99: 2054.06 ------------------------------------------------------ [ 0, 1 ] 6374 1.340% 1.340% ( 1, 2 ] 213844 44.965% 46.306% ######### ( 2, 3 ] 143480 30.170% 76.476% ###### ( 3, 4 ] 41392 8.704% 85.179% ## ( 4, 6 ] 47004 9.884% 95.063% ## ( 6, 10 ] 12874 2.707% 97.770% # ( 10, 15 ] 2455 0.516% 98.286% ( 15, 22 ] 348 0.073% 98.359% ( 22, 34 ] 34 0.007% 98.366% ( 34, 51 ] 26 0.005% 98.372% ( 51, 76 ] 17 0.004% 98.375% ( 76, 110 ] 308 0.065% 98.440% ( 110, 170 ] 2972 0.625% 99.065% ( 170, 250 ] 1820 0.383% 99.448% ( 250, 380 ] 492 0.103% 99.551% ( 380, 580 ] 445 0.094% 99.645% ( 580, 870 ] 452 0.095% 99.740% ( 870, 1300 ] 503 0.106% 99.846% ( 1300, 1900 ] 588 0.124% 99.969% ( 1900, 2900 ] 639 0.134% 100.104% ( 2900, 4400 ] 369 0.078% 100.181% ( 4400, 6600 ] 75 0.016% 100.197% ( 6600, 9900 ] 8 0.002% 100.199% ** Level 4 read latency histogram (micros): Count: 253048 Average: 60.6933 StdDev: 230.22 Min: 1 Median: 2.5178 Max: 9658 Percentiles: P50: 2.52 P75: 5.98 P99: 705.30 P99.9: 2890.14 P99.99: 4093.01 ------------------------------------------------------ [ 0, 1 ] 4420 1.747% 1.747% ( 1, 2 ] 92703 36.635% 38.381% ####### ( 2, 3 ] 56776 22.437% 60.818% #### ( 3, 4 ] 17517 6.922% 67.741% # ( 4, 6 ] 18513 7.316% 75.057% # ( 6, 10 ] 5253 2.076% 77.132% ( 10, 15 ] 948 0.375% 77.507% ( 15, 22 ] 135 0.053% 77.560% ( 22, 34 ] 7 0.003% 77.563% ( 34, 51 ] 10 0.004% 77.567% ( 51, 76 ] 8 0.003% 77.570% ( 76, 110 ] 2741 1.083% 78.653% ( 110, 170 ] 28571 11.291% 89.944% ## ( 170, 250 ] 16627 6.571% 96.515% # ( 250, 380 ] 3401 1.344% 97.859% ( 380, 580 ] 2401 0.949% 98.808% ( 580, 870 ] 1126 0.445% 99.253% ( 870, 1300 ] 633 0.250% 99.503% ( 1300, 1900 ] 498 0.197% 99.700% ( 1900, 2900 ] 512 0.202% 99.902% ( 2900, 4400 ] 280 0.111% 100.013% ( 4400, 6600 ] 93 0.037% 100.049% ( 6600, 9900 ] 12 0.005% 100.054% ** Level 5 read latency histogram (micros): Count: 381886 Average: 223.1161 StdDev: 346.33 Min: 80 Median: 161.8537 Max: 13634 Percentiles: P50: 161.85 P75: 218.21 P99: 1505.99 P99.9: 5509.83 P99.99: 8573.08 ------------------------------------------------------ ( 76, 110 ] 19392 5.078% 5.078% # ( 110, 170 ] 198502 51.979% 57.057% ########## ( 170, 250 ] 113703 29.774% 86.831% ###### ( 250, 380 ] 22975 6.016% 92.848% # ( 380, 580 ] 15488 4.056% 96.903% # ( 580, 870 ] 5503 1.441% 98.344% ( 870, 1300 ] 2075 0.543% 98.888% ( 1300, 1900 ] 1250 0.327% 99.215% ( 1900, 2900 ] 1259 0.330% 99.545% ( 2900, 4400 ] 1062 0.278% 99.823% ( 4400, 6600 ] 585 0.153% 99.976% ( 6600, 9900 ] 90 0.024% 99.999% ( 9900, 14000 ] 2 0.001% 100.000% ** DB Stats ** Uptime(secs): 33.9 total, 10.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 116.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.829 H:M:S, 55.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 93.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.876 H:M:S, 65.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 237.960 micros/op 16801 ops/sec 60.112 seconds 1009996 operations; 16.3 MB/s (248999 of 248999 found) Microseconds per read: Count: 1009996 Average: 237.9613 StdDev: 641.06 Min: 2 Median: 196.2063 Max: 81464 Percentiles: P50: 196.21 P75: 238.90 P99: 803.82 P99.9: 8851.82 P99.99: 29894.14 ------------------------------------------------------ ( 1, 2 ] 7 0.001% 0.001% ( 2, 3 ] 34 0.003% 0.004% ( 3, 4 ] 49 0.005% 0.009% ( 4, 6 ] 71 0.007% 0.016% ( 6, 10 ] 371 0.037% 0.053% ( 10, 15 ] 4692 0.465% 0.517% ( 15, 22 ] 5181 0.513% 1.030% ( 22, 34 ] 10802 1.070% 2.100% ( 34, 51 ] 2932 0.290% 2.390% ( 51, 76 ] 374 0.037% 2.427% ( 76, 110 ] 4766 0.472% 2.899% ( 110, 170 ] 320740 31.757% 34.655% ###### ( 170, 250 ] 473104 46.842% 81.498% ######### ( 250, 380 ] 111708 11.060% 92.558% ## ( 380, 580 ] 53374 5.285% 97.842% # ( 580, 870 ] 15148 1.500% 99.342% ( 870, 1300 ] 3542 0.351% 99.693% ( 1300, 1900 ] 906 0.090% 99.783% ( 1900, 2900 ] 590 0.058% 99.841% ( 2900, 4400 ] 296 0.029% 99.870% ( 4400, 6600 ] 125 0.012% 99.883% ( 6600, 9900 ] 255 0.025% 99.908% ( 9900, 14000 ] 369 0.037% 99.945% ( 14000, 22000 ] 337 0.033% 99.978% ( 22000, 33000 ] 170 0.017% 99.995% ( 33000, 50000 ] 43 0.004% 99.999% ( 50000, 75000 ] 9 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 16922742 rocksdb.bloom.filter.full.positive COUNT : 1173463 rocksdb.bloom.filter.full.true.positive COUNT : 1009588 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 408 rocksdb.memtable.miss COUNT : 1009588 rocksdb.l0.hit COUNT : 38737 rocksdb.l1.hit COUNT : 8040 rocksdb.l2andup.hit COUNT : 962811 rocksdb.compaction.key.drop.new COUNT : 80786 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4139342 rocksdb.number.keys.read COUNT : 1009996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4271800944 rocksdb.bytes.read COUNT : 1009996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1472 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44071140 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 12831978104 rocksdb.compact.write.bytes COUNT : 12746808928 rocksdb.flush.write.bytes COUNT : 4227821733 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 50 rocksdb.number.superversion_acquires COUNT : 696 rocksdb.number.superversion_releases COUNT : 669 rocksdb.number.superversion_cleanups COUNT : 177 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 142 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4193596416 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1519616 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 17331623743 rocksdb.non.last.level.read.count COUNT : 4041976 rocksdb.block.checksum.compute.count COUNT : 4292146 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 195.094822 P95 : 470.739500 P99 : 802.826613 P100 : 81462.000000 COUNT : 1009996 SUM : 239339345 rocksdb.db.write.micros P50 : 1.513689 P95 : 4.718249 P99 : 13.441870 P100 : 836097.000000 COUNT : 4139342 SUM : 54384367 rocksdb.compaction.times.micros P50 : 1093750.000000 P95 : 4276666.666667 P99 : 28490000.000000 P100 : 32972820.000000 COUNT : 41 SUM : 88296277 rocksdb.compaction.times.cpu_micros P50 : 894000.000000 P95 : 3810000.000000 P99 : 10225611.000000 P100 : 10225611.000000 COUNT : 41 SUM : 50262979 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 879.772727 P95 : 4325.000000 P99 : 19207.000000 P100 : 19207.000000 COUNT : 61 SUM : 101035 rocksdb.compaction.outfile.sync.micros P50 : 2707.692308 P95 : 40437.500000 P99 : 108250.000000 P100 : 247914.000000 COUNT : 105 SUM : 1182513 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 161.000000 P95 : 3962.500000 P99 : 5967.500000 P100 : 6297.000000 COUNT : 115 SUM : 95095 rocksdb.table.open.io.micros P50 : 9144.171779 P95 : 20643.346008 P99 : 27416.551724 P100 : 29439.000000 COUNT : 1472 SUM : 14478411 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.869636 P95 : 139.869352 P99 : 242.385511 P100 : 16462.000000 COUNT : 3107304 SUM : 66202476 rocksdb.read.block.get.micros P50 : 153.005383 P95 : 314.859749 P99 : 675.448378 P100 : 16253.000000 COUNT : 1183330 SUM : 205241427 rocksdb.write.raw.block.micros P50 : 0.553492 P95 : 1.655370 P99 : 3.968547 P100 : 13865.000000 COUNT : 4111228 SUM : 11304727 rocksdb.numfiles.in.singlecompaction P50 : 3.187500 P95 : 5.266667 P99 : 24.000000 P100 : 24.000000 COUNT : 62 SUM : 234 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.573734 P95 : 1271.786411 P99 : 2675.748538 P100 : 835956.000000 COUNT : 230882 SUM : 44091221 rocksdb.sst.read.micros P50 : 2.436050 P95 : 226.751697 P99 : 462.803778 P100 : 15911.000000 COUNT : 4041994 SUM : 256498688 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1009996 SUM : 1009996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4139342 SUM : 4271800944 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 216923.076923 P95 : 661833.333333 P99 : 992600.000000 P100 : 1059996.000000 COUNT : 61 SUM : 15356839 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 144 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0