[2024-07-12 12:30:22.754666] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-12 12:30:22.754923] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2819323 ] Set seed to 1720780222748186 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-12 12:30:22.866150] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-12 12:30:23.086670] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-12 12:30:23.086718] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2819323' to capture a snapshot of events at runtime. [2024-07-12 12:30:23.086727] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2819323 for offline analysis/debug. [2024-07-12 12:30:23.086753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 12 12:30:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/12-12:30:40 ... thread 0: (1000000,1000000) ops and (127528.3,127528.3) ops/second in (7.841395,7.841395) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.01 GB 37.7 0.4 0.0 0.4 1.2 0.8 0.0 1.5 36.0 113.8 10.51 4.33 10 1.051 383K 535 0.0 0.0 L1 9/9 980.48 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 29.57 MB 0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 25/8 1.83 GB 1.2 1.1 0.8 0.4 1.1 0.7 0.1 1.5 101.8 100.4 11.38 5.65 3 3.794 523K 0 0.0 0.0 L4 189/21 11.62 GB 1.1 4.3 2.0 2.3 4.3 2.0 0.0 2.1 94.9 93.2 46.85 22.74 18 2.603 799K 0 0.0 0.0 L5 1104/0 90.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1341/50 107.24 GB 0.0 5.8 2.8 3.1 6.5 3.5 0.1 8.2 87.0 97.6 68.74 32.72 31 2.217 1706K 535 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 2.8 3.1 6.5 3.5 0.1 8.2 87.0 97.6 68.74 32.72 31 2.217 1706K 535 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 2.8 3.1 5.7 2.7 0.0 0.0 97.3 95.8 61.49 30.19 22 2.795 1706K 535 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 112.9 7.25 2.54 9 0.806 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.55 GB write, 835.55 MB/s write, 5.84 GB read, 745.36 MB/s read, 68.7 seconds Interval compaction: 6.55 GB write, 855.08 MB/s write, 5.84 GB read, 762.78 MB/s read, 68.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 28, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 249999 Average: 22.8022 StdDev: 384.75 Min: 1 Median: 1.9013 Max: 38455 Percentiles: P50: 1.90 P75: 2.90 P99: 14.46 P99.9: 3328.58 P99.99: 6170.12 ------------------------------------------------------ [ 0, 1 ] 9112 3.645% 3.645% # ( 1, 2 ] 128575 51.430% 55.075% ########## ( 2, 3 ] 55101 22.040% 77.116% #### ( 3, 4 ] 22160 8.864% 85.980% ## ( 4, 6 ] 25047 10.019% 95.998% ## ( 6, 10 ] 6056 2.422% 98.421% ( 10, 15 ] 1623 0.649% 99.070% ( 15, 22 ] 172 0.069% 99.139% ( 22, 34 ] 12 0.005% 99.144% ( 34, 51 ] 7 0.003% 99.146% ( 51, 76 ] 4 0.002% 99.148% ( 76, 110 ] 6 0.002% 99.150% ( 110, 170 ] 13 0.005% 99.156% ( 170, 250 ] 32 0.013% 99.168% ( 250, 380 ] 50 0.020% 99.188% ( 380, 580 ] 136 0.054% 99.243% ( 580, 870 ] 260 0.104% 99.347% ( 870, 1300 ] 453 0.181% 99.528% ( 1300, 1900 ] 475 0.190% 99.718% ( 1900, 2900 ] 393 0.157% 99.875% ( 2900, 4400 ] 217 0.087% 99.962% ( 4400, 6600 ] 87 0.035% 99.997% ( 6600, 9900 ] 32 0.013% 100.010% ( 9900, 14000 ] 10 0.004% 100.014% ( 14000, 22000 ] 17 0.007% 100.020% ( 22000, 33000 ] 18 0.007% 100.028% ( 33000, 50000 ] 5 0.002% 100.030% ** Level 1 read latency histogram (micros): Count: 86 Average: 3466.0581 StdDev: 2755.63 Min: 54 Median: 2525.0000 Max: 9648 Percentiles: P50: 2525.00 P75: 5758.82 P99: 9648.00 P99.9: 9648.00 P99.99: 9648.00 ------------------------------------------------------ ( 51, 76 ] 1 1.163% 1.163% ( 170, 250 ] 2 2.326% 3.488% ( 380, 580 ] 3 3.488% 6.977% # ( 580, 870 ] 8 9.302% 16.279% ## ( 870, 1300 ] 16 18.605% 34.884% #### ( 1300, 1900 ] 8 9.302% 44.186% ## ( 1900, 2900 ] 8 9.302% 53.488% ## ( 2900, 4400 ] 8 9.302% 62.791% ## ( 4400, 6600 ] 17 19.767% 82.558% #### ( 6600, 9900 ] 15 17.442% 100.000% ### ** Level 2 read latency histogram (micros): Count: 110297 Average: 18.5370 StdDev: 295.56 Min: 1 Median: 2.0240 Max: 30257 Percentiles: P50: 2.02 P75: 3.00 P99: 13.72 P99.9: 2600.70 P99.99: 3750.06 ------------------------------------------------------ [ 0, 1 ] 2519 2.284% 2.284% ( 1, 2 ] 51949 47.099% 49.383% ######### ( 2, 3 ] 28343 25.697% 75.080% ##### ( 3, 4 ] 10648 9.654% 84.734% ## ( 4, 6 ] 11926 10.813% 95.547% ## ( 6, 10 ] 3148 2.854% 98.401% # ( 10, 15 ] 891 0.808% 99.209% ( 15, 22 ] 143 0.130% 99.338% ( 22, 34 ] 14 0.013% 99.351% ( 34, 51 ] 6 0.005% 99.356% ( 51, 76 ] 8 0.007% 99.364% ( 76, 110 ] 3 0.003% 99.366% ( 110, 170 ] 3 0.003% 99.369% ( 170, 250 ] 8 0.007% 99.376% ( 250, 380 ] 15 0.014% 99.390% ( 380, 580 ] 36 0.033% 99.422% ( 580, 870 ] 81 0.073% 99.496% ( 870, 1300 ] 158 0.143% 99.639% ( 1300, 1900 ] 185 0.168% 99.807% ( 1900, 2900 ] 148 0.134% 99.941% ( 2900, 4400 ] 97 0.088% 100.029% ( 4400, 6600 ] 27 0.024% 100.053% ( 6600, 9900 ] 10 0.009% 100.063% ( 9900, 14000 ] 2 0.002% 100.064% ( 14000, 22000 ] 4 0.004% 100.068% ( 22000, 33000 ] 7 0.006% 100.074% ** Level 3 read latency histogram (micros): Count: 431941 Average: 15.3067 StdDev: 274.95 Min: 1 Median: 1.9744 Max: 39966 Percentiles: P50: 1.97 P75: 2.97 P99: 12.04 P99.9: 1679.28 P99.99: 2409.15 ------------------------------------------------------ [ 0, 1 ] 10041 2.325% 2.325% ( 1, 2 ] 211342 48.928% 51.253% ########## ( 2, 3 ] 106235 24.595% 75.848% ##### ( 3, 4 ] 39995 9.259% 85.107% ## ( 4, 6 ] 46750 10.823% 95.930% ## ( 6, 10 ] 11892 2.753% 98.684% # ( 10, 15 ] 3357 0.777% 99.461% ( 15, 22 ] 449 0.104% 99.565% ( 22, 34 ] 36 0.008% 99.573% ( 34, 51 ] 12 0.003% 99.576% ( 51, 76 ] 25 0.006% 99.582% ( 76, 110 ] 11 0.003% 99.584% ( 110, 170 ] 14 0.003% 99.587% ( 170, 250 ] 23 0.005% 99.593% ( 250, 380 ] 92 0.021% 99.614% ( 380, 580 ] 171 0.040% 99.654% ( 580, 870 ] 308 0.071% 99.725% ( 870, 1300 ] 452 0.105% 99.830% ( 1300, 1900 ] 481 0.111% 99.941% ( 1900, 2900 ] 416 0.096% 100.037% ( 2900, 4400 ] 278 0.064% 100.102% ( 4400, 6600 ] 116 0.027% 100.128% ( 6600, 9900 ] 29 0.007% 100.135% ( 9900, 14000 ] 15 0.003% 100.139% ( 14000, 22000 ] 20 0.005% 100.143% ( 22000, 33000 ] 12 0.003% 100.146% ( 33000, 50000 ] 3 0.001% 100.147% ** Level 4 read latency histogram (micros): Count: 648991 Average: 26.9256 StdDev: 385.68 Min: 0 Median: 1.9579 Max: 55993 Percentiles: P50: 1.96 P75: 2.96 P99: 14.95 P99.9: 2750.83 P99.99: 3560.17 ------------------------------------------------------ [ 0, 1 ] 16160 2.490% 2.490% ( 1, 2 ] 321886 49.598% 52.088% ########## ( 2, 3 ] 155701 23.991% 76.079% ##### ( 3, 4 ] 59331 9.142% 85.221% ## ( 4, 6 ] 67695 10.431% 95.652% ## ( 6, 10 ] 16769 2.584% 98.236% # ( 10, 15 ] 5008 0.772% 99.008% ( 15, 22 ] 622 0.096% 99.103% ( 22, 34 ] 52 0.008% 99.111% ( 34, 51 ] 25 0.004% 99.115% ( 51, 76 ] 25 0.004% 99.119% ( 76, 110 ] 22 0.003% 99.122% ( 110, 170 ] 23 0.004% 99.126% ( 170, 250 ] 95 0.015% 99.141% ( 250, 380 ] 134 0.021% 99.161% ( 380, 580 ] 364 0.056% 99.217% ( 580, 870 ] 719 0.111% 99.328% ( 870, 1300 ] 1185 0.183% 99.511% ( 1300, 1900 ] 1393 0.215% 99.725% ( 1900, 2900 ] 1334 0.206% 99.931% ( 2900, 4400 ] 875 0.135% 100.066% ( 4400, 6600 ] 352 0.054% 100.120% ( 6600, 9900 ] 112 0.017% 100.137% ( 9900, 14000 ] 27 0.004% 100.141% ( 14000, 22000 ] 49 0.008% 100.149% ( 22000, 33000 ] 38 0.006% 100.155% ( 33000, 50000 ] 3 0.000% 100.155% ( 50000, 75000 ] 2 0.000% 100.156% ** Level 5 read latency histogram (micros): Count: 8667 Average: 2564.5948 StdDev: 2930.55 Min: 111 Median: 1811.1332 Max: 58138 Percentiles: P50: 1811.13 P75: 3474.24 P99: 9838.85 P99.9: 41904.36 P99.99: 58138.00 ------------------------------------------------------ ( 110, 170 ] 16 0.185% 0.185% ( 170, 250 ] 59 0.681% 0.865% ( 250, 380 ] 195 2.250% 3.115% ( 380, 580 ] 501 5.781% 8.896% # ( 580, 870 ] 875 10.096% 18.992% ## ( 870, 1300 ] 1402 16.176% 35.168% ### ( 1300, 1900 ] 1509 17.411% 52.579% ### ( 1900, 2900 ] 1405 16.211% 68.790% ### ( 2900, 4400 ] 1406 16.222% 85.012% ### ( 4400, 6600 ] 965 11.134% 96.146% ## ( 6600, 9900 ] 252 2.908% 99.054% # ( 9900, 14000 ] 22 0.254% 99.308% ( 14000, 22000 ] 23 0.265% 99.573% ( 22000, 33000 ] 21 0.242% 99.815% ( 33000, 50000 ] 14 0.162% 99.977% ( 50000, 75000 ] 3 0.035% 100.012% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 122.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.900 H:M:S, 48.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.900 H:M:S, 49.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/12-12:30:44 ... thread 0: (1000000,2000000) ops and (242520.8,167157.7) ops/second in (4.123357,11.964752) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.05 GB 163.6 1.3 0.0 1.3 3.1 1.8 0.0 1.7 70.5 171.2 18.75 11.08 29 0.647 1343K 1806 0.0 0.0 L1 9/9 980.48 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 29.57 MB 0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 972.13 MB 1.0 1.1 0.8 0.4 1.1 0.7 0.1 1.5 101.8 100.4 11.38 5.65 3 3.794 523K 0 0.0 0.0 L4 163/0 9.45 GB 1.0 6.3 2.8 3.5 6.2 2.7 0.1 2.2 103.8 101.9 62.26 32.05 27 2.306 1903K 7169 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/20 108.25 GB 0.0 8.7 3.6 5.1 10.4 5.3 3.2 5.7 96.8 115.8 92.39 48.79 59 1.566 3769K 8975 0.0 0.0 Int 0/0 0.00 KB 0.0 8.7 3.6 5.1 10.4 5.3 3.2 5.7 96.8 115.8 92.39 48.79 59 1.566 3769K 8975 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.7 3.6 5.1 8.6 3.5 0.0 0.0 110.3 108.7 81.07 43.25 34 2.384 3769K 8975 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 166.9 11.32 5.54 25 0.453 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.45 GB write, 880.53 MB/s write, 8.73 GB read, 735.94 MB/s read, 92.4 seconds Interval compaction: 10.45 GB write, 894.02 MB/s write, 8.73 GB read, 747.21 MB/s read, 92.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 40, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 635596 Average: 15.8472 StdDev: 252.54 Min: 1 Median: 1.7441 Max: 38455 Percentiles: P50: 1.74 P75: 2.59 P99: 232.58 P99.9: 1835.50 P99.99: 3145.69 ------------------------------------------------------ [ 0, 1 ] 51409 8.088% 8.088% ## ( 1, 2 ] 357984 56.323% 64.411% ########### ( 2, 3 ] 114484 18.012% 82.423% #### ( 3, 4 ] 41626 6.549% 88.972% # ( 4, 6 ] 43876 6.903% 95.875% # ( 6, 10 ] 10526 1.656% 97.531% ( 10, 15 ] 2666 0.419% 97.951% ( 15, 22 ] 299 0.047% 97.998% ( 22, 34 ] 27 0.004% 98.002% ( 34, 51 ] 12 0.002% 98.004% ( 51, 76 ] 14 0.002% 98.006% ( 76, 110 ] 355 0.056% 98.062% ( 110, 170 ] 3495 0.550% 98.612% ( 170, 250 ] 3155 0.496% 99.108% ( 250, 380 ] 1629 0.256% 99.365% ( 380, 580 ] 1272 0.200% 99.565% ( 580, 870 ] 885 0.139% 99.704% ( 870, 1300 ] 736 0.116% 99.820% ( 1300, 1900 ] 573 0.090% 99.910% ( 1900, 2900 ] 469 0.074% 99.984% ( 2900, 4400 ] 253 0.040% 100.023% ( 4400, 6600 ] 90 0.014% 100.038% ( 6600, 9900 ] 36 0.006% 100.043% ( 9900, 14000 ] 13 0.002% 100.045% ( 14000, 22000 ] 18 0.003% 100.048% ( 22000, 33000 ] 18 0.003% 100.051% ( 33000, 50000 ] 5 0.001% 100.052% ** Level 1 read latency histogram (micros): Count: 21823 Average: 25.4926 StdDev: 288.10 Min: 1 Median: 3.4676 Max: 9648 Percentiles: P50: 3.47 P75: 5.16 P99: 351.80 P99.9: 5717.02 P99.99: 9419.89 ------------------------------------------------------ [ 0, 1 ] 121 0.554% 0.554% ( 1, 2 ] 3829 17.546% 18.100% #### ( 2, 3 ] 5375 24.630% 42.730% ##### ( 3, 4 ] 3393 15.548% 58.278% ### ( 4, 6 ] 6289 28.818% 87.096% ###### ( 6, 10 ] 1695 7.767% 94.863% ## ( 10, 15 ] 365 1.673% 96.536% ( 15, 22 ] 172 0.788% 97.324% ( 22, 34 ] 26 0.119% 97.443% ( 34, 51 ] 4 0.018% 97.461% ( 51, 76 ] 1 0.005% 97.466% ( 76, 110 ] 10 0.046% 97.512% ( 110, 170 ] 142 0.651% 98.162% ( 170, 250 ] 135 0.619% 98.781% ( 250, 380 ] 61 0.280% 99.061% ( 380, 580 ] 57 0.261% 99.322% ( 580, 870 ] 48 0.220% 99.542% ( 870, 1300 ] 27 0.124% 99.665% ( 1300, 1900 ] 17 0.078% 99.743% ( 1900, 2900 ] 13 0.060% 99.803% ( 2900, 4400 ] 11 0.050% 99.853% ( 4400, 6600 ] 17 0.078% 99.931% ( 6600, 9900 ] 15 0.069% 100.000% ** Level 2 read latency histogram (micros): Count: 130716 Average: 16.2856 StdDev: 274.14 Min: 1 Median: 2.0017 Max: 30257 Percentiles: P50: 2.00 P75: 2.98 P99: 13.11 P99.9: 2469.49 P99.99: 3733.94 ------------------------------------------------------ [ 0, 1 ] 2960 2.264% 2.264% ( 1, 2 ] 62343 47.693% 49.958% ########## ( 2, 3 ] 33296 25.472% 75.430% ##### ( 3, 4 ] 12530 9.586% 85.016% ## ( 4, 6 ] 13955 10.676% 95.691% ## ( 6, 10 ] 3679 2.814% 98.506% # ( 10, 15 ] 1037 0.793% 99.299% ( 15, 22 ] 160 0.122% 99.422% ( 22, 34 ] 16 0.012% 99.434% ( 34, 51 ] 6 0.005% 99.438% ( 51, 76 ] 9 0.007% 99.445% ( 76, 110 ] 4 0.003% 99.448% ( 110, 170 ] 8 0.006% 99.455% ( 170, 250 ] 14 0.011% 99.465% ( 250, 380 ] 16 0.012% 99.477% ( 380, 580 ] 37 0.028% 99.506% ( 580, 870 ] 84 0.064% 99.570% ( 870, 1300 ] 161 0.123% 99.693% ( 1300, 1900 ] 186 0.142% 99.836% ( 1900, 2900 ] 148 0.113% 99.949% ( 2900, 4400 ] 97 0.074% 100.023% ( 4400, 6600 ] 27 0.021% 100.044% ( 6600, 9900 ] 10 0.008% 100.051% ( 9900, 14000 ] 3 0.002% 100.054% ( 14000, 22000 ] 4 0.003% 100.057% ( 22000, 33000 ] 7 0.005% 100.062% ** Level 3 read latency histogram (micros): Count: 529386 Average: 13.7843 StdDev: 252.71 Min: 1 Median: 1.9557 Max: 39966 Percentiles: P50: 1.96 P75: 2.94 P99: 11.98 P99.9: 1562.42 P99.99: 2305.97 ------------------------------------------------------ [ 0, 1 ] 12531 2.367% 2.367% ( 1, 2 ] 263858 49.842% 52.209% ########## ( 2, 3 ] 127968 24.173% 76.382% ##### ( 3, 4 ] 48246 9.114% 85.496% ## ( 4, 6 ] 55663 10.515% 96.010% ## ( 6, 10 ] 14287 2.699% 98.709% # ( 10, 15 ] 3885 0.734% 99.443% ( 15, 22 ] 502 0.095% 99.538% ( 22, 34 ] 43 0.008% 99.546% ( 34, 51 ] 14 0.003% 99.549% ( 51, 76 ] 33 0.006% 99.555% ( 76, 110 ] 26 0.005% 99.560% ( 110, 170 ] 154 0.029% 99.589% ( 170, 250 ] 145 0.027% 99.616% ( 250, 380 ] 155 0.029% 99.646% ( 380, 580 ] 240 0.045% 99.691% ( 580, 870 ] 373 0.070% 99.761% ( 870, 1300 ] 504 0.095% 99.857% ( 1300, 1900 ] 525 0.099% 99.956% ( 1900, 2900 ] 446 0.084% 100.040% ( 2900, 4400 ] 281 0.053% 100.093% ( 4400, 6600 ] 116 0.022% 100.115% ( 6600, 9900 ] 30 0.006% 100.121% ( 9900, 14000 ] 18 0.003% 100.124% ( 14000, 22000 ] 21 0.004% 100.128% ( 22000, 33000 ] 12 0.002% 100.130% ( 33000, 50000 ] 3 0.001% 100.131% ** Level 4 read latency histogram (micros): Count: 822508 Average: 24.3960 StdDev: 347.87 Min: 0 Median: 1.9430 Max: 55993 Percentiles: P50: 1.94 P75: 2.94 P99: 211.08 P99.9: 2543.00 P99.99: 3289.09 ------------------------------------------------------ [ 0, 1 ] 20493 2.492% 2.492% ( 1, 2 ] 414373 50.379% 52.871% ########## ( 2, 3 ] 194515 23.649% 76.520% ##### ( 3, 4 ] 73394 8.923% 85.443% ## ( 4, 6 ] 81842 9.950% 95.393% ## ( 6, 10 ] 20721 2.519% 97.912% # ( 10, 15 ] 5934 0.721% 98.634% ( 15, 22 ] 720 0.088% 98.721% ( 22, 34 ] 62 0.008% 98.729% ( 34, 51 ] 34 0.004% 98.733% ( 51, 76 ] 38 0.005% 98.738% ( 76, 110 ] 129 0.016% 98.753% ( 110, 170 ] 1363 0.166% 98.919% ( 170, 250 ] 1295 0.157% 99.077% ( 250, 380 ] 775 0.094% 99.171% ( 380, 580 ] 973 0.118% 99.289% ( 580, 870 ] 1153 0.140% 99.429% ( 870, 1300 ] 1450 0.176% 99.606% ( 1300, 1900 ] 1511 0.184% 99.789% ( 1900, 2900 ] 1416 0.172% 99.961% ( 2900, 4400 ] 905 0.110% 100.071% ( 4400, 6600 ] 362 0.044% 100.116% ( 6600, 9900 ] 114 0.014% 100.129% ( 9900, 14000 ] 30 0.004% 100.133% ( 14000, 22000 ] 50 0.006% 100.139% ( 22000, 33000 ] 38 0.005% 100.144% ( 33000, 50000 ] 3 0.000% 100.144% ( 50000, 75000 ] 2 0.000% 100.144% ** Level 5 read latency histogram (micros): Count: 39861 Average: 839.3064 StdDev: 1710.69 Min: 82 Median: 261.4697 Max: 58138 Percentiles: P50: 261.47 P75: 779.93 P99: 6505.10 P99.9: 21210.76 P99.99: 47588.31 ------------------------------------------------------ ( 76, 110 ] 960 2.408% 2.408% ( 110, 170 ] 9825 24.648% 27.057% ##### ( 170, 250 ] 8761 21.979% 49.035% #### ( 250, 380 ] 4358 10.933% 59.968% ## ( 380, 580 ] 3980 9.985% 69.953% ## ( 580, 870 ] 2919 7.323% 77.276% # ( 870, 1300 ] 2449 6.144% 83.420% # ( 1300, 1900 ] 1922 4.822% 88.242% # ( 1900, 2900 ] 1737 4.358% 92.599% # ( 2900, 4400 ] 1585 3.976% 96.576% # ( 4400, 6600 ] 1011 2.536% 99.112% # ( 6600, 9900 ] 262 0.657% 99.769% ( 9900, 14000 ] 27 0.068% 99.837% ( 14000, 22000 ] 29 0.073% 99.910% ( 22000, 33000 ] 21 0.053% 99.962% ( 33000, 50000 ] 14 0.035% 99.997% ( 50000, 75000 ] 3 0.008% 100.005% ** DB Stats ** Uptime(secs): 12.1 total, 4.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 162.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.558 H:M:S, 37.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 238.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.658 H:M:S, 16.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/12-12:30:50 ... thread 0: (1000000,3000000) ops and (172102.3,168774.0) ops/second in (5.810496,17.775248) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/13 3.98 GB 132.1 2.5 0.0 2.5 5.3 2.8 0.0 1.9 97.6 204.6 26.46 18.27 49 0.540 2622K 3051 0.0 0.0 L1 9/9 980.48 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 29.57 MB 0.3 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 15/0 972.13 MB 1.0 1.1 0.8 0.4 1.1 0.7 0.1 1.5 101.8 100.4 11.38 5.65 3 3.794 523K 0 0.0 0.0 L4 163/0 9.45 GB 1.0 6.3 2.8 3.5 6.2 2.7 0.1 2.2 103.8 101.9 62.26 32.05 27 2.306 1903K 7169 0.0 0.0 L5 1140/0 93.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/22 109.17 GB 0.0 10.0 3.6 6.4 12.6 6.2 3.2 4.6 101.9 128.9 100.10 55.97 79 1.267 5049K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.0 3.6 6.4 12.6 6.2 3.2 4.6 101.9 128.9 100.10 55.97 79 1.267 5049K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.0 3.6 6.4 9.8 3.5 0.0 0.0 118.9 117.3 85.80 47.89 39 2.200 5049K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 198.2 14.30 8.08 40 0.357 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.0 total, 17.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.60 GB write, 718.36 MB/s write, 9.96 GB read, 568.01 MB/s read, 100.1 seconds Interval compaction: 12.60 GB write, 725.77 MB/s write, 9.96 GB read, 573.86 MB/s read, 100.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 40, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 40, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 986164 Average: 16.8847 StdDev: 206.86 Min: 1 Median: 1.6550 Max: 38455 Percentiles: P50: 1.66 P75: 2.38 P99: 262.40 P99.9: 1313.14 P99.99: 2553.60 ------------------------------------------------------ [ 0, 1 ] 124973 12.673% 12.673% ### ( 1, 2 ] 561963 56.985% 69.657% ########### ( 2, 3 ] 140434 14.240% 83.898% ### ( 3, 4 ] 50629 5.134% 89.032% # ( 4, 6 ] 51585 5.231% 94.263% # ( 6, 10 ] 11761 1.193% 95.455% ( 10, 15 ] 2987 0.303% 95.758% ( 15, 22 ] 362 0.037% 95.795% ( 22, 34 ] 31 0.003% 95.798% ( 34, 51 ] 13 0.001% 95.799% ( 51, 76 ] 16 0.002% 95.801% ( 76, 110 ] 1734 0.176% 95.977% ( 110, 170 ] 17114 1.735% 97.712% ( 170, 250 ] 12310 1.248% 98.960% ( 250, 380 ] 4092 0.415% 99.375% ( 380, 580 ] 2964 0.301% 99.676% ( 580, 870 ] 1391 0.141% 99.817% ( 870, 1300 ] 806 0.082% 99.899% ( 1300, 1900 ] 586 0.059% 99.958% ( 1900, 2900 ] 481 0.049% 100.007% ( 2900, 4400 ] 259 0.026% 100.033% ( 4400, 6600 ] 92 0.009% 100.042% ( 6600, 9900 ] 36 0.004% 100.046% ( 9900, 14000 ] 13 0.001% 100.047% ( 14000, 22000 ] 18 0.002% 100.049% ( 22000, 33000 ] 18 0.002% 100.051% ( 33000, 50000 ] 5 0.001% 100.052% ** Level 1 read latency histogram (micros): Count: 82217 Average: 12.4867 StdDev: 151.75 Min: 1 Median: 2.9972 Max: 9648 Percentiles: P50: 3.00 P75: 4.86 P99: 189.26 P99.9: 1204.52 P99.99: 7871.23 ------------------------------------------------------ [ 0, 1 ] 1484 1.805% 1.805% ( 1, 2 ] 20690 25.165% 26.970% ##### ( 2, 3 ] 18987 23.094% 50.064% ##### ( 3, 4 ] 11275 13.714% 63.778% ### ( 4, 6 ] 21565 26.229% 90.007% ##### ( 6, 10 ] 4713 5.732% 95.739% # ( 10, 15 ] 1103 1.342% 97.081% ( 15, 22 ] 592 0.720% 97.801% ( 22, 34 ] 54 0.066% 97.867% ( 34, 51 ] 4 0.005% 97.871% ( 51, 76 ] 1 0.001% 97.873% ( 76, 110 ] 65 0.079% 97.952% ( 110, 170 ] 740 0.900% 98.852% ( 170, 250 ] 506 0.615% 99.467% ( 250, 380 ] 148 0.180% 99.647% ( 380, 580 ] 121 0.147% 99.794% ( 580, 870 ] 65 0.079% 99.874% ( 870, 1300 ] 28 0.034% 99.908% ( 1300, 1900 ] 18 0.022% 99.929% ( 1900, 2900 ] 16 0.019% 99.949% ( 2900, 4400 ] 11 0.013% 99.962% ( 4400, 6600 ] 17 0.021% 99.983% ( 6600, 9900 ] 15 0.018% 100.001% ** Level 2 read latency histogram (micros): Count: 130752 Average: 16.3447 StdDev: 274.14 Min: 1 Median: 2.0022 Max: 30257 Percentiles: P50: 2.00 P75: 2.98 P99: 13.29 P99.9: 2469.24 P99.99: 3733.89 ------------------------------------------------------ [ 0, 1 ] 2960 2.264% 2.264% ( 1, 2 ] 62343 47.680% 49.944% ########## ( 2, 3 ] 33296 25.465% 75.409% ##### ( 3, 4 ] 12530 9.583% 84.992% ## ( 4, 6 ] 13955 10.673% 95.665% ## ( 6, 10 ] 3679 2.814% 98.479% # ( 10, 15 ] 1037 0.793% 99.272% ( 15, 22 ] 160 0.122% 99.394% ( 22, 34 ] 16 0.012% 99.407% ( 34, 51 ] 6 0.005% 99.411% ( 51, 76 ] 9 0.007% 99.418% ( 76, 110 ] 6 0.005% 99.423% ( 110, 170 ] 20 0.015% 99.438% ( 170, 250 ] 29 0.022% 99.460% ( 250, 380 ] 19 0.015% 99.475% ( 380, 580 ] 39 0.030% 99.504% ( 580, 870 ] 85 0.065% 99.569% ( 870, 1300 ] 162 0.124% 99.693% ( 1300, 1900 ] 186 0.142% 99.836% ( 1900, 2900 ] 148 0.113% 99.949% ( 2900, 4400 ] 97 0.074% 100.023% ( 4400, 6600 ] 27 0.021% 100.044% ( 6600, 9900 ] 10 0.008% 100.051% ( 9900, 14000 ] 3 0.002% 100.054% ( 14000, 22000 ] 4 0.003% 100.057% ( 22000, 33000 ] 7 0.005% 100.062% ** Level 3 read latency histogram (micros): Count: 530508 Average: 14.1634 StdDev: 252.62 Min: 1 Median: 1.9578 Max: 39966 Percentiles: P50: 1.96 P75: 2.95 P99: 13.41 P99.9: 1561.13 P99.99: 2305.72 ------------------------------------------------------ [ 0, 1 ] 12531 2.362% 2.362% ( 1, 2 ] 263858 49.737% 52.099% ########## ( 2, 3 ] 127968 24.122% 76.221% ##### ( 3, 4 ] 48246 9.094% 85.315% ## ( 4, 6 ] 55663 10.492% 95.807% ## ( 6, 10 ] 14287 2.693% 98.500% # ( 10, 15 ] 3885 0.732% 99.233% ( 15, 22 ] 502 0.095% 99.327% ( 22, 34 ] 43 0.008% 99.336% ( 34, 51 ] 14 0.003% 99.338% ( 51, 76 ] 33 0.006% 99.344% ( 76, 110 ] 80 0.015% 99.359% ( 110, 170 ] 725 0.137% 99.496% ( 170, 250 ] 485 0.091% 99.588% ( 250, 380 ] 243 0.046% 99.633% ( 380, 580 ] 290 0.055% 99.688% ( 580, 870 ] 390 0.074% 99.762% ( 870, 1300 ] 506 0.095% 99.857% ( 1300, 1900 ] 525 0.099% 99.956% ( 1900, 2900 ] 446 0.084% 100.040% ( 2900, 4400 ] 281 0.053% 100.093% ( 4400, 6600 ] 116 0.022% 100.115% ( 6600, 9900 ] 30 0.006% 100.120% ( 9900, 14000 ] 18 0.003% 100.124% ( 14000, 22000 ] 21 0.004% 100.128% ( 22000, 33000 ] 12 0.002% 100.130% ( 33000, 50000 ] 3 0.001% 100.131% ** Level 4 read latency histogram (micros): Count: 833747 Average: 26.5340 StdDev: 346.33 Min: 0 Median: 1.9565 Max: 55993 Percentiles: P50: 1.96 P75: 2.98 P99: 314.68 P99.9: 2536.54 P99.99: 3288.45 ------------------------------------------------------ [ 0, 1 ] 20493 2.458% 2.458% ( 1, 2 ] 414405 49.704% 52.162% ########## ( 2, 3 ] 194755 23.359% 75.521% ##### ( 3, 4 ] 73576 8.825% 84.346% ## ( 4, 6 ] 82180 9.857% 94.202% ## ( 6, 10 ] 20776 2.492% 96.694% ( 10, 15 ] 5941 0.713% 97.407% ( 15, 22 ] 723 0.087% 97.493% ( 22, 34 ] 62 0.007% 97.501% ( 34, 51 ] 34 0.004% 97.505% ( 51, 76 ] 38 0.005% 97.510% ( 76, 110 ] 641 0.077% 97.586% ( 110, 170 ] 6532 0.783% 98.370% ( 170, 250 ] 4452 0.534% 98.904% ( 250, 380 ] 1611 0.193% 99.097% ( 380, 580 ] 1491 0.179% 99.276% ( 580, 870 ] 1311 0.157% 99.433% ( 870, 1300 ] 1473 0.177% 99.610% ( 1300, 1900 ] 1516 0.182% 99.792% ( 1900, 2900 ] 1419 0.170% 99.962% ( 2900, 4400 ] 906 0.109% 100.071% ( 4400, 6600 ] 362 0.043% 100.114% ( 6600, 9900 ] 114 0.014% 100.128% ( 9900, 14000 ] 30 0.004% 100.131% ( 14000, 22000 ] 50 0.006% 100.137% ( 22000, 33000 ] 38 0.005% 100.142% ( 33000, 50000 ] 3 0.000% 100.142% ( 50000, 75000 ] 2 0.000% 100.142% ** Level 5 read latency histogram (micros): Count: 113034 Average: 424.1979 StdDev: 1065.70 Min: 80 Median: 184.5021 Max: 58138 Percentiles: P50: 184.50 P75: 286.86 P99: 4912.81 P99.9: 9647.66 P99.99: 38703.01 ------------------------------------------------------ ( 76, 110 ] 4565 4.039% 4.039% # ( 110, 170 ] 46321 40.980% 45.018% ######## ( 170, 250 ] 31063 27.481% 72.499% ##### ( 250, 380 ] 9970 8.820% 81.320% ## ( 380, 580 ] 7796 6.897% 88.217% # ( 580, 870 ] 4049 3.582% 91.799% # ( 870, 1300 ] 2597 2.298% 94.096% ( 1300, 1900 ] 1953 1.728% 95.824% ( 1900, 2900 ] 1767 1.563% 97.388% ( 2900, 4400 ] 1587 1.404% 98.792% ( 4400, 6600 ] 1011 0.894% 99.686% ( 6600, 9900 ] 262 0.232% 99.918% ( 9900, 14000 ] 27 0.024% 99.942% ( 14000, 22000 ] 29 0.026% 99.967% ( 22000, 33000 ] 21 0.019% 99.986% ( 33000, 50000 ] 14 0.012% 99.998% ( 50000, 75000 ] 3 0.003% 100.001% ** DB Stats ** Uptime(secs): 18.0 total, 5.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 164.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.836 H:M:S, 38.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 169.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.277 H:M:S, 39.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 253.847 micros/op 15735 ops/sec 60.181 seconds 946996 operations; 15.2 MB/s (236999 of 236999 found) Microseconds per read: Count: 946996 Average: 253.8491 StdDev: 948.84 Min: 2 Median: 198.4874 Max: 215278 Percentiles: P50: 198.49 P75: 238.18 P99: 858.77 P99.9: 15250.45 P99.99: 33768.59 ------------------------------------------------------ ( 1, 2 ] 4 0.000% 0.000% ( 2, 3 ] 28 0.003% 0.003% ( 3, 4 ] 47 0.005% 0.008% ( 4, 6 ] 90 0.010% 0.018% ( 6, 10 ] 187 0.020% 0.038% ( 10, 15 ] 2209 0.233% 0.271% ( 15, 22 ] 3816 0.403% 0.674% ( 22, 34 ] 11005 1.162% 1.836% ( 34, 51 ] 2054 0.217% 2.053% ( 51, 76 ] 225 0.024% 2.077% ( 76, 110 ] 1828 0.193% 2.270% ( 110, 170 ] 282099 29.789% 32.058% ###### ( 170, 250 ] 477140 50.385% 82.443% ########## ( 250, 380 ] 98523 10.404% 92.847% ## ( 380, 580 ] 45641 4.820% 97.666% # ( 580, 870 ] 13139 1.387% 99.054% ( 870, 1300 ] 4003 0.423% 99.476% ( 1300, 1900 ] 1486 0.157% 99.633% ( 1900, 2900 ] 1120 0.118% 99.752% ( 2900, 4400 ] 727 0.077% 99.828% ( 4400, 6600 ] 262 0.028% 99.856% ( 6600, 9900 ] 126 0.013% 99.869% ( 9900, 14000 ] 192 0.020% 99.890% ( 14000, 22000 ] 627 0.066% 99.956% ( 22000, 33000 ] 320 0.034% 99.990% ( 33000, 50000 ] 73 0.008% 99.997% ( 50000, 75000 ] 17 0.002% 99.999% ( 75000, 110000 ] 1 0.000% 99.999% ( 110000, 170000 ] 4 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13405707 rocksdb.bloom.filter.full.positive COUNT : 1076926 rocksdb.bloom.filter.full.true.positive COUNT : 946643 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 353 rocksdb.memtable.miss COUNT : 946643 rocksdb.l0.hit COUNT : 33324 rocksdb.l1.hit COUNT : 16006 rocksdb.l2andup.hit COUNT : 897313 rocksdb.compaction.key.drop.new COUNT : 191905 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3345528 rocksdb.number.keys.read COUNT : 946996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3452584896 rocksdb.bytes.read COUNT : 946996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1533 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 47003289 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16491936265 rocksdb.compact.write.bytes COUNT : 16290415000 rocksdb.flush.write.bytes COUNT : 3434947406 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 40 rocksdb.number.superversion_acquires COUNT : 606 rocksdb.number.superversion_releases COUNT : 585 rocksdb.number.superversion_cleanups COUNT : 152 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 178 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3407229952 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1306624 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19757134259 rocksdb.non.last.level.read.count COUNT : 4628017 rocksdb.block.checksum.compute.count COUNT : 5080159 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 197.482098 P95 : 467.699123 P99 : 858.188623 P100 : 215276.000000 COUNT : 946996 SUM : 239511150 rocksdb.db.write.micros P50 : 1.557781 P95 : 5.074019 P99 : 20.411784 P100 : 871297.000000 COUNT : 3345528 SUM : 55658252 rocksdb.compaction.times.micros P50 : 1900000.000000 P95 : 4290000.000000 P99 : 28380000.000000 P100 : 31103467.000000 COUNT : 42 SUM : 123363576 rocksdb.compaction.times.cpu_micros P50 : 1200000.000000 P95 : 2880000.000000 P99 : 12236000.000000 P100 : 12862250.000000 COUNT : 42 SUM : 67150581 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 835.476190 P95 : 38525.000000 P99 : 124154.000000 P100 : 124154.000000 COUNT : 47 SUM : 335296 rocksdb.compaction.outfile.sync.micros P50 : 29000.000000 P95 : 202000.000000 P99 : 359200.000000 P100 : 675904.000000 COUNT : 180 SUM : 10355042 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 239.473684 P95 : 3785.000000 P99 : 8233.500000 P100 : 8638.000000 COUNT : 101 SUM : 97563 rocksdb.table.open.io.micros P50 : 12253.080082 P95 : 21972.727273 P99 : 32098.000000 P100 : 164184.000000 COUNT : 1533 SUM : 19402483 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.903343 P95 : 116.060483 P99 : 231.154613 P100 : 55996.000000 COUNT : 3993252 SUM : 84070174 rocksdb.read.block.get.micros P50 : 155.280128 P95 : 322.402082 P99 : 828.476841 P100 : 58193.000000 COUNT : 1085373 SUM : 203244759 rocksdb.write.raw.block.micros P50 : 0.523677 P95 : 0.994986 P99 : 3.395084 P100 : 61418.000000 COUNT : 4777714 SUM : 16006556 rocksdb.numfiles.in.singlecompaction P50 : 3.454545 P95 : 7.200000 P99 : 27.520000 P100 : 34.000000 COUNT : 54 SUM : 250 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570920 P95 : 1290.974161 P99 : 2694.019355 P100 : 871129.000000 COUNT : 232996 SUM : 47023220 rocksdb.sst.read.micros P50 : 2.301376 P95 : 216.903750 P99 : 467.013993 P100 : 58138.000000 COUNT : 4628071 SUM : 272126745 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 946996 SUM : 946996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3345528 SUM : 3452584896 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 222222.222222 P95 : 1040200.000000 P99 : 1094207.000000 P100 : 1094207.000000 COUNT : 47 SUM : 15761410 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 187 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0