[2024-07-26 23:40:11.805184] Starting SPDK v24.05.1-pre git sha1 241d0f3c9 / DPDK 23.11.0 initialization... [2024-07-26 23:40:11.805277] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2706491 ] Set seed to 1722030011802891 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-26 23:40:11.898630] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-26 23:40:11.936491] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-26 23:40:11.936535] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2706491' to capture a snapshot of events at runtime. [2024-07-26 23:40:11.936546] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-26 23:40:11.936555] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-26 23:40:11.936563] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2706491 for offline analysis/debug. [2024-07-26 23:40:11.936649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 26 23:40:16 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/26-23:40:20 ... thread 0: (1000000,1000000) ops and (234797.8,234797.8) ops/second in (4.258984,4.258984) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.80 GB 94.4 0.7 0.0 0.7 1.7 0.9 0.0 1.8 130.3 293.1 5.80 5.25 18 0.322 767K 761 0.0 0.0 L1 27/27 1.47 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 947.18 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 172/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 148.4 148.0 1.16 0.94 2 0.580 0 0 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1338/39 105.74 GB 0.0 0.9 0.2 0.7 1.8 1.1 0.0 2.0 133.3 268.9 6.96 6.19 20 0.348 767K 761 0.0 0.0 Int 0/0 0.00 KB 0.0 0.9 0.2 0.7 1.8 1.1 0.0 2.0 133.3 268.9 6.96 6.19 20 0.348 767K 761 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.9 0.2 0.7 0.9 0.2 0.0 0.0 232.5 232.2 3.99 3.71 5 0.798 767K 761 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 318.3 2.97 2.48 15 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.5 total, 4.3 interval Flush(GB): cumulative 0.923, interval 0.923 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.83 GB write, 419.15 MB/s write, 0.91 GB read, 207.83 MB/s read, 7.0 seconds Interval compaction: 1.83 GB write, 439.33 MB/s write, 0.91 GB read, 217.83 MB/s read, 7.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 0, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 283594 Average: 12.8752 StdDev: 78.30 Min: 0 Median: 1.4714 Max: 6533 Percentiles: P50: 1.47 P75: 1.91 P99: 245.10 P99.9: 761.46 P99.99: 1244.17 ------------------------------------------------------ [ 0, 1 ] 65474 23.087% 23.087% ##### ( 1, 2 ] 161900 57.089% 80.176% ########### ( 2, 3 ] 27251 9.609% 89.785% ## ( 3, 4 ] 7900 2.786% 92.571% # ( 4, 6 ] 4927 1.737% 94.308% ( 6, 10 ] 2197 0.775% 95.083% ( 10, 15 ] 466 0.164% 95.247% ( 15, 22 ] 95 0.033% 95.281% ( 22, 34 ] 44 0.016% 95.296% ( 34, 51 ] 13 0.005% 95.301% ( 51, 76 ] 9 0.003% 95.304% ( 76, 110 ] 1877 0.662% 95.966% ( 110, 170 ] 6295 2.220% 98.185% ( 170, 250 ] 2462 0.868% 99.054% ( 250, 380 ] 1194 0.421% 99.475% ( 380, 580 ] 964 0.340% 99.815% ( 580, 870 ] 389 0.137% 99.952% ( 870, 1300 ] 126 0.044% 99.996% ( 1300, 1900 ] 64 0.023% 100.019% ( 1900, 2900 ] 40 0.014% 100.033% ( 2900, 4400 ] 25 0.009% 100.042% ( 4400, 6600 ] 8 0.003% 100.044% ** Level 1 read latency histogram (micros): Count: 27409 Average: 14.1918 StdDev: 98.48 Min: 1 Median: 1.9523 Max: 5442 Percentiles: P50: 1.95 P75: 3.57 P99: 269.70 P99.9: 1511.89 P99.99: 3844.32 ------------------------------------------------------ [ 0, 1 ] 1764 6.436% 6.436% # ( 1, 2 ] 12538 45.744% 52.180% ######### ( 2, 3 ] 5112 18.651% 70.831% #### ( 3, 4 ] 2000 7.297% 78.128% # ( 4, 6 ] 3329 12.146% 90.273% ## ( 6, 10 ] 1261 4.601% 94.874% # ( 10, 15 ] 215 0.784% 95.658% ( 15, 22 ] 94 0.343% 96.001% ( 22, 34 ] 12 0.044% 96.045% ( 34, 51 ] 5 0.018% 96.063% ( 76, 110 ] 165 0.602% 96.665% ( 110, 170 ] 474 1.729% 98.395% ( 170, 250 ] 150 0.547% 98.942% ( 250, 380 ] 105 0.383% 99.325% ( 380, 580 ] 92 0.336% 99.661% ( 580, 870 ] 38 0.139% 99.799% ( 870, 1300 ] 23 0.084% 99.883% ( 1300, 1900 ] 13 0.047% 99.931% ( 1900, 2900 ] 15 0.055% 99.985% ( 2900, 4400 ] 2 0.007% 99.993% ( 4400, 6600 ] 2 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 489 Average: 273.9530 StdDev: 400.61 Min: 79 Median: 161.0849 Max: 5129 Percentiles: P50: 161.08 P75: 254.95 P99: 1955.00 P99.9: 5129.00 P99.99: 5129.00 ------------------------------------------------------ ( 76, 110 ] 64 13.088% 13.088% ### ( 110, 170 ] 212 43.354% 56.442% ######### ( 170, 250 ] 89 18.200% 74.642% #### ( 250, 380 ] 46 9.407% 84.049% ## ( 380, 580 ] 36 7.362% 91.411% # ( 580, 870 ] 24 4.908% 96.319% # ( 870, 1300 ] 7 1.431% 97.751% ( 1300, 1900 ] 6 1.227% 98.978% ( 1900, 2900 ] 2 0.409% 99.387% ( 2900, 4400 ] 2 0.409% 99.796% ( 4400, 6600 ] 1 0.204% 100.000% ** Level 4 read latency histogram (micros): Count: 4294 Average: 299.1213 StdDev: 457.97 Min: 1 Median: 159.9554 Max: 5606 Percentiles: P50: 159.96 P75: 256.12 P99: 2705.10 P99.9: 4710.64 P99.99: 5606.00 ------------------------------------------------------ [ 0, 1 ] 5 0.116% 0.116% ( 1, 2 ] 13 0.303% 0.419% ( 2, 3 ] 22 0.512% 0.932% ( 3, 4 ] 9 0.210% 1.141% ( 4, 6 ] 37 0.862% 2.003% ( 6, 10 ] 3 0.070% 2.073% ( 10, 15 ] 1 0.023% 2.096% ( 51, 76 ] 1 0.023% 2.119% ( 76, 110 ] 564 13.135% 15.254% ### ( 110, 170 ] 1792 41.733% 56.986% ######## ( 170, 250 ] 756 17.606% 74.592% #### ( 250, 380 ] 372 8.663% 83.256% ## ( 380, 580 ] 291 6.777% 90.033% # ( 580, 870 ] 173 4.029% 94.061% # ( 870, 1300 ] 101 2.352% 96.414% ( 1300, 1900 ] 70 1.630% 98.044% ( 1900, 2900 ] 51 1.188% 99.231% ( 2900, 4400 ] 28 0.652% 99.884% ( 4400, 6600 ] 5 0.116% 100.000% ** Level 5 read latency histogram (micros): Count: 34247 Average: 324.8824 StdDev: 531.88 Min: 75 Median: 160.3286 Max: 6217 Percentiles: P50: 160.33 P75: 258.84 P99: 3184.18 P99.9: 4892.85 P99.99: 6217.00 ------------------------------------------------------ ( 51, 76 ] 1 0.003% 0.003% ( 76, 110 ] 4641 13.552% 13.554% ### ( 110, 170 ] 14880 43.449% 57.004% ######### ( 170, 250 ] 5959 17.400% 74.404% ### ( 250, 380 ] 3002 8.766% 83.169% ## ( 380, 580 ] 2358 6.885% 90.055% # ( 580, 870 ] 1173 3.425% 93.480% # ( 870, 1300 ] 608 1.775% 95.255% ( 1300, 1900 ] 563 1.644% 96.899% ( 1900, 2900 ] 650 1.898% 98.797% ( 2900, 4400 ] 367 1.072% 99.869% ( 4400, 6600 ] 48 0.140% 100.009% ** DB Stats ** Uptime(secs): 4.5 total, 4.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 220.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.701 H:M:S, 15.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 230.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.701 H:M:S, 16.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/26-23:40:28 ... thread 0: (1000000,2000000) ops and (125574.0,163633.8) ops/second in (7.963430,12.222414) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 3.71 GB 106.5 2.8 0.0 2.8 4.6 1.8 0.0 2.5 173.0 288.0 16.38 15.26 38 0.431 2877K 6279 0.0 0.0 L1 27/27 1.47 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 947.18 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 172/0 9.69 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 148.4 148.0 1.16 0.94 2 0.580 0 0 0.0 0.0 L5 1104/0 90.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1337/43 106.66 GB 0.0 2.9 0.2 2.8 4.8 2.0 0.0 2.6 171.4 278.7 17.54 16.20 40 0.439 2877K 6279 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 0.2 2.8 4.8 2.0 0.0 2.6 171.4 278.7 17.54 16.20 40 0.439 2877K 6279 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 0.2 2.8 2.9 0.2 0.0 0.0 258.8 258.2 11.62 11.16 10 1.162 2877K 6279 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 318.9 5.93 5.04 30 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.2 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.77 GB write, 393.37 MB/s write, 2.94 GB read, 241.85 MB/s read, 17.5 seconds Interval compaction: 4.77 GB write, 399.97 MB/s write, 2.94 GB read, 245.91 MB/s read, 17.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 0, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 876497 Average: 16.2872 StdDev: 68.06 Min: 0 Median: 1.4436 Max: 6533 Percentiles: P50: 1.44 P75: 1.90 P99: 248.05 P99.9: 591.29 P99.99: 805.89 ------------------------------------------------------ [ 0, 1 ] 225294 25.704% 25.704% ##### ( 1, 2 ] 480098 54.775% 80.479% ########### ( 2, 3 ] 67247 7.672% 88.151% ## ( 3, 4 ] 19636 2.240% 90.391% ( 4, 6 ] 11912 1.359% 91.750% ( 6, 10 ] 3819 0.436% 92.186% ( 10, 15 ] 670 0.076% 92.262% ( 15, 22 ] 125 0.014% 92.277% ( 22, 34 ] 52 0.006% 92.282% ( 34, 51 ] 15 0.002% 92.284% ( 51, 76 ] 35 0.004% 92.288% ( 76, 110 ] 10851 1.238% 93.526% ( 110, 170 ] 36136 4.123% 97.649% # ( 170, 250 ] 12139 1.385% 99.034% ( 250, 380 ] 4218 0.481% 99.515% ( 380, 580 ] 3333 0.380% 99.895% ( 580, 870 ] 1066 0.122% 100.017% ( 870, 1300 ] 214 0.024% 100.041% ( 1300, 1900 ] 75 0.009% 100.050% ( 1900, 2900 ] 53 0.006% 100.056% ( 2900, 4400 ] 37 0.004% 100.060% ( 4400, 6600 ] 8 0.001% 100.061% ** Level 1 read latency histogram (micros): Count: 57448 Average: 18.6786 StdDev: 81.64 Min: 1 Median: 3.2362 Max: 5442 Percentiles: P50: 3.24 P75: 5.28 P99: 275.05 P99.9: 860.14 P99.99: 2517.01 ------------------------------------------------------ [ 0, 1 ] 1922 3.346% 3.346% # ( 1, 2 ] 15522 27.019% 30.365% ##### ( 2, 3 ] 9797 17.054% 47.419% ### ( 3, 4 ] 6279 10.930% 58.348% ## ( 4, 6 ] 14984 26.083% 84.431% ##### ( 6, 10 ] 3530 6.145% 90.576% # ( 10, 15 ] 648 1.128% 91.704% ( 15, 22 ] 383 0.667% 92.370% ( 22, 34 ] 44 0.077% 92.447% ( 34, 51 ] 9 0.016% 92.463% ( 76, 110 ] 735 1.279% 93.742% ( 110, 170 ] 2291 3.988% 97.730% # ( 170, 250 ] 680 1.184% 98.914% ( 250, 380 ] 257 0.447% 99.361% ( 380, 580 ] 240 0.418% 99.779% ( 580, 870 ] 72 0.125% 99.904% ( 870, 1300 ] 26 0.045% 99.950% ( 1300, 1900 ] 14 0.024% 99.974% ( 1900, 2900 ] 15 0.026% 100.000% ( 2900, 4400 ] 2 0.003% 100.003% ( 4400, 6600 ] 2 0.003% 100.007% ** Level 3 read latency histogram (micros): Count: 2055 Average: 192.4073 StdDev: 217.55 Min: 78 Median: 147.5668 Max: 5129 Percentiles: P50: 147.57 P75: 191.86 P99: 866.01 P99.9: 3608.75 P99.99: 5129.00 ------------------------------------------------------ ( 76, 110 ] 325 15.815% 15.815% ### ( 110, 170 ] 1122 54.599% 70.414% ########### ( 170, 250 ] 345 16.788% 87.202% ### ( 250, 380 ] 114 5.547% 92.749% # ( 380, 580 ] 89 4.331% 97.080% # ( 580, 870 ] 40 1.946% 99.027% ( 870, 1300 ] 9 0.438% 99.465% ( 1300, 1900 ] 6 0.292% 99.757% ( 1900, 2900 ] 2 0.097% 99.854% ( 2900, 4400 ] 2 0.097% 99.951% ( 4400, 6600 ] 1 0.049% 100.000% ** Level 4 read latency histogram (micros): Count: 17934 Average: 201.3039 StdDev: 252.45 Min: 1 Median: 147.5897 Max: 5606 Percentiles: P50: 147.59 P75: 198.24 P99: 1235.72 P99.9: 3753.30 P99.99: 5606.00 ------------------------------------------------------ [ 0, 1 ] 6 0.033% 0.033% ( 1, 2 ] 39 0.217% 0.251% ( 2, 3 ] 106 0.591% 0.842% ( 3, 4 ] 68 0.379% 1.221% ( 4, 6 ] 95 0.530% 1.751% ( 6, 10 ] 12 0.067% 1.818% ( 10, 15 ] 1 0.006% 1.823% ( 51, 76 ] 1 0.006% 1.829% ( 76, 110 ] 2874 16.025% 17.854% ### ( 110, 170 ] 9202 51.310% 69.165% ########## ( 170, 250 ] 2965 16.533% 85.698% ### ( 250, 380 ] 1102 6.145% 91.842% # ( 380, 580 ] 847 4.723% 96.565% # ( 580, 870 ] 338 1.885% 98.450% ( 870, 1300 ] 116 0.647% 99.097% ( 1300, 1900 ] 73 0.407% 99.504% ( 1900, 2900 ] 54 0.301% 99.805% ( 2900, 4400 ] 30 0.167% 99.972% ( 4400, 6600 ] 5 0.028% 100.000% ** Level 5 read latency histogram (micros): Count: 147842 Average: 207.2250 StdDev: 281.30 Min: 73 Median: 148.0133 Max: 6217 Percentiles: P50: 148.01 P75: 197.66 P99: 1487.65 P99.9: 3911.42 P99.99: 4959.89 ------------------------------------------------------ ( 51, 76 ] 10 0.007% 0.007% ( 76, 110 ] 24661 16.681% 16.687% ### ( 110, 170 ] 77736 52.580% 69.268% ########### ( 170, 250 ] 24512 16.580% 85.848% ### ( 250, 380 ] 9066 6.132% 91.980% # ( 380, 580 ] 7034 4.758% 96.738% # ( 580, 870 ] 2392 1.618% 98.356% ( 870, 1300 ] 769 0.520% 98.876% ( 1300, 1900 ] 587 0.397% 99.273% ( 1900, 2900 ] 677 0.458% 99.731% ( 2900, 4400 ] 371 0.251% 99.982% ( 4400, 6600 ] 48 0.032% 100.014% ** DB Stats ** Uptime(secs): 12.4 total, 8.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 158.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.015 H:M:S, 40.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 123.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.314 H:M:S, 54.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 212.565 micros/op 18793 ops/sec 60.181 seconds 1130996 operations; 18.2 MB/s (274999 of 274999 found) Microseconds per read: Count: 1130996 Average: 212.5668 StdDev: 301.52 Min: 2 Median: 179.5320 Max: 39736 Percentiles: P50: 179.53 P75: 234.81 P99: 698.54 P99.9: 4437.52 P99.99: 12458.57 ------------------------------------------------------ ( 1, 2 ] 15 0.001% 0.001% ( 2, 3 ] 57 0.005% 0.006% ( 3, 4 ] 41 0.004% 0.010% ( 4, 6 ] 103 0.009% 0.019% ( 6, 10 ] 556 0.049% 0.068% ( 10, 15 ] 3792 0.335% 0.404% ( 15, 22 ] 1892 0.167% 0.571% ( 22, 34 ] 10670 0.943% 1.514% ( 34, 51 ] 1036 0.092% 1.606% ( 51, 76 ] 116 0.010% 1.616% ( 76, 110 ] 19715 1.743% 3.359% ( 110, 170 ] 478748 42.330% 45.689% ######## ( 170, 250 ] 409209 36.181% 81.870% ####### ( 250, 380 ] 142490 12.599% 94.469% ### ( 380, 580 ] 46477 4.109% 98.578% # ( 580, 870 ] 11667 1.032% 99.610% ( 870, 1300 ] 2355 0.208% 99.818% ( 1300, 1900 ] 323 0.029% 99.847% ( 1900, 2900 ] 298 0.026% 99.873% ( 2900, 4400 ] 296 0.026% 99.899% ( 4400, 6600 ] 528 0.047% 99.946% ( 6600, 9900 ] 434 0.038% 99.984% ( 9900, 14000 ] 104 0.009% 99.993% ( 14000, 22000 ] 51 0.005% 99.998% ( 22000, 33000 ] 21 0.002% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 22021780 rocksdb.bloom.filter.full.positive COUNT : 1345063 rocksdb.bloom.filter.full.true.positive COUNT : 1130597 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 399 rocksdb.memtable.miss COUNT : 1130597 rocksdb.l0.hit COUNT : 48380 rocksdb.l1.hit COUNT : 16430 rocksdb.l2andup.hit COUNT : 1065787 rocksdb.compaction.key.drop.new COUNT : 44324 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 2764855 rocksdb.number.keys.read COUNT : 1130996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 2853330360 rocksdb.bytes.read COUNT : 1130996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1392 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 49533967 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 8255536780 rocksdb.compact.write.bytes COUNT : 8221974270 rocksdb.flush.write.bytes COUNT : 2840693945 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 32 rocksdb.number.superversion_acquires COUNT : 418 rocksdb.number.superversion_releases COUNT : 393 rocksdb.number.superversion_cleanups COUNT : 101 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 2817565696 rocksdb.memtable.garbage.bytes.at.flush COUNT : 899072 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 14330364240 rocksdb.non.last.level.read.count COUNT : 3319418 rocksdb.block.checksum.compute.count COUNT : 3360391 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 177.960296 P95 : 403.523372 P99 : 696.951821 P100 : 39735.000000 COUNT : 1130996 SUM : 239353639 rocksdb.db.write.micros P50 : 1.551465 P95 : 5.089565 P99 : 985.376483 P100 : 2809.000000 COUNT : 2764855 SUM : 56480611 rocksdb.compaction.times.micros P50 : 1047000.000000 P95 : 3947888.000000 P99 : 3947888.000000 P100 : 3947888.000000 COUNT : 15 SUM : 20312107 rocksdb.compaction.times.cpu_micros P50 : 1047000.000000 P95 : 3862569.000000 P99 : 3862569.000000 P100 : 3862569.000000 COUNT : 15 SUM : 19735183 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 745.000000 P95 : 1670.000000 P99 : 2010.000000 P100 : 2010.000000 COUNT : 43 SUM : 36129 rocksdb.compaction.outfile.sync.micros P50 : 825.869565 P95 : 2183.333333 P99 : 2694.000000 P100 : 2694.000000 COUNT : 43 SUM : 44267 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 155.000000 P95 : 542.000000 P99 : 1046.300000 P100 : 1088.000000 COUNT : 59 SUM : 12586 rocksdb.table.open.io.micros P50 : 4904.746835 P95 : 9021.157895 P99 : 11288.533333 P100 : 14309.000000 COUNT : 1392 SUM : 6840184 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.666946 P95 : 153.749332 P99 : 235.551967 P100 : 18589.000000 COUNT : 2002269 SUM : 53178498 rocksdb.read.block.get.micros P50 : 139.333246 P95 : 246.063654 P99 : 534.989494 P100 : 18826.000000 COUNT : 1356735 SUM : 202427426 rocksdb.write.raw.block.micros P50 : 0.534868 P95 : 1.325787 P99 : 3.448437 P100 : 3102.000000 COUNT : 2679200 SUM : 5367983 rocksdb.numfiles.in.singlecompaction P50 : 3.500000 P95 : 37.400000 P99 : 39.000000 P100 : 39.000000 COUNT : 16 SUM : 96 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.576163 P95 : 2037.285235 P99 : 2530.000000 P100 : 2530.000000 COUNT : 247047 SUM : 49552945 rocksdb.sst.read.micros P50 : 4.766936 P95 : 205.798202 P99 : 400.891139 P100 : 6533.000000 COUNT : 3319478 SUM : 244014945 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1130996 SUM : 1130996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 2764855 SUM : 2853330360 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211951.219512 P95 : 249707.317073 P99 : 252531.000000 P100 : 252531.000000 COUNT : 43 SUM : 8585937 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 76 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0