[2024-10-17 17:20:20.671652] Starting SPDK v25.01-pre git sha1 b1174c3d3 / DPDK 24.03.0 initialization... [2024-10-17 17:20:20.671965] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2660097 ] Set seed to 1729178420664460 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-17 17:20:20.833809] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-17 17:20:20.908566] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-17 17:20:20.908600] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2660097' to capture a snapshot of events at runtime. [2024-10-17 17:20:20.908609] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-17 17:20:20.908617] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-17 17:20:20.908624] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2660097 for offline analysis/debug. [2024-10-17 17:20:20.909587] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Oct 17 17:20:22 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/10/17-17:20:28 ... thread 0: (1000000,1000000) ops and (190017.1,190017.1) ops/second in (5.262684,5.262684) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 1.03 GB 69.0 0.2 0.0 0.2 1.0 0.8 0.0 1.3 45.0 191.1 5.59 2.64 12 0.466 255K 1236 0.0 0.0 L1 2/0 165.23 MB 16.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 2/1 179.39 MB 1.3 0.2 0.2 0.0 0.2 0.2 0.0 1.1 97.6 95.9 1.92 0.97 1 1.916 172K 0 0.0 0.0 L3 46/19 2.85 GB 1.5 2.2 1.6 0.6 2.2 1.6 0.2 1.3 117.1 115.5 19.23 10.95 11 1.748 1863K 9882 0.0 0.0 L4 159/25 11.04 GB 1.0 2.1 1.5 0.7 2.1 1.4 0.1 1.4 143.4 138.9 15.14 8.60 12 1.262 402K 787 0.0 0.0 L5 120/0 8.98 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 341/51 24.23 GB 0.0 4.7 3.3 1.5 5.4 3.9 0.2 6.8 116.1 133.2 41.87 23.16 36 1.163 2694K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 3.3 1.5 5.4 3.9 0.2 6.8 116.1 133.2 41.87 23.16 36 1.163 2694K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 3.3 1.5 4.6 3.1 0.0 0.0 130.8 128.0 37.16 21.25 25 1.486 2694K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 173.4 4.71 1.91 11 0.428 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.3 total, 5.3 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.44 GB write, 1043.68 MB/s write, 4.75 GB read, 909.91 MB/s read, 41.9 seconds Interval compaction: 5.44 GB write, 1058.65 MB/s write, 4.75 GB read, 922.96 MB/s read, 41.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 69474 Average: 74.8431 StdDev: 639.72 Min: 0 Median: 1.4577 Max: 61929 Percentiles: P50: 1.46 P75: 2.23 P99: 1815.61 P99.9: 4577.81 P99.99: 14140.27 ------------------------------------------------------ [ 0, 1 ] 21542 31.007% 31.007% ###### ( 1, 2 ] 28831 41.499% 72.506% ######## ( 2, 3 ] 7458 10.735% 83.241% ## ( 3, 4 ] 4509 6.490% 89.731% # ( 4, 6 ] 1958 2.818% 92.550% # ( 6, 10 ] 178 0.256% 92.806% ( 10, 15 ] 7 0.010% 92.816% ( 15, 22 ] 3 0.004% 92.820% ( 22, 34 ] 13 0.019% 92.839% ( 34, 51 ] 8 0.012% 92.851% ( 51, 76 ] 2 0.003% 92.853% ( 76, 110 ] 4 0.006% 92.859% ( 110, 170 ] 38 0.055% 92.914% ( 170, 250 ] 264 0.380% 93.294% ( 250, 380 ] 758 1.091% 94.385% ( 380, 580 ] 1490 2.145% 96.530% ( 580, 870 ] 1147 1.651% 98.181% ( 870, 1300 ] 412 0.593% 98.774% ( 1300, 1900 ] 183 0.263% 99.037% ( 1900, 2900 ] 330 0.475% 99.512% ( 2900, 4400 ] 265 0.381% 99.893% ( 4400, 6600 ] 56 0.081% 99.974% ( 6600, 9900 ] 9 0.013% 99.987% ( 9900, 14000 ] 2 0.003% 99.990% ( 14000, 22000 ] 3 0.004% 99.994% ( 22000, 33000 ] 2 0.003% 99.997% ( 33000, 50000 ] 4 0.006% 100.003% ( 50000, 75000 ] 3 0.004% 100.007% ** Level 1 read latency histogram (micros): Count: 43371 Average: 22.2457 StdDev: 517.06 Min: 1 Median: 1.7470 Max: 52832 Percentiles: P50: 1.75 P75: 2.89 P99: 222.36 P99.9: 3701.32 P99.99: 32072.97 ------------------------------------------------------ [ 0, 1 ] 4903 11.305% 11.305% ## ( 1, 2 ] 22468 51.804% 63.109% ########## ( 2, 3 ] 5793 13.357% 76.466% ### ( 3, 4 ] 4628 10.671% 87.137% ## ( 4, 6 ] 4086 9.421% 96.558% ## ( 6, 10 ] 888 2.047% 98.605% ( 10, 15 ] 99 0.228% 98.833% ( 15, 22 ] 23 0.053% 98.886% ( 22, 34 ] 7 0.016% 98.902% ( 34, 51 ] 8 0.018% 98.921% ( 51, 76 ] 6 0.014% 98.935% ( 76, 110 ] 1 0.002% 98.937% ( 110, 170 ] 7 0.016% 98.953% ( 170, 250 ] 31 0.071% 99.025% ( 250, 380 ] 89 0.205% 99.230% ( 380, 580 ] 94 0.217% 99.447% ( 580, 870 ] 71 0.164% 99.610% ( 870, 1300 ] 39 0.090% 99.700% ( 1300, 1900 ] 22 0.051% 99.751% ( 1900, 2900 ] 47 0.108% 99.859% ( 2900, 4400 ] 33 0.076% 99.935% ( 4400, 6600 ] 15 0.035% 99.970% ( 9900, 14000 ] 2 0.005% 99.975% ( 14000, 22000 ] 3 0.007% 99.982% ( 22000, 33000 ] 4 0.009% 99.991% ( 33000, 50000 ] 3 0.007% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 370903 Average: 15.8900 StdDev: 387.83 Min: 0 Median: 1.6615 Max: 57966 Percentiles: P50: 1.66 P75: 2.59 P99: 9.71 P99.9: 2693.08 P99.99: 6371.81 ------------------------------------------------------ [ 0, 1 ] 62266 16.788% 16.788% ### ( 1, 2 ] 186233 50.211% 66.998% ########## ( 2, 3 ] 50040 13.491% 80.490% ### ( 3, 4 ] 35188 9.487% 89.977% ## ( 4, 6 ] 28213 7.607% 97.583% ## ( 6, 10 ] 5663 1.527% 99.110% ( 10, 15 ] 540 0.146% 99.256% ( 15, 22 ] 124 0.033% 99.289% ( 22, 34 ] 84 0.023% 99.312% ( 34, 51 ] 120 0.032% 99.344% ( 51, 76 ] 34 0.009% 99.353% ( 76, 110 ] 13 0.004% 99.357% ( 110, 170 ] 50 0.013% 99.370% ( 170, 250 ] 143 0.039% 99.409% ( 250, 380 ] 367 0.099% 99.508% ( 380, 580 ] 487 0.131% 99.639% ( 580, 870 ] 372 0.100% 99.740% ( 870, 1300 ] 218 0.059% 99.798% ( 1300, 1900 ] 182 0.049% 99.847% ( 1900, 2900 ] 246 0.066% 99.914% ( 2900, 4400 ] 213 0.057% 99.971% ( 4400, 6600 ] 78 0.021% 99.992% ( 6600, 9900 ] 35 0.009% 100.002% ( 9900, 14000 ] 14 0.004% 100.005% ( 14000, 22000 ] 26 0.007% 100.012% ( 22000, 33000 ] 27 0.007% 100.020% ( 33000, 50000 ] 12 0.003% 100.023% ( 50000, 75000 ] 1 0.000% 100.023% ** Level 3 read latency histogram (micros): Count: 642704 Average: 13.6979 StdDev: 285.89 Min: 0 Median: 1.5301 Max: 51840 Percentiles: P50: 1.53 P75: 2.27 P99: 9.58 P99.9: 2334.14 P99.99: 3962.43 ------------------------------------------------------ [ 0, 1 ] 165407 25.736% 25.736% ##### ( 1, 2 ] 294162 45.769% 71.506% ######### ( 2, 3 ] 84140 13.092% 84.597% ### ( 3, 4 ] 54629 8.500% 93.097% ## ( 4, 6 ] 33466 5.207% 98.304% # ( 6, 10 ] 4997 0.777% 99.082% ( 10, 15 ] 429 0.067% 99.148% ( 15, 22 ] 109 0.017% 99.165% ( 22, 34 ] 134 0.021% 99.186% ( 34, 51 ] 189 0.029% 99.216% ( 51, 76 ] 50 0.008% 99.223% ( 76, 110 ] 27 0.004% 99.227% ( 110, 170 ] 61 0.009% 99.237% ( 170, 250 ] 212 0.033% 99.270% ( 250, 380 ] 697 0.108% 99.378% ( 380, 580 ] 1279 0.199% 99.577% ( 580, 870 ] 1004 0.156% 99.734% ( 870, 1300 ] 460 0.072% 99.805% ( 1300, 1900 ] 398 0.062% 99.867% ( 1900, 2900 ] 489 0.076% 99.943% ( 2900, 4400 ] 426 0.066% 100.009% ( 4400, 6600 ] 108 0.017% 100.026% ( 6600, 9900 ] 23 0.004% 100.030% ( 9900, 14000 ] 4 0.001% 100.030% ( 14000, 22000 ] 19 0.003% 100.033% ( 22000, 33000 ] 21 0.003% 100.037% ( 33000, 50000 ] 6 0.001% 100.038% ( 50000, 75000 ] 3 0.000% 100.038% ** Level 4 read latency histogram (micros): Count: 340904 Average: 34.2783 StdDev: 476.07 Min: 0 Median: 1.4602 Max: 66787 Percentiles: P50: 1.46 P75: 2.20 P99: 772.05 P99.9: 3711.94 P99.99: 5459.00 ------------------------------------------------------ [ 0, 1 ] 104984 30.796% 30.796% ###### ( 1, 2 ] 142275 41.735% 72.530% ######## ( 2, 3 ] 42950 12.599% 85.129% ### ( 3, 4 ] 26255 7.702% 92.831% ## ( 4, 6 ] 13089 3.839% 96.670% # ( 6, 10 ] 1631 0.478% 97.149% ( 10, 15 ] 159 0.047% 97.195% ( 15, 22 ] 37 0.011% 97.206% ( 22, 34 ] 81 0.024% 97.230% ( 34, 51 ] 113 0.033% 97.263% ( 51, 76 ] 28 0.008% 97.271% ( 76, 110 ] 26 0.008% 97.279% ( 110, 170 ] 118 0.035% 97.314% ( 170, 250 ] 486 0.143% 97.456% ( 250, 380 ] 1438 0.422% 97.878% ( 380, 580 ] 2471 0.725% 98.603% ( 580, 870 ] 2049 0.601% 99.204% ( 870, 1300 ] 853 0.250% 99.454% ( 1300, 1900 ] 523 0.153% 99.608% ( 1900, 2900 ] 717 0.210% 99.818% ( 2900, 4400 ] 523 0.153% 99.971% ( 4400, 6600 ] 139 0.041% 100.012% ( 6600, 9900 ] 29 0.009% 100.021% ( 9900, 14000 ] 5 0.001% 100.022% ( 14000, 22000 ] 15 0.004% 100.026% ( 22000, 33000 ] 23 0.007% 100.033% ( 33000, 50000 ] 10 0.003% 100.036% ( 50000, 75000 ] 5 0.001% 100.038% ** Level 5 read latency histogram (micros): Count: 6216 Average: 1159.3082 StdDev: 3080.37 Min: 94 Median: 564.6784 Max: 71989 Percentiles: P50: 564.68 P75: 968.85 P99: 6395.43 P99.9: 48409.85 P99.99: 71892.00 ------------------------------------------------------ ( 76, 110 ] 11 0.177% 0.177% ( 110, 170 ] 80 1.287% 1.464% ( 170, 250 ] 361 5.808% 7.272% # ( 250, 380 ] 1077 17.326% 24.598% ### ( 380, 580 ] 1710 27.510% 52.107% ###### ( 580, 870 ] 1303 20.962% 73.069% #### ( 870, 1300 ] 522 8.398% 81.467% ## ( 1300, 1900 ] 284 4.569% 86.036% # ( 1900, 2900 ] 417 6.708% 92.745% # ( 2900, 4400 ] 319 5.132% 97.876% # ( 4400, 6600 ] 77 1.239% 99.115% ( 6600, 9900 ] 10 0.161% 99.276% ( 9900, 14000 ] 4 0.064% 99.340% ( 14000, 22000 ] 6 0.097% 99.437% ( 22000, 33000 ] 17 0.273% 99.710% ( 33000, 50000 ] 13 0.209% 99.920% ( 50000, 75000 ] 5 0.080% 100.000% ** DB Stats ** Uptime(secs): 5.3 total, 5.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 184.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.230 H:M:S, 23.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 186.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.230 H:M:S, 23.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/17-17:20:33 ... thread 0: (1000000,2000000) ops and (196415.2,193163.2) ops/second in (5.091255,10.353939) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.07 GB 144.1 1.0 0.0 1.0 2.9 1.8 0.0 1.6 85.4 235.5 12.53 7.88 30 0.418 1085K 5490 0.0 0.0 L1 2/0 165.23 MB 16.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.1 97.6 95.9 1.92 0.97 1 1.916 172K 0 0.0 0.0 L3 16/0 942.26 MB 0.9 3.3 1.8 1.5 3.3 1.7 0.2 1.8 126.5 124.7 26.76 15.32 13 2.058 2132K 12K 0.0 0.0 L4 145/0 9.65 GB 1.0 6.5 2.5 4.0 5.8 1.8 1.1 2.3 181.6 161.7 36.75 21.76 27 1.361 1514K 796 0.0 0.0 L5 159/0 11.81 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 340/10 24.61 GB 0.0 11.0 4.4 6.6 12.1 5.5 4.1 6.6 145.1 159.2 77.96 45.92 71 1.098 4904K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 4.4 6.6 12.1 5.5 4.1 6.6 145.1 159.2 77.96 45.92 71 1.098 4904K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 4.4 6.6 10.3 3.7 0.0 0.0 164.3 152.9 68.86 41.15 45 1.530 4904K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 207.4 9.10 4.77 26 0.350 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.4 total, 10.4 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.12 GB write, 1189.68 MB/s write, 11.05 GB read, 1084.42 MB/s read, 78.0 seconds Interval compaction: 12.12 GB write, 1198.35 MB/s write, 11.05 GB read, 1092.33 MB/s read, 78.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 25, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 311982 Average: 56.0327 StdDev: 401.15 Min: 0 Median: 1.2057 Max: 61929 Percentiles: P50: 1.21 P75: 1.92 P99: 797.47 P99.9: 2869.29 P99.99: 3799.32 ------------------------------------------------------ [ 0, 1 ] 133643 42.837% 42.837% ######### ( 1, 2 ] 108664 34.830% 77.667% ####### ( 2, 3 ] 18735 6.005% 83.672% # ( 3, 4 ] 8788 2.817% 86.489% # ( 4, 6 ] 4732 1.517% 88.006% ( 6, 10 ] 998 0.320% 88.326% ( 10, 15 ] 977 0.313% 88.639% ( 15, 22 ] 82 0.026% 88.665% ( 22, 34 ] 53 0.017% 88.682% ( 34, 51 ] 18 0.006% 88.688% ( 51, 76 ] 2 0.001% 88.688% ( 76, 110 ] 578 0.185% 88.874% ( 110, 170 ] 4972 1.594% 90.467% ( 170, 250 ] 6028 1.932% 92.400% ( 250, 380 ] 11037 3.538% 95.937% # ( 380, 580 ] 6912 2.216% 98.153% ( 580, 870 ] 3526 1.130% 99.283% ( 870, 1300 ] 1025 0.329% 99.612% ( 1300, 1900 ] 365 0.117% 99.729% ( 1900, 2900 ] 553 0.177% 99.906% ( 2900, 4400 ] 440 0.141% 100.047% ( 4400, 6600 ] 92 0.029% 100.076% ( 6600, 9900 ] 20 0.006% 100.083% ( 9900, 14000 ] 6 0.002% 100.085% ( 14000, 22000 ] 6 0.002% 100.087% ( 22000, 33000 ] 2 0.001% 100.087% ( 33000, 50000 ] 5 0.002% 100.089% ( 50000, 75000 ] 6 0.002% 100.091% ** Level 1 read latency histogram (micros): Count: 43671 Average: 24.5899 StdDev: 516.59 Min: 1 Median: 1.7536 Max: 52832 Percentiles: P50: 1.75 P75: 2.93 P99: 376.62 P99.9: 3708.63 P99.99: 31990.47 ------------------------------------------------------ [ 0, 1 ] 4903 11.227% 11.227% ## ( 1, 2 ] 22468 51.448% 62.675% ########## ( 2, 3 ] 5793 13.265% 75.941% ### ( 3, 4 ] 4628 10.597% 86.538% ## ( 4, 6 ] 4086 9.356% 95.894% ## ( 6, 10 ] 888 2.033% 97.928% ( 10, 15 ] 99 0.227% 98.154% ( 15, 22 ] 23 0.053% 98.207% ( 22, 34 ] 7 0.016% 98.223% ( 34, 51 ] 8 0.018% 98.241% ( 51, 76 ] 6 0.014% 98.255% ( 76, 110 ] 6 0.014% 98.269% ( 110, 170 ] 53 0.121% 98.390% ( 170, 250 ] 90 0.206% 98.596% ( 250, 380 ] 181 0.414% 99.011% ( 380, 580 ] 154 0.353% 99.363% ( 580, 870 ] 98 0.224% 99.588% ( 870, 1300 ] 47 0.108% 99.695% ( 1300, 1900 ] 23 0.053% 99.748% ( 1900, 2900 ] 48 0.110% 99.858% ( 2900, 4400 ] 34 0.078% 99.936% ( 4400, 6600 ] 15 0.034% 99.970% ( 9900, 14000 ] 2 0.005% 99.975% ( 14000, 22000 ] 3 0.007% 99.982% ( 22000, 33000 ] 4 0.009% 99.991% ( 33000, 50000 ] 3 0.007% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 410295 Average: 15.2216 StdDev: 371.37 Min: 0 Median: 1.6384 Max: 57966 Percentiles: P50: 1.64 P75: 2.54 P99: 9.76 P99.9: 2589.31 P99.99: 6373.53 ------------------------------------------------------ [ 0, 1 ] 75779 18.469% 18.469% #### ( 1, 2 ] 202632 49.387% 67.856% ########## ( 2, 3 ] 54658 13.322% 81.178% ### ( 3, 4 ] 37832 9.221% 90.399% ## ( 4, 6 ] 29741 7.249% 97.647% # ( 6, 10 ] 5898 1.438% 99.085% ( 10, 15 ] 571 0.139% 99.224% ( 15, 22 ] 131 0.032% 99.256% ( 22, 34 ] 87 0.021% 99.277% ( 34, 51 ] 120 0.029% 99.306% ( 51, 76 ] 37 0.009% 99.315% ( 76, 110 ] 19 0.005% 99.320% ( 110, 170 ] 90 0.022% 99.342% ( 170, 250 ] 183 0.045% 99.387% ( 250, 380 ] 463 0.113% 99.499% ( 380, 580 ] 581 0.142% 99.641% ( 580, 870 ] 459 0.112% 99.753% ( 870, 1300 ] 241 0.059% 99.812% ( 1300, 1900 ] 189 0.046% 99.858% ( 1900, 2900 ] 252 0.061% 99.919% ( 2900, 4400 ] 221 0.054% 99.973% ( 4400, 6600 ] 78 0.019% 99.992% ( 6600, 9900 ] 38 0.009% 100.001% ( 9900, 14000 ] 14 0.003% 100.005% ( 14000, 22000 ] 27 0.007% 100.011% ( 22000, 33000 ] 27 0.007% 100.018% ( 33000, 50000 ] 12 0.003% 100.021% ( 50000, 75000 ] 1 0.000% 100.021% ** Level 3 read latency histogram (micros): Count: 898375 Average: 13.2249 StdDev: 249.96 Min: 0 Median: 1.5091 Max: 51840 Percentiles: P50: 1.51 P75: 2.24 P99: 168.19 P99.9: 2082.11 P99.99: 3873.54 ------------------------------------------------------ [ 0, 1 ] 245013 27.273% 27.273% ##### ( 1, 2 ] 401023 44.639% 71.912% ######### ( 2, 3 ] 116262 12.941% 84.853% ### ( 3, 4 ] 75386 8.391% 93.244% ## ( 4, 6 ] 43874 4.884% 98.128% # ( 6, 10 ] 6081 0.677% 98.805% ( 10, 15 ] 572 0.064% 98.869% ( 15, 22 ] 132 0.015% 98.883% ( 22, 34 ] 150 0.017% 98.900% ( 34, 51 ] 205 0.023% 98.923% ( 51, 76 ] 61 0.007% 98.930% ( 76, 110 ] 94 0.010% 98.940% ( 110, 170 ] 555 0.062% 99.002% ( 170, 250 ] 777 0.086% 99.088% ( 250, 380 ] 2040 0.227% 99.315% ( 380, 580 ] 2219 0.247% 99.562% ( 580, 870 ] 1725 0.192% 99.754% ( 870, 1300 ] 713 0.079% 99.834% ( 1300, 1900 ] 487 0.054% 99.888% ( 1900, 2900 ] 591 0.066% 99.954% ( 2900, 4400 ] 501 0.056% 100.010% ( 4400, 6600 ] 118 0.013% 100.023% ( 6600, 9900 ] 25 0.003% 100.025% ( 9900, 14000 ] 4 0.000% 100.026% ( 14000, 22000 ] 19 0.002% 100.028% ( 22000, 33000 ] 22 0.002% 100.030% ( 33000, 50000 ] 6 0.001% 100.031% ( 50000, 75000 ] 3 0.000% 100.032% ** Level 4 read latency histogram (micros): Count: 1068065 Average: 21.7785 StdDev: 312.81 Min: 0 Median: 1.4393 Max: 66787 Percentiles: P50: 1.44 P75: 2.22 P99: 503.56 P99.9: 2380.16 P99.99: 3715.13 ------------------------------------------------------ [ 0, 1 ] 348035 32.586% 32.586% ####### ( 1, 2 ] 423421 39.644% 72.229% ######## ( 2, 3 ] 132293 12.386% 84.616% ## ( 3, 4 ] 85484 8.004% 92.619% ## ( 4, 6 ] 42863 4.013% 96.632% # ( 6, 10 ] 5063 0.474% 97.106% ( 10, 15 ] 660 0.062% 97.168% ( 15, 22 ] 114 0.011% 97.179% ( 22, 34 ] 142 0.013% 97.192% ( 34, 51 ] 200 0.019% 97.211% ( 51, 76 ] 58 0.005% 97.216% ( 76, 110 ] 378 0.035% 97.252% ( 110, 170 ] 3032 0.284% 97.536% ( 170, 250 ] 3828 0.358% 97.894% ( 250, 380 ] 7894 0.739% 98.633% ( 380, 580 ] 6344 0.594% 99.227% ( 580, 870 ] 4263 0.399% 99.626% ( 870, 1300 ] 1604 0.150% 99.776% ( 1300, 1900 ] 811 0.076% 99.852% ( 1900, 2900 ] 1062 0.099% 99.952% ( 2900, 4400 ] 753 0.071% 100.022% ( 4400, 6600 ] 181 0.017% 100.039% ( 6600, 9900 ] 40 0.004% 100.043% ( 9900, 14000 ] 11 0.001% 100.044% ( 14000, 22000 ] 21 0.002% 100.046% ( 22000, 33000 ] 28 0.003% 100.048% ( 33000, 50000 ] 14 0.001% 100.050% ( 50000, 75000 ] 6 0.001% 100.050% ** Level 5 read latency histogram (micros): Count: 19677 Average: 636.7104 StdDev: 1835.25 Min: 84 Median: 355.8320 Max: 71989 Percentiles: P50: 355.83 P75: 569.89 P99: 4250.48 P99.9: 32561.94 P99.99: 65161.50 ------------------------------------------------------ ( 76, 110 ] 239 1.215% 1.215% ( 110, 170 ] 2258 11.475% 12.690% ## ( 170, 250 ] 2772 14.088% 26.777% ### ( 250, 380 ] 5614 28.531% 55.308% ###### ( 380, 580 ] 4083 20.750% 76.058% #### ( 580, 870 ] 2432 12.360% 88.418% ## ( 870, 1300 ] 818 4.157% 92.575% # ( 1300, 1900 ] 379 1.926% 94.501% ( 1900, 2900 ] 519 2.638% 97.139% # ( 2900, 4400 ] 409 2.079% 99.217% ( 4400, 6600 ] 96 0.488% 99.705% ( 6600, 9900 ] 13 0.066% 99.771% ( 9900, 14000 ] 4 0.020% 99.792% ( 14000, 22000 ] 7 0.036% 99.827% ( 22000, 33000 ] 17 0.086% 99.914% ( 33000, 50000 ] 14 0.071% 99.985% ( 50000, 75000 ] 5 0.025% 100.010% ** DB Stats ** Uptime(secs): 10.4 total, 5.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 188.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.112 H:M:S, 29.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 193.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.882 H:M:S, 37.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/17-17:20:38 ... thread 0: (1000000,3000000) ops and (196039.5,194112.5) ops/second in (5.101013,15.454952) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.97 GB 243.0 2.9 0.0 2.9 5.6 2.7 0.0 2.0 112.2 219.0 26.31 17.49 50 0.526 2998K 22K 0.0 0.0 L1 2/0 165.23 MB 16.5 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.0 1.1 97.6 95.9 1.92 0.97 1 1.916 172K 0 0.0 0.0 L3 16/0 942.26 MB 0.9 3.3 1.8 1.5 3.3 1.7 0.2 1.8 126.5 124.7 26.76 15.32 13 2.058 2132K 12K 0.0 0.0 L4 145/0 9.65 GB 1.0 6.5 2.5 4.0 5.8 1.8 1.1 2.3 181.6 161.7 36.75 21.76 27 1.361 1514K 796 0.0 0.0 L5 159/0 11.81 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 340/10 25.51 GB 0.0 12.9 4.4 8.4 14.9 6.4 4.1 5.4 143.9 165.9 91.73 55.54 91 1.008 6817K 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.9 4.4 8.4 14.9 6.4 4.1 5.4 143.9 165.9 91.73 55.54 91 1.008 6817K 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.9 4.4 8.4 12.1 3.7 0.0 0.0 166.0 155.8 79.51 47.91 50 1.590 6817K 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 231.6 12.22 7.63 41 0.298 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.5 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.87 GB write, 979.90 MB/s write, 12.89 GB read, 849.57 MB/s read, 91.7 seconds Interval compaction: 14.87 GB write, 984.69 MB/s write, 12.89 GB read, 853.72 MB/s read, 91.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 25, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 831830 Average: 30.6994 StdDev: 251.40 Min: 0 Median: 1.2764 Max: 61929 Percentiles: P50: 1.28 P75: 1.83 P99: 517.73 P99.9: 1191.12 P99.99: 2113.32 ------------------------------------------------------ [ 0, 1 ] 311829 37.487% 37.487% ####### ( 1, 2 ] 376634 45.278% 82.765% ######### ( 2, 3 ] 44854 5.392% 88.157% # ( 3, 4 ] 19532 2.348% 90.505% ( 4, 6 ] 10509 1.263% 91.769% ( 6, 10 ] 2648 0.318% 92.087% ( 10, 15 ] 3107 0.374% 92.460% ( 15, 22 ] 203 0.024% 92.485% ( 22, 34 ] 141 0.017% 92.502% ( 34, 51 ] 27 0.003% 92.505% ( 51, 76 ] 3 0.000% 92.505% ( 76, 110 ] 1323 0.159% 92.664% ( 110, 170 ] 11088 1.333% 93.997% ( 170, 250 ] 12125 1.458% 95.455% ( 250, 380 ] 23028 2.768% 98.223% # ( 380, 580 ] 9382 1.128% 99.351% ( 580, 870 ] 3790 0.456% 99.807% ( 870, 1300 ] 1038 0.125% 99.932% ( 1300, 1900 ] 367 0.044% 99.976% ( 1900, 2900 ] 557 0.067% 100.043% ( 2900, 4400 ] 440 0.053% 100.096% ( 4400, 6600 ] 92 0.011% 100.107% ( 6600, 9900 ] 20 0.002% 100.109% ( 9900, 14000 ] 6 0.001% 100.110% ( 14000, 22000 ] 6 0.001% 100.110% ( 22000, 33000 ] 2 0.000% 100.111% ( 33000, 50000 ] 5 0.001% 100.111% ( 50000, 75000 ] 6 0.001% 100.112% ** Level 1 read latency histogram (micros): Count: 44091 Average: 26.7939 StdDev: 514.71 Min: 1 Median: 1.7630 Max: 52832 Percentiles: P50: 1.76 P75: 2.98 P99: 409.88 P99.9: 3690.10 P99.99: 31874.97 ------------------------------------------------------ [ 0, 1 ] 4903 11.120% 11.120% ## ( 1, 2 ] 22468 50.958% 62.078% ########## ( 2, 3 ] 5793 13.139% 75.217% ### ( 3, 4 ] 4628 10.496% 85.714% ## ( 4, 6 ] 4086 9.267% 94.981% ## ( 6, 10 ] 888 2.014% 96.995% ( 10, 15 ] 99 0.225% 97.219% ( 15, 22 ] 23 0.052% 97.272% ( 22, 34 ] 7 0.016% 97.287% ( 34, 51 ] 8 0.018% 97.306% ( 51, 76 ] 6 0.014% 97.319% ( 76, 110 ] 16 0.036% 97.355% ( 110, 170 ] 149 0.338% 97.693% ( 170, 250 ] 183 0.415% 98.108% ( 250, 380 ] 365 0.828% 98.936% ( 380, 580 ] 188 0.426% 99.363% ( 580, 870 ] 101 0.229% 99.592% ( 870, 1300 ] 47 0.107% 99.698% ( 1300, 1900 ] 23 0.052% 99.751% ( 1900, 2900 ] 48 0.109% 99.859% ( 2900, 4400 ] 34 0.077% 99.936% ( 4400, 6600 ] 15 0.034% 99.971% ( 9900, 14000 ] 2 0.005% 99.975% ( 14000, 22000 ] 3 0.007% 99.982% ( 22000, 33000 ] 4 0.009% 99.991% ( 33000, 50000 ] 3 0.007% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 410573 Average: 15.3831 StdDev: 371.31 Min: 0 Median: 1.6391 Max: 57966 Percentiles: P50: 1.64 P75: 2.54 P99: 9.95 P99.9: 2588.20 P99.99: 6372.74 ------------------------------------------------------ [ 0, 1 ] 75779 18.457% 18.457% #### ( 1, 2 ] 202632 49.353% 67.810% ########## ( 2, 3 ] 54658 13.313% 81.123% ### ( 3, 4 ] 37832 9.214% 90.337% ## ( 4, 6 ] 29741 7.244% 97.581% # ( 6, 10 ] 5898 1.437% 99.018% ( 10, 15 ] 571 0.139% 99.157% ( 15, 22 ] 131 0.032% 99.189% ( 22, 34 ] 87 0.021% 99.210% ( 34, 51 ] 120 0.029% 99.239% ( 51, 76 ] 37 0.009% 99.248% ( 76, 110 ] 26 0.006% 99.254% ( 110, 170 ] 160 0.039% 99.293% ( 170, 250 ] 238 0.058% 99.351% ( 250, 380 ] 585 0.142% 99.494% ( 380, 580 ] 605 0.147% 99.641% ( 580, 870 ] 459 0.112% 99.753% ( 870, 1300 ] 241 0.059% 99.812% ( 1300, 1900 ] 189 0.046% 99.858% ( 1900, 2900 ] 252 0.061% 99.919% ( 2900, 4400 ] 221 0.054% 99.973% ( 4400, 6600 ] 78 0.019% 99.992% ( 6600, 9900 ] 38 0.009% 100.001% ( 9900, 14000 ] 14 0.003% 100.005% ( 14000, 22000 ] 27 0.007% 100.011% ( 22000, 33000 ] 27 0.007% 100.018% ( 33000, 50000 ] 12 0.003% 100.021% ( 50000, 75000 ] 1 0.000% 100.021% ** Level 3 read latency histogram (micros): Count: 903171 Average: 14.4929 StdDev: 250.04 Min: 0 Median: 1.5151 Max: 51840 Percentiles: P50: 1.52 P75: 2.27 P99: 303.06 P99.9: 2075.39 P99.99: 3872.10 ------------------------------------------------------ [ 0, 1 ] 245014 27.128% 27.128% ##### ( 1, 2 ] 401027 44.402% 71.530% ######### ( 2, 3 ] 116277 12.874% 84.405% ### ( 3, 4 ] 75403 8.349% 92.753% ## ( 4, 6 ] 43917 4.863% 97.616% # ( 6, 10 ] 6092 0.675% 98.290% ( 10, 15 ] 618 0.068% 98.359% ( 15, 22 ] 134 0.015% 98.374% ( 22, 34 ] 150 0.017% 98.390% ( 34, 51 ] 205 0.023% 98.413% ( 51, 76 ] 61 0.007% 98.420% ( 76, 110 ] 214 0.024% 98.443% ( 110, 170 ] 1571 0.174% 98.617% ( 170, 250 ] 1787 0.198% 98.815% ( 250, 380 ] 4090 0.453% 99.268% ( 380, 580 ] 2644 0.293% 99.561% ( 580, 870 ] 1755 0.194% 99.755% ( 870, 1300 ] 718 0.079% 99.835% ( 1300, 1900 ] 487 0.054% 99.889% ( 1900, 2900 ] 592 0.066% 99.954% ( 2900, 4400 ] 501 0.055% 100.010% ( 4400, 6600 ] 118 0.013% 100.023% ( 6600, 9900 ] 25 0.003% 100.025% ( 9900, 14000 ] 4 0.000% 100.026% ( 14000, 22000 ] 19 0.002% 100.028% ( 22000, 33000 ] 22 0.002% 100.030% ( 33000, 50000 ] 6 0.001% 100.031% ( 50000, 75000 ] 3 0.000% 100.031% ** Level 4 read latency histogram (micros): Count: 1094134 Average: 27.3598 StdDev: 311.57 Min: 0 Median: 1.4700 Max: 66787 Percentiles: P50: 1.47 P75: 2.37 P99: 523.49 P99.9: 2352.88 P99.99: 3701.97 ------------------------------------------------------ [ 0, 1 ] 348036 31.809% 31.809% ###### ( 1, 2 ] 423433 38.700% 70.510% ######## ( 2, 3 ] 132332 12.095% 82.604% ## ( 3, 4 ] 85542 7.818% 90.422% ## ( 4, 6 ] 42950 3.925% 94.348% # ( 6, 10 ] 5110 0.467% 94.815% ( 10, 15 ] 792 0.072% 94.887% ( 15, 22 ] 118 0.011% 94.898% ( 22, 34 ] 149 0.014% 94.912% ( 34, 51 ] 200 0.018% 94.930% ( 51, 76 ] 58 0.005% 94.935% ( 76, 110 ] 1108 0.101% 95.037% ( 110, 170 ] 8588 0.785% 95.822% ( 170, 250 ] 9400 0.859% 96.681% ( 250, 380 ] 19158 1.751% 98.432% ( 380, 580 ] 8668 0.792% 99.224% ( 580, 870 ] 4494 0.411% 99.635% ( 870, 1300 ] 1611 0.147% 99.782% ( 1300, 1900 ] 811 0.074% 99.856% ( 1900, 2900 ] 1064 0.097% 99.953% ( 2900, 4400 ] 753 0.069% 100.022% ( 4400, 6600 ] 181 0.017% 100.039% ( 6600, 9900 ] 40 0.004% 100.042% ( 9900, 14000 ] 11 0.001% 100.043% ( 14000, 22000 ] 21 0.002% 100.045% ( 22000, 33000 ] 28 0.003% 100.048% ( 33000, 50000 ] 14 0.001% 100.049% ( 50000, 75000 ] 6 0.001% 100.050% ** Level 5 read latency histogram (micros): Count: 38252 Average: 453.8386 StdDev: 1331.72 Min: 84 Median: 300.3480 Max: 71989 Percentiles: P50: 300.35 P75: 420.42 P99: 3569.24 P99.9: 19426.29 P99.99: 55874.00 ------------------------------------------------------ ( 76, 110 ] 769 2.010% 2.010% ( 110, 170 ] 6357 16.619% 18.629% ### ( 170, 250 ] 6703 17.523% 36.152% #### ( 250, 380 ] 13677 35.755% 71.907% ####### ( 380, 580 ] 5854 15.304% 87.211% ### ( 580, 870 ] 2602 6.802% 94.013% # ( 870, 1300 ] 825 2.157% 96.170% ( 1300, 1900 ] 380 0.993% 97.164% ( 1900, 2900 ] 520 1.359% 98.523% ( 2900, 4400 ] 409 1.069% 99.592% ( 4400, 6600 ] 96 0.251% 99.843% ( 6600, 9900 ] 13 0.034% 99.877% ( 9900, 14000 ] 4 0.010% 99.888% ( 14000, 22000 ] 7 0.018% 99.906% ( 22000, 33000 ] 17 0.044% 99.950% ( 33000, 50000 ] 14 0.037% 99.987% ( 50000, 75000 ] 5 0.013% 100.000% ** DB Stats ** Uptime(secs): 15.5 total, 5.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 190.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.470 H:M:S, 28.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 192.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.358 H:M:S, 26.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 477.512 micros/op 8319 ops/sec 20.312 seconds 168996 operations; 8.1 MB/s (41999 of 41999 found) Microseconds per read: Count: 168996 Average: 477.5407 StdDev: 1216.97 Min: 2 Median: 357.9864 Max: 147998 Percentiles: P50: 357.99 P75: 518.82 P99: 3284.57 P99.9: 16390.03 P99.99: 50156.87 ------------------------------------------------------ ( 1, 2 ] 1 0.001% 0.001% ( 2, 3 ] 12 0.007% 0.008% ( 3, 4 ] 19 0.011% 0.019% ( 4, 6 ] 69 0.041% 0.060% ( 6, 10 ] 182 0.108% 0.167% ( 10, 15 ] 337 0.199% 0.367% ( 15, 22 ] 697 0.412% 0.779% ( 22, 34 ] 2395 1.417% 2.197% ( 34, 51 ] 1857 1.099% 3.295% ( 51, 76 ] 2690 1.592% 4.887% ( 76, 110 ] 919 0.544% 5.431% ( 110, 170 ] 8247 4.880% 10.311% # ( 170, 250 ] 35119 20.781% 31.092% #### ( 250, 380 ] 38468 22.763% 53.855% ##### ( 380, 580 ] 51483 30.464% 84.319% ###### ( 580, 870 ] 16416 9.714% 94.032% ## ( 870, 1300 ] 5204 3.079% 97.112% # ( 1300, 1900 ] 1473 0.872% 97.983% ( 1900, 2900 ] 1435 0.849% 98.833% ( 2900, 4400 ] 1104 0.653% 99.486% ( 4400, 6600 ] 452 0.267% 99.753% ( 6600, 9900 ] 171 0.101% 99.854% ( 9900, 14000 ] 54 0.032% 99.886% ( 14000, 22000 ] 77 0.046% 99.932% ( 22000, 33000 ] 64 0.038% 99.970% ( 33000, 50000 ] 34 0.020% 99.990% ( 50000, 75000 ] 16 0.009% 99.999% ( 110000, 170000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2839370 rocksdb.bloom.filter.full.positive COUNT : 195846 rocksdb.bloom.filter.full.true.positive COUNT : 168288 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 708 rocksdb.memtable.miss COUNT : 168288 rocksdb.l0.hit COUNT : 20022 rocksdb.l1.hit COUNT : 1255 rocksdb.l2andup.hit COUNT : 147011 rocksdb.compaction.key.drop.new COUNT : 833834 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3653149 rocksdb.number.keys.read COUNT : 168996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3770049768 rocksdb.bytes.read COUNT : 168996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 531 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6589688 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 15239764808 rocksdb.compact.write.bytes COUNT : 14375974809 rocksdb.flush.write.bytes COUNT : 3759441021 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 30 rocksdb.number.superversion_acquires COUNT : 732 rocksdb.number.superversion_releases COUNT : 706 rocksdb.number.superversion_cleanups COUNT : 180 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 18 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3734909952 rocksdb.memtable.garbage.bytes.at.flush COUNT : 6747136 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 15332197497 rocksdb.non.last.level.read.count COUNT : 3676341 rocksdb.block.checksum.compute.count COUNT : 3890546 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 352.567568 P95 : 1001.205985 P99 : 3283.553944 P100 : 147997.000000 COUNT : 168996 SUM : 80261241 rocksdb.db.write.micros P50 : 1.494620 P95 : 3.959781 P99 : 7.615117 P100 : 499145.000000 COUNT : 3653149 SUM : 15625792 rocksdb.compaction.times.micros P50 : 1429310.344828 P95 : 2770000.000000 P99 : 5917000.000000 P100 : 6259546.000000 COUNT : 53 SUM : 82145800 rocksdb.compaction.times.cpu_micros P50 : 895416.666667 P95 : 1748333.333333 P99 : 3424438.000000 P100 : 3424438.000000 COUNT : 53 SUM : 50494612 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 530.000000 P95 : 9471.000000 P99 : 14405.000000 P100 : 14405.000000 COUNT : 53 SUM : 105118 rocksdb.compaction.outfile.sync.micros P50 : 3931.250000 P95 : 71562.500000 P99 : 118700.000000 P100 : 122556.000000 COUNT : 171 SUM : 2119645 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 160.454545 P95 : 1885.000000 P99 : 6094.000000 P100 : 20979.000000 COUNT : 123 SUM : 80186 rocksdb.table.open.io.micros P50 : 4130.978261 P95 : 12440.757576 P99 : 20320.000000 P100 : 93274.000000 COUNT : 531 SUM : 2532272 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.757502 P95 : 6.916534 P99 : 310.252621 P100 : 61932.000000 COUNT : 3692261 SUM : 55549565 rocksdb.read.block.get.micros P50 : 268.694286 P95 : 767.520340 P99 : 2687.040498 P100 : 71992.000000 COUNT : 198480 SUM : 69249478 rocksdb.write.raw.block.micros P50 : 0.522815 P95 : 0.993349 P99 : 4.556761 P100 : 116609.000000 COUNT : 4395003 SUM : 12410333 rocksdb.numfiles.in.singlecompaction P50 : 3.086207 P95 : 5.411111 P99 : 11.000000 P100 : 11.000000 COUNT : 73 SUM : 256 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.580986 P95 : 1121.497617 P99 : 1279.331303 P100 : 498939.000000 COUNT : 34650 SUM : 6596231 rocksdb.sst.read.micros P50 : 1.482085 P95 : 191.703902 P99 : 515.013528 P100 : 71989.000000 COUNT : 3677476 SUM : 112345750 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 168996 SUM : 168996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3653149 SUM : 3770049768 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226969.696970 P95 : 706300.000000 P99 : 768099.000000 P100 : 768099.000000 COUNT : 53 SUM : 14783211 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 188 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0