[2024-07-25 13:18:18.455689] Starting SPDK v24.09-pre git sha1 704257090 / DPDK 24.03.0 initialization... [2024-07-25 13:18:18.456012] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2361839 ] Set seed to 1721906298448327 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-25 13:18:18.617422] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-25 13:18:18.839459] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-25 13:18:18.839509] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2361839' to capture a snapshot of events at runtime. [2024-07-25 13:18:18.839523] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-25 13:18:18.839537] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-25 13:18:18.839547] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2361839 for offline analysis/debug. [2024-07-25 13:18:18.839694] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Jul 25 13:18:22 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/25-13:18:25 ... thread 0: (1000000,1000000) ops and (333478.5,333478.5) ops/second in (2.998694,2.998694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 692.07 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 348.2 2.53 2.36 13 0.195 0 0 0.0 0.0 L2 3/2 222.64 MB 0.4 0.3 0.2 0.1 0.3 0.2 0.0 1.7 250.7 250.1 1.28 1.24 2 0.640 326K 738 0.0 0.0 L3 11/0 881.93 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 120/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 112/0 8.80 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 257/11 20.09 GB 0.0 0.3 0.2 0.1 1.2 1.0 0.0 1.4 84.3 315.2 3.81 3.60 15 0.254 326K 738 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.2 1.0 0.0 1.4 84.3 315.2 3.81 3.60 15 0.254 326K 738 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 250.7 250.1 1.28 1.24 2 0.640 326K 738 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 348.2 2.53 2.36 13 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 387.85 MB/s write, 0.31 GB read, 103.68 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 400.22 MB/s write, 0.31 GB read, 106.99 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 148722 Average: 2.0921 StdDev: 5.38 Min: 0 Median: 1.4254 Max: 1222 Percentiles: P50: 1.43 P75: 1.83 P99: 5.78 P99.9: 12.02 P99.99: 27.50 ------------------------------------------------------ [ 0, 1 ] 35310 23.742% 23.742% ##### ( 1, 2 ] 91808 61.731% 85.474% ############ ( 2, 3 ] 12702 8.541% 94.014% ## ( 3, 4 ] 4841 3.255% 97.269% # ( 4, 6 ] 2900 1.950% 99.219% ( 6, 10 ] 950 0.639% 99.858% ( 10, 15 ] 159 0.107% 99.965% ( 15, 22 ] 35 0.024% 99.989% ( 22, 34 ] 9 0.006% 99.995% ( 34, 51 ] 5 0.003% 99.998% ( 51, 76 ] 1 0.001% 99.999% ( 76, 110 ] 1 0.001% 99.999% ( 170, 250 ] 12 0.008% 100.007% ( 250, 380 ] 1 0.001% 100.008% ( 380, 580 ] 12 0.008% 100.016% ( 870, 1300 ] 1 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 8854 Average: 3.0972 StdDev: 18.18 Min: 1 Median: 1.2803 Max: 954 Percentiles: P50: 1.28 P75: 1.73 P99: 12.49 P99.9: 205.95 P99.99: 919.28 ------------------------------------------------------ [ 0, 1 ] 3037 34.301% 34.301% ####### ( 1, 2 ] 4959 56.009% 90.309% ########### ( 2, 3 ] 448 5.060% 95.369% # ( 3, 4 ] 135 1.525% 96.894% ( 4, 6 ] 86 0.971% 97.865% ( 6, 10 ] 90 1.016% 98.882% ( 10, 15 ] 21 0.237% 99.119% ( 15, 22 ] 7 0.079% 99.198% ( 22, 34 ] 1 0.011% 99.209% ( 34, 51 ] 1 0.011% 99.221% ( 76, 110 ] 22 0.248% 99.469% ( 110, 170 ] 35 0.395% 99.864% ( 170, 250 ] 7 0.079% 99.944% ( 250, 380 ] 2 0.023% 99.966% ( 380, 580 ] 1 0.011% 99.977% ( 580, 870 ] 1 0.011% 99.989% ( 870, 1300 ] 1 0.011% 100.000% ** Level 2 read latency histogram (micros): Count: 62370 Average: 2.1722 StdDev: 4.33 Min: 0 Median: 1.4732 Max: 711 Percentiles: P50: 1.47 P75: 1.87 P99: 6.33 P99.9: 14.06 P99.99: 205.26 ------------------------------------------------------ [ 0, 1 ] 12760 20.459% 20.459% #### ( 1, 2 ] 38938 62.431% 82.889% ############ ( 2, 3 ] 5966 9.565% 92.455% ## ( 3, 4 ] 2506 4.018% 96.473% # ( 4, 6 ] 1535 2.461% 98.934% ( 6, 10 ] 516 0.827% 99.761% ( 10, 15 ] 108 0.173% 99.934% ( 15, 22 ] 24 0.038% 99.973% ( 22, 34 ] 6 0.010% 99.982% ( 34, 51 ] 2 0.003% 99.986% ( 76, 110 ] 1 0.002% 99.987% ( 110, 170 ] 1 0.002% 99.989% ( 170, 250 ] 4 0.006% 99.995% ( 250, 380 ] 2 0.003% 99.998% ( 380, 580 ] 1 0.002% 100.000% ( 580, 870 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 55 Average: 2489.7091 StdDev: 1942.42 Min: 100 Median: 2275.0000 Max: 6173 Percentiles: P50: 2275.00 P75: 4306.25 P99: 6173.00 P99.9: 6173.00 P99.99: 6173.00 ------------------------------------------------------ ( 76, 110 ] 1 1.818% 1.818% ( 110, 170 ] 2 3.636% 5.455% # ( 170, 250 ] 5 9.091% 14.545% ## ( 250, 380 ] 3 5.455% 20.000% # ( 380, 580 ] 4 7.273% 27.273% # ( 580, 870 ] 6 10.909% 38.182% ## ( 870, 1300 ] 1 1.818% 40.000% ( 1300, 1900 ] 4 7.273% 47.273% # ( 1900, 2900 ] 4 7.273% 54.545% # ( 2900, 4400 ] 12 21.818% 76.364% #### ( 4400, 6600 ] 13 23.636% 100.000% ##### ** Level 4 read latency histogram (micros): Count: 20 Average: 3400.4500 StdDev: 1625.34 Min: 620 Median: 3275.0000 Max: 5863 Percentiles: P50: 3275.00 P75: 5028.57 P99: 5863.00 P99.9: 5863.00 P99.99: 5863.00 ------------------------------------------------------ ( 580, 870 ] 2 10.000% 10.000% ## ( 870, 1300 ] 1 5.000% 15.000% # ( 1300, 1900 ] 2 10.000% 25.000% ## ( 1900, 2900 ] 4 20.000% 45.000% #### ( 2900, 4400 ] 4 20.000% 65.000% #### ( 4400, 6600 ] 7 35.000% 100.000% ####### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 317.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.208 H:M:S, 6.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.208 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/25-13:18:28 ... thread 0: (1000000,2000000) ops and (348313.0,340734.4) ops/second in (2.870981,5.869675) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.29 GB 106.4 1.0 0.0 1.0 2.8 1.8 0.0 1.5 110.7 310.8 9.09 8.63 32 0.284 1022K 4872 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.7 241.1 1.30 1.27 1 1.296 319K 2091 0.0 0.0 L2 2/1 142.05 MB 0.8 0.4 0.2 0.2 0.4 0.2 0.3 1.9 245.1 244.2 1.55 1.50 3 0.515 384K 1425 0.0 0.0 L3 19/11 1.16 GB 0.3 0.3 0.3 0.1 0.3 0.3 0.1 1.2 224.4 223.8 1.46 1.41 2 0.728 331K 808 0.0 0.0 L4 126/0 9.62 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 218.0 218.0 0.40 0.38 1 0.395 87K 0 0.0 0.0 L5 112/0 8.80 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 268/16 21.00 GB 0.0 2.1 0.8 1.2 3.8 2.6 0.6 2.2 153.3 284.9 13.79 13.19 39 0.353 2145K 9196 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 0.8 1.2 3.8 2.6 0.6 2.2 153.3 284.9 13.79 13.19 39 0.353 2145K 9196 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 0.8 1.2 2.1 0.8 0.0 0.0 244.6 243.6 8.64 8.43 11 0.785 2145K 9196 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.3 5.15 4.76 28 0.184 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.9 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.84 GB write, 658.22 MB/s write, 2.06 GB read, 354.08 MB/s read, 13.8 seconds Interval compaction: 3.84 GB write, 668.95 MB/s write, 2.06 GB read, 359.86 MB/s read, 13.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 398711 Average: 2.3062 StdDev: 6.19 Min: 0 Median: 1.5609 Max: 1438 Percentiles: P50: 1.56 P75: 1.96 P99: 5.94 P99.9: 12.10 P99.99: 18.81 ------------------------------------------------------ [ 0, 1 ] 57522 14.427% 14.427% ### ( 1, 2 ] 252873 63.423% 77.850% ############# ( 2, 3 ] 54798 13.744% 91.593% ### ( 3, 4 ] 18362 4.605% 96.199% # ( 4, 6 ] 11525 2.891% 99.089% # ( 6, 10 ] 3005 0.754% 99.843% ( 10, 15 ] 541 0.136% 99.979% ( 15, 22 ] 83 0.021% 99.999% ( 22, 34 ] 18 0.005% 100.004% ( 34, 51 ] 7 0.002% 100.006% ( 51, 76 ] 4 0.001% 100.007% ( 76, 110 ] 1 0.000% 100.007% ( 170, 250 ] 27 0.007% 100.014% ( 250, 380 ] 8 0.002% 100.016% ( 380, 580 ] 20 0.005% 100.021% ( 580, 870 ] 2 0.001% 100.021% ( 870, 1300 ] 6 0.002% 100.023% ( 1300, 1900 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 33990 Average: 2.8075 StdDev: 11.19 Min: 1 Median: 1.6309 Max: 954 Percentiles: P50: 1.63 P75: 2.19 P99: 8.46 P99.9: 139.16 P99.99: 460.05 ------------------------------------------------------ [ 0, 1 ] 4296 12.639% 12.639% ### ( 1, 2 ] 20129 59.220% 71.859% ############ ( 2, 3 ] 5506 16.199% 88.058% ### ( 3, 4 ] 1916 5.637% 93.695% # ( 4, 6 ] 1538 4.525% 98.220% # ( 6, 10 ] 431 1.268% 99.488% ( 10, 15 ] 74 0.218% 99.706% ( 15, 22 ] 17 0.050% 99.756% ( 22, 34 ] 6 0.018% 99.773% ( 34, 51 ] 3 0.009% 99.782% ( 51, 76 ] 1 0.003% 99.785% ( 76, 110 ] 22 0.065% 99.850% ( 110, 170 ] 35 0.103% 99.953% ( 170, 250 ] 7 0.021% 99.974% ( 250, 380 ] 4 0.012% 99.985% ( 380, 580 ] 4 0.012% 99.997% ( 580, 870 ] 2 0.006% 100.003% ( 870, 1300 ] 1 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 84558 Average: 2.3146 StdDev: 3.89 Min: 0 Median: 1.5549 Max: 711 Percentiles: P50: 1.55 P75: 1.96 P99: 7.12 P99.9: 14.00 P99.99: 178.71 ------------------------------------------------------ [ 0, 1 ] 13571 16.049% 16.049% ### ( 1, 2 ] 51739 61.188% 77.237% ############ ( 2, 3 ] 10726 12.685% 89.922% ### ( 3, 4 ] 4355 5.150% 95.072% # ( 4, 6 ] 3075 3.637% 98.709% # ( 6, 10 ] 878 1.038% 99.747% ( 10, 15 ] 162 0.192% 99.939% ( 15, 22 ] 28 0.033% 99.972% ( 22, 34 ] 9 0.011% 99.982% ( 34, 51 ] 2 0.002% 99.985% ( 76, 110 ] 2 0.002% 99.987% ( 110, 170 ] 2 0.002% 99.989% ( 170, 250 ] 5 0.006% 99.995% ( 250, 380 ] 2 0.002% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 164623 Average: 3.5733 StdDev: 58.14 Min: 0 Median: 1.6418 Max: 6173 Percentiles: P50: 1.64 P75: 2.11 P99: 9.05 P99.9: 157.05 P99.99: 3092.21 ------------------------------------------------------ [ 0, 1 ] 13639 8.285% 8.285% ## ( 1, 2 ] 107005 65.000% 73.285% ############# ( 2, 3 ] 25562 15.528% 88.813% ### ( 3, 4 ] 8895 5.403% 94.216% # ( 4, 6 ] 5605 3.405% 97.621% # ( 6, 10 ] 2976 1.808% 99.428% ( 10, 15 ] 409 0.248% 99.677% ( 15, 22 ] 53 0.032% 99.709% ( 22, 34 ] 14 0.009% 99.718% ( 34, 51 ] 88 0.053% 99.771% ( 51, 76 ] 44 0.027% 99.798% ( 76, 110 ] 28 0.017% 99.815% ( 110, 170 ] 179 0.109% 99.923% ( 170, 250 ] 63 0.038% 99.962% ( 250, 380 ] 22 0.013% 99.975% ( 380, 580 ] 8 0.005% 99.980% ( 580, 870 ] 6 0.004% 99.984% ( 870, 1300 ] 1 0.001% 99.984% ( 1300, 1900 ] 4 0.002% 99.987% ( 1900, 2900 ] 4 0.002% 99.989% ( 2900, 4400 ] 12 0.007% 99.996% ( 4400, 6600 ] 13 0.008% 100.004% ** Level 4 read latency histogram (micros): Count: 50 Average: 1375.9000 StdDev: 1947.01 Min: 0 Median: 34.0000 Max: 5863 Percentiles: P50: 34.00 P75: 2525.00 P99: 5863.00 P99.9: 5863.00 P99.99: 5863.00 ------------------------------------------------------ [ 0, 1 ] 8 16.000% 16.000% ### ( 1, 2 ] 6 12.000% 28.000% ## ( 2, 3 ] 3 6.000% 34.000% # ( 3, 4 ] 2 4.000% 38.000% # ( 6, 10 ] 2 4.000% 42.000% # ( 10, 15 ] 1 2.000% 44.000% ( 22, 34 ] 3 6.000% 50.000% # ( 34, 51 ] 1 2.000% 52.000% ( 51, 76 ] 1 2.000% 54.000% ( 110, 170 ] 1 2.000% 56.000% ( 170, 250 ] 2 4.000% 60.000% # ( 580, 870 ] 2 4.000% 64.000% # ( 870, 1300 ] 1 2.000% 66.000% ( 1300, 1900 ] 2 4.000% 70.000% # ( 1900, 2900 ] 4 8.000% 78.000% ## ( 2900, 4400 ] 4 8.000% 86.000% ## ( 4400, 6600 ] 7 14.000% 100.000% ### ** DB Stats ** Uptime(secs): 6.0 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 329.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.208 H:M:S, 3.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 342.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/25-13:18:31 ... thread 0: (1000000,3000000) ops and (332454.2,337928.9) ops/second in (3.007933,8.877608) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.26 GB 181.5 1.8 0.0 1.8 4.5 2.8 0.0 1.6 120.1 305.9 15.19 14.43 50 0.304 1852K 9165 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.7 241.1 1.30 1.27 1 1.296 319K 2091 0.0 0.0 L2 1/0 84.76 MB 0.8 0.4 0.2 0.2 0.4 0.2 0.3 1.9 245.1 244.2 1.55 1.50 3 0.515 384K 1425 0.0 0.0 L3 19/0 964.60 MB 1.0 1.2 0.3 0.9 1.2 0.3 0.1 3.9 247.2 242.6 5.12 4.91 3 1.707 1285K 23K 0.0 0.0 L4 126/0 9.50 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 218.0 218.0 0.40 0.38 1 0.395 87K 0 0.0 0.0 L5 116/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 277/8 21.96 GB 0.0 3.8 0.9 2.9 6.5 3.6 1.3 2.4 164.4 283.0 23.54 22.49 58 0.406 3930K 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 0.9 2.9 6.5 3.6 1.3 2.4 164.4 283.0 23.54 22.49 58 0.406 3930K 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 0.9 2.9 3.7 0.9 0.0 0.0 248.4 246.1 15.58 15.11 15 1.039 3930K 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.3 7.97 7.37 43 0.185 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.51 GB write, 742.52 MB/s write, 3.78 GB read, 431.17 MB/s read, 23.5 seconds Interval compaction: 6.51 GB write, 750.53 MB/s write, 3.78 GB read, 435.82 MB/s read, 23.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 644208 Average: 2.2752 StdDev: 6.11 Min: 0 Median: 1.5493 Max: 1438 Percentiles: P50: 1.55 P75: 1.94 P99: 5.87 P99.9: 12.00 P99.99: 19.86 ------------------------------------------------------ [ 0, 1 ] 94312 14.640% 14.640% ### ( 1, 2 ] 414732 64.379% 79.019% ############# ( 2, 3 ] 86300 13.396% 92.415% ### ( 3, 4 ] 27109 4.208% 96.623% # ( 4, 6 ] 16376 2.542% 99.165% # ( 6, 10 ] 4398 0.683% 99.848% ( 10, 15 ] 843 0.131% 99.979% ( 15, 22 ] 106 0.016% 99.995% ( 22, 34 ] 39 0.006% 100.001% ( 34, 51 ] 10 0.002% 100.003% ( 51, 76 ] 8 0.001% 100.004% ( 76, 110 ] 4 0.001% 100.005% ( 170, 250 ] 41 0.006% 100.011% ( 250, 380 ] 13 0.002% 100.013% ( 380, 580 ] 31 0.005% 100.018% ( 580, 870 ] 4 0.001% 100.018% ( 870, 1300 ] 10 0.002% 100.020% ( 1300, 1900 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 33990 Average: 2.8075 StdDev: 11.19 Min: 1 Median: 1.6309 Max: 954 Percentiles: P50: 1.63 P75: 2.19 P99: 8.46 P99.9: 139.16 P99.99: 460.05 ------------------------------------------------------ [ 0, 1 ] 4296 12.639% 12.639% ### ( 1, 2 ] 20129 59.220% 71.859% ############ ( 2, 3 ] 5506 16.199% 88.058% ### ( 3, 4 ] 1916 5.637% 93.695% # ( 4, 6 ] 1538 4.525% 98.220% # ( 6, 10 ] 431 1.268% 99.488% ( 10, 15 ] 74 0.218% 99.706% ( 15, 22 ] 17 0.050% 99.756% ( 22, 34 ] 6 0.018% 99.773% ( 34, 51 ] 3 0.009% 99.782% ( 51, 76 ] 1 0.003% 99.785% ( 76, 110 ] 22 0.065% 99.850% ( 110, 170 ] 35 0.103% 99.953% ( 170, 250 ] 7 0.021% 99.974% ( 250, 380 ] 4 0.012% 99.985% ( 380, 580 ] 4 0.012% 99.997% ( 580, 870 ] 2 0.006% 100.003% ( 870, 1300 ] 1 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 95902 Average: 2.3436 StdDev: 3.82 Min: 0 Median: 1.5731 Max: 711 Percentiles: P50: 1.57 P75: 1.98 P99: 7.34 P99.9: 13.89 P99.99: 176.56 ------------------------------------------------------ [ 0, 1 ] 14095 14.697% 14.697% ### ( 1, 2 ] 59077 61.601% 76.299% ############ ( 2, 3 ] 12943 13.496% 89.795% ### ( 3, 4 ] 4931 5.142% 94.936% # ( 4, 6 ] 3532 3.683% 98.619% # ( 6, 10 ] 1091 1.138% 99.757% ( 10, 15 ] 176 0.184% 99.941% ( 15, 22 ] 29 0.030% 99.971% ( 22, 34 ] 9 0.009% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 76, 110 ] 3 0.003% 99.985% ( 110, 170 ] 4 0.004% 99.990% ( 170, 250 ] 5 0.005% 99.995% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 262040 Average: 3.2412 StdDev: 46.49 Min: 0 Median: 1.6165 Max: 6173 Percentiles: P50: 1.62 P75: 1.99 P99: 8.96 P99.9: 150.37 P99.99: 1395.52 ------------------------------------------------------ [ 0, 1 ] 24106 9.199% 9.199% ## ( 1, 2 ] 173407 66.176% 75.375% ############# ( 2, 3 ] 38523 14.701% 90.076% ### ( 3, 4 ] 12446 4.750% 94.826% # ( 4, 6 ] 7409 2.827% 97.653% # ( 6, 10 ] 4762 1.817% 99.471% ( 10, 15 ] 489 0.187% 99.657% ( 15, 22 ] 62 0.024% 99.681% ( 22, 34 ] 15 0.006% 99.687% ( 34, 51 ] 219 0.084% 99.770% ( 51, 76 ] 92 0.035% 99.805% ( 76, 110 ] 71 0.027% 99.832% ( 110, 170 ] 263 0.100% 99.933% ( 170, 250 ] 82 0.031% 99.964% ( 250, 380 ] 46 0.018% 99.982% ( 380, 580 ] 12 0.005% 99.986% ( 580, 870 ] 7 0.003% 99.989% ( 870, 1300 ] 2 0.001% 99.990% ( 1300, 1900 ] 5 0.002% 99.992% ( 1900, 2900 ] 4 0.002% 99.993% ( 2900, 4400 ] 12 0.005% 99.998% ( 4400, 6600 ] 13 0.005% 100.003% ** Level 4 read latency histogram (micros): Count: 50 Average: 1375.9000 StdDev: 1947.01 Min: 0 Median: 34.0000 Max: 5863 Percentiles: P50: 34.00 P75: 2525.00 P99: 5863.00 P99.9: 5863.00 P99.99: 5863.00 ------------------------------------------------------ [ 0, 1 ] 8 16.000% 16.000% ### ( 1, 2 ] 6 12.000% 28.000% ## ( 2, 3 ] 3 6.000% 34.000% # ( 3, 4 ] 2 4.000% 38.000% # ( 6, 10 ] 2 4.000% 42.000% # ( 10, 15 ] 1 2.000% 44.000% ( 22, 34 ] 3 6.000% 50.000% # ( 34, 51 ] 1 2.000% 52.000% ( 51, 76 ] 1 2.000% 54.000% ( 110, 170 ] 1 2.000% 56.000% ( 170, 250 ] 2 4.000% 60.000% # ( 580, 870 ] 2 4.000% 64.000% # ( 870, 1300 ] 1 2.000% 66.000% ( 1300, 1900 ] 2 4.000% 70.000% # ( 1900, 2900 ] 4 8.000% 78.000% ## ( 2900, 4400 ] 4 8.000% 86.000% ## ( 4400, 6600 ] 7 14.000% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 551.3500 StdDev: 592.66 Min: 124 Median: 170.0000 Max: 2032 Percentiles: P50: 170.00 P75: 870.00 P99: 2032.00 P99.9: 2032.00 P99.99: 2032.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.0 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 328.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.377 H:M:S, 4.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.24 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.169 H:M:S, 5.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/25-13:18:34 ... thread 0: (1000000,4000000) ops and (298376.0,327089.1) ops/second in (3.351476,12.229084) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 3.24 GB 25.0 2.8 0.0 2.8 6.5 3.7 0.0 1.7 130.2 305.9 21.75 20.72 69 0.315 2874K 14K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 242.7 241.1 1.30 1.27 1 1.296 319K 2091 0.0 0.0 L2 1/0 84.76 MB 0.8 0.4 0.2 0.2 0.4 0.2 0.3 1.9 245.1 244.2 1.55 1.50 3 0.515 384K 1425 0.0 0.0 L3 19/0 964.60 MB 1.0 1.2 0.3 0.9 1.2 0.3 0.1 3.9 247.2 242.6 5.12 4.91 3 1.707 1285K 23K 0.0 0.0 L4 126/0 9.50 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 218.0 218.0 0.40 0.38 1 0.395 87K 0 0.0 0.0 L5 116/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 280/17 22.93 GB 0.0 4.8 0.9 3.9 8.5 4.6 1.3 2.3 162.0 288.0 30.11 28.78 77 0.391 4952K 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 0.9 3.9 8.5 4.6 1.3 2.3 162.0 288.0 30.11 28.78 77 0.391 4952K 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 0.9 3.9 4.7 0.9 0.0 0.0 251.4 249.3 19.39 18.86 19 1.021 4952K 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 358.1 10.71 9.92 58 0.185 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.2 interval Flush(GB): cumulative 3.747, interval 3.747 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.47 GB write, 703.54 MB/s write, 4.76 GB read, 395.60 MB/s read, 30.1 seconds Interval compaction: 8.47 GB write, 709.05 MB/s write, 4.76 GB read, 398.70 MB/s read, 30.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 5, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 964146 Average: 2.2945 StdDev: 7.08 Min: 0 Median: 1.5295 Max: 1732 Percentiles: P50: 1.53 P75: 1.91 P99: 5.88 P99.9: 13.16 P99.99: 145.19 ------------------------------------------------------ [ 0, 1 ] 149713 15.528% 15.528% ### ( 1, 2 ] 627642 65.098% 80.626% ############# ( 2, 3 ] 120493 12.497% 93.124% ## ( 3, 4 ] 36571 3.793% 96.917% # ( 4, 6 ] 21406 2.220% 99.137% ( 6, 10 ] 6610 0.686% 99.823% ( 10, 15 ] 1183 0.123% 99.945% ( 15, 22 ] 154 0.016% 99.961% ( 22, 34 ] 49 0.005% 99.966% ( 34, 51 ] 11 0.001% 99.967% ( 51, 76 ] 11 0.001% 99.969% ( 76, 110 ] 7 0.001% 99.969% ( 110, 170 ] 342 0.035% 100.005% ( 170, 250 ] 86 0.009% 100.014% ( 250, 380 ] 35 0.004% 100.017% ( 380, 580 ] 39 0.004% 100.021% ( 580, 870 ] 7 0.001% 100.022% ( 870, 1300 ] 16 0.002% 100.024% ( 1300, 1900 ] 2 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 33990 Average: 2.8075 StdDev: 11.19 Min: 1 Median: 1.6309 Max: 954 Percentiles: P50: 1.63 P75: 2.19 P99: 8.46 P99.9: 139.16 P99.99: 460.05 ------------------------------------------------------ [ 0, 1 ] 4296 12.639% 12.639% ### ( 1, 2 ] 20129 59.220% 71.859% ############ ( 2, 3 ] 5506 16.199% 88.058% ### ( 3, 4 ] 1916 5.637% 93.695% # ( 4, 6 ] 1538 4.525% 98.220% # ( 6, 10 ] 431 1.268% 99.488% ( 10, 15 ] 74 0.218% 99.706% ( 15, 22 ] 17 0.050% 99.756% ( 22, 34 ] 6 0.018% 99.773% ( 34, 51 ] 3 0.009% 99.782% ( 51, 76 ] 1 0.003% 99.785% ( 76, 110 ] 22 0.065% 99.850% ( 110, 170 ] 35 0.103% 99.953% ( 170, 250 ] 7 0.021% 99.974% ( 250, 380 ] 4 0.012% 99.985% ( 380, 580 ] 4 0.012% 99.997% ( 580, 870 ] 2 0.006% 100.003% ( 870, 1300 ] 1 0.003% 100.006% ** Level 2 read latency histogram (micros): Count: 95902 Average: 2.3436 StdDev: 3.82 Min: 0 Median: 1.5731 Max: 711 Percentiles: P50: 1.57 P75: 1.98 P99: 7.34 P99.9: 13.89 P99.99: 176.56 ------------------------------------------------------ [ 0, 1 ] 14095 14.697% 14.697% ### ( 1, 2 ] 59077 61.601% 76.299% ############ ( 2, 3 ] 12943 13.496% 89.795% ### ( 3, 4 ] 4931 5.142% 94.936% # ( 4, 6 ] 3532 3.683% 98.619% # ( 6, 10 ] 1091 1.138% 99.757% ( 10, 15 ] 176 0.184% 99.941% ( 15, 22 ] 29 0.030% 99.971% ( 22, 34 ] 9 0.009% 99.980% ( 34, 51 ] 2 0.002% 99.982% ( 76, 110 ] 3 0.003% 99.985% ( 110, 170 ] 4 0.004% 99.990% ( 170, 250 ] 5 0.005% 99.995% ( 250, 380 ] 3 0.003% 99.998% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 262040 Average: 3.2412 StdDev: 46.49 Min: 0 Median: 1.6165 Max: 6173 Percentiles: P50: 1.62 P75: 1.99 P99: 8.96 P99.9: 150.37 P99.99: 1395.52 ------------------------------------------------------ [ 0, 1 ] 24106 9.199% 9.199% ## ( 1, 2 ] 173407 66.176% 75.375% ############# ( 2, 3 ] 38523 14.701% 90.076% ### ( 3, 4 ] 12446 4.750% 94.826% # ( 4, 6 ] 7409 2.827% 97.653% # ( 6, 10 ] 4762 1.817% 99.471% ( 10, 15 ] 489 0.187% 99.657% ( 15, 22 ] 62 0.024% 99.681% ( 22, 34 ] 15 0.006% 99.687% ( 34, 51 ] 219 0.084% 99.770% ( 51, 76 ] 92 0.035% 99.805% ( 76, 110 ] 71 0.027% 99.832% ( 110, 170 ] 263 0.100% 99.933% ( 170, 250 ] 82 0.031% 99.964% ( 250, 380 ] 46 0.018% 99.982% ( 380, 580 ] 12 0.005% 99.986% ( 580, 870 ] 7 0.003% 99.989% ( 870, 1300 ] 2 0.001% 99.990% ( 1300, 1900 ] 5 0.002% 99.992% ( 1900, 2900 ] 4 0.002% 99.993% ( 2900, 4400 ] 12 0.005% 99.998% ( 4400, 6600 ] 13 0.005% 100.003% ** Level 4 read latency histogram (micros): Count: 50 Average: 1375.9000 StdDev: 1947.01 Min: 0 Median: 34.0000 Max: 5863 Percentiles: P50: 34.00 P75: 2525.00 P99: 5863.00 P99.9: 5863.00 P99.99: 5863.00 ------------------------------------------------------ [ 0, 1 ] 8 16.000% 16.000% ### ( 1, 2 ] 6 12.000% 28.000% ## ( 2, 3 ] 3 6.000% 34.000% # ( 3, 4 ] 2 4.000% 38.000% # ( 6, 10 ] 2 4.000% 42.000% # ( 10, 15 ] 1 2.000% 44.000% ( 22, 34 ] 3 6.000% 50.000% # ( 34, 51 ] 1 2.000% 52.000% ( 51, 76 ] 1 2.000% 54.000% ( 110, 170 ] 1 2.000% 56.000% ( 170, 250 ] 2 4.000% 60.000% # ( 580, 870 ] 2 4.000% 64.000% # ( 870, 1300 ] 1 2.000% 66.000% ( 1300, 1900 ] 2 4.000% 70.000% # ( 1900, 2900 ] 4 8.000% 78.000% ## ( 2900, 4400 ] 4 8.000% 86.000% ## ( 4400, 6600 ] 7 14.000% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 551.3500 StdDev: 592.66 Min: 124 Median: 170.0000 Max: 2032 Percentiles: P50: 170.00 P75: 870.00 P99: 2032.00 P99.9: 2032.00 P99.99: 2032.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 170, 250 ] 1 5.000% 55.000% # ( 250, 380 ] 1 5.000% 60.000% # ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.3 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 319.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.918 H:M:S, 7.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 293.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.541 H:M:S, 16.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.245 micros/op 235560 ops/sec 20.003 seconds 4711999 operations; 228.2 MB/s Microseconds per write: Count: 4711999 Average: 4.2452 StdDev: 152.02 Min: 1 Median: 1.7663 Max: 207895 Percentiles: P50: 1.77 P75: 3.04 P99: 9.02 P99.9: 295.31 P99.99: 2354.74 ------------------------------------------------------ [ 0, 1 ] 616905 13.092% 13.092% ### ( 1, 2 ] 2269439 48.163% 61.255% ########## ( 2, 3 ] 623957 13.242% 74.497% ### ( 3, 4 ] 658302 13.971% 88.468% ### ( 4, 6 ] 451147 9.574% 98.042% ## ( 6, 10 ] 59840 1.270% 99.312% ( 10, 15 ] 16752 0.356% 99.668% ( 15, 22 ] 4929 0.105% 99.772% ( 22, 34 ] 1124 0.024% 99.796% ( 34, 51 ] 141 0.003% 99.799% ( 51, 76 ] 19 0.000% 99.800% ( 76, 110 ] 4 0.000% 99.800% ( 110, 170 ] 4441 0.094% 99.894% ( 170, 250 ] 264 0.006% 99.900% ( 250, 380 ] 66 0.001% 99.901% ( 380, 580 ] 7 0.000% 99.901% ( 580, 870 ] 4 0.000% 99.901% ( 870, 1300 ] 3793 0.080% 99.982% ( 1300, 1900 ] 5 0.000% 99.982% ( 1900, 2900 ] 855 0.018% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 195306 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4711999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4862782968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 149 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 6425143 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9112807753 rocksdb.compact.write.bytes COUNT : 8921418116 rocksdb.flush.write.bytes COUNT : 4815055140 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 12 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 74 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4783283200 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8318976 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9152876713 rocksdb.non.last.level.read.count COUNT : 2210549 rocksdb.block.checksum.compute.count COUNT : 2210263 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.427471 P95 : 4.735877 P99 : 7.585621 P100 : 207894.000000 COUNT : 4711999 SUM : 17849660 rocksdb.compaction.times.micros P50 : 1003846.153846 P95 : 4090000.000000 P99 : 4383208.000000 P100 : 4383208.000000 COUNT : 23 SUM : 26635182 rocksdb.compaction.times.cpu_micros P50 : 1003846.153846 P95 : 3495000.000000 P99 : 4043719.000000 P100 : 4043719.000000 COUNT : 23 SUM : 25723455 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 574.285714 P95 : 1375.000000 P99 : 1795.000000 P100 : 1864.000000 COUNT : 70 SUM : 51758 rocksdb.compaction.outfile.sync.micros P50 : 681.891892 P95 : 1203.250000 P99 : 1964.000000 P100 : 1964.000000 COUNT : 74 SUM : 51080 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 87.137931 P95 : 292.250000 P99 : 379.783333 P100 : 402.000000 COUNT : 101 SUM : 11355 rocksdb.table.open.io.micros P50 : 789.025974 P95 : 15377.777778 P99 : 20274.000000 P100 : 20274.000000 COUNT : 149 SUM : 371735 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.613458 P95 : 6.610232 P99 : 11.292584 P100 : 13259.000000 COUNT : 2210047 SUM : 10906042 rocksdb.read.block.get.micros P50 : 377.678571 P95 : 4250.000000 P99 : 6131.714286 P100 : 6340.000000 COUNT : 298 SUM : 241372 rocksdb.write.raw.block.micros P50 : 0.512976 P95 : 0.974654 P99 : 2.865210 P100 : 4763.000000 COUNT : 3327595 SUM : 6268674 rocksdb.numfiles.in.singlecompaction P50 : 3.343750 P95 : 11.125000 P99 : 13.000000 P100 : 13.000000 COUNT : 31 SUM : 122 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562374 P95 : 1157.650290 P99 : 2409.789474 P100 : 207701.000000 COUNT : 42313 SUM : 6430337 rocksdb.sst.read.micros P50 : 1.553158 P95 : 3.707375 P99 : 8.140758 P100 : 6173.000000 COUNT : 2210932 SUM : 6410884 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4711999 SUM : 4862782968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 188000.000000 P95 : 266250.000000 P99 : 349676.000000 P100 : 349676.000000 COUNT : 70 SUM : 12824593 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 94 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0