[2024-12-09 05:08:05.708612] Starting SPDK v25.01-pre git sha1 cabd61f7f / DPDK 24.03.0 initialization... [2024-12-09 05:08:05.708917] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318631 ] Set seed to 1733717285702575 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-09 05:08:06.024082] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-09 05:08:06.269277] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-09 05:08:06.269395] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 318631' to capture a snapshot of events at runtime. [2024-12-09 05:08:06.269432] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-09 05:08:06.269464] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-09 05:08:06.269491] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid318631 for offline analysis/debug. [2024-12-09 05:08:06.272389] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Dec 9 05:08:15 2024 CPU: 36 * Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz CPUCache: 46080 KB 2024/12/09-05:08:22 ... thread 0: (1000000,1000000) ops and (131970.2,131970.2) ops/second in (7.577466,7.577466) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 627.84 MB 37.6 0.2 0.0 0.2 1.1 0.9 0.0 1.3 47.5 213.6 5.30 4.73 15 0.353 255K 1249 0.0 0.0 L1 3/3 188.15 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 107.4 107.1 1.76 1.71 1 1.757 191K 591 0.0 0.0 L2 1/1 100.54 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.6 105.2 105.0 1.53 1.45 1 1.528 163K 330 0.0 0.0 L3 18/11 878.85 MB 0.1 0.1 0.1 0.0 0.1 0.1 0.0 1.0 88.4 88.4 0.68 0.59 1 0.678 60K 0 0.0 0.0 L4 140/0 9.72 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.61 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 285/19 20.09 GB 0.0 0.6 0.3 0.3 1.5 1.2 0.1 1.7 71.4 166.3 9.26 8.48 18 0.514 671K 2170 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.3 0.3 1.5 1.2 0.1 1.7 71.4 166.3 9.26 8.48 18 0.514 671K 2170 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.3 0.3 0.6 0.3 0.0 0.0 125.5 125.0 5.27 5.02 4 1.317 671K 2170 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 220.8 3.99 3.46 14 0.285 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.6 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.50 GB write, 199.35 MB/s write, 0.65 GB read, 85.60 MB/s read, 9.3 seconds Interval compaction: 1.50 GB write, 203.18 MB/s write, 0.65 GB read, 87.25 MB/s read, 9.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 176001 Average: 4.0400 StdDev: 12.67 Min: 1 Median: 3.2990 Max: 3389 Percentiles: P50: 3.30 P75: 3.82 P99: 11.20 P99.9: 21.27 P99.99: 31.68 ------------------------------------------------------ [ 0, 1 ] 63 0.036% 0.036% ( 1, 2 ] 20594 11.701% 11.737% ## ( 2, 3 ] 42075 23.906% 35.643% ##### ( 3, 4 ] 84522 48.024% 83.667% ########## ( 4, 6 ] 21418 12.169% 95.836% ## ( 6, 10 ] 5185 2.946% 98.782% # ( 10, 15 ] 1599 0.909% 99.690% ( 15, 22 ] 412 0.234% 99.924% ( 22, 34 ] 143 0.081% 100.006% ( 34, 51 ] 9 0.005% 100.011% ( 51, 76 ] 1 0.001% 100.011% ( 110, 170 ] 1 0.001% 100.012% ( 170, 250 ] 10 0.006% 100.018% ( 250, 380 ] 1 0.001% 100.018% ( 380, 580 ] 3 0.002% 100.020% ( 580, 870 ] 10 0.006% 100.026% ( 870, 1300 ] 3 0.002% 100.027% ( 1300, 1900 ] 1 0.001% 100.028% ( 1900, 2900 ] 1 0.001% 100.028% ( 2900, 4400 ] 1 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 36054 Average: 4.8765 StdDev: 22.91 Min: 2 Median: 3.7476 Max: 3898 Percentiles: P50: 3.75 P75: 4.70 P99: 12.52 P99.9: 27.32 P99.99: 519.46 ------------------------------------------------------ ( 1, 2 ] 4 0.011% 0.011% ( 2, 3 ] 1414 3.922% 3.933% # ( 3, 4 ] 22215 61.616% 65.549% ############ ( 4, 6 ] 9799 27.179% 92.728% ##### ( 6, 10 ] 2038 5.653% 98.380% # ( 10, 15 ] 444 1.231% 99.612% ( 15, 22 ] 84 0.233% 99.845% ( 22, 34 ] 45 0.125% 99.969% ( 34, 51 ] 5 0.014% 99.983% ( 250, 380 ] 1 0.003% 99.986% ( 380, 580 ] 2 0.006% 99.992% ( 580, 870 ] 1 0.003% 99.994% ( 1300, 1900 ] 1 0.003% 99.997% ( 2900, 4400 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 40231 Average: 6.3988 StdDev: 59.80 Min: 2 Median: 3.6566 Max: 6658 Percentiles: P50: 3.66 P75: 4.45 P99: 18.97 P99.9: 350.28 P99.99: 2888.45 ------------------------------------------------------ ( 1, 2 ] 1 0.002% 0.002% ( 2, 3 ] 4281 10.641% 10.644% ## ( 3, 4 ] 24114 59.939% 70.582% ############ ( 4, 6 ] 7961 19.788% 90.371% #### ( 6, 10 ] 2445 6.077% 96.448% # ( 10, 15 ] 865 2.150% 98.598% ( 15, 22 ] 285 0.708% 99.307% ( 22, 34 ] 126 0.313% 99.620% ( 34, 51 ] 9 0.022% 99.642% ( 51, 76 ] 1 0.002% 99.645% ( 76, 110 ] 1 0.002% 99.647% ( 110, 170 ] 23 0.057% 99.704% ( 170, 250 ] 51 0.127% 99.831% ( 250, 380 ] 36 0.089% 99.920% ( 380, 580 ] 17 0.042% 99.963% ( 580, 870 ] 4 0.010% 99.973% ( 870, 1300 ] 4 0.010% 99.983% ( 1300, 1900 ] 1 0.002% 99.985% ( 1900, 2900 ] 2 0.005% 99.990% ( 2900, 4400 ] 1 0.002% 99.993% ( 4400, 6600 ] 2 0.005% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 35915 Average: 17.7003 StdDev: 324.10 Min: 3 Median: 4.3574 Max: 16460 Percentiles: P50: 4.36 P75: 5.53 P99: 29.29 P99.9: 3717.50 P99.99: 16253.60 ------------------------------------------------------ ( 2, 3 ] 188 0.523% 0.523% ( 3, 4 ] 15031 41.852% 42.375% ######## ( 4, 6 ] 15326 42.673% 85.048% ######### ( 6, 10 ] 3438 9.573% 94.621% ## ( 10, 15 ] 971 2.704% 97.324% # ( 15, 22 ] 456 1.270% 98.594% ( 22, 34 ] 240 0.668% 99.262% ( 34, 51 ] 14 0.039% 99.301% ( 76, 110 ] 3 0.008% 99.309% ( 110, 170 ] 1 0.003% 99.312% ( 170, 250 ] 82 0.228% 99.541% ( 250, 380 ] 56 0.156% 99.697% ( 380, 580 ] 37 0.103% 99.800% ( 580, 870 ] 13 0.036% 99.836% ( 870, 1300 ] 4 0.011% 99.847% ( 1300, 1900 ] 2 0.006% 99.852% ( 1900, 2900 ] 10 0.028% 99.880% ( 2900, 4400 ] 13 0.036% 99.916% ( 4400, 6600 ] 7 0.019% 99.936% ( 6600, 9900 ] 5 0.014% 99.950% ( 9900, 14000 ] 13 0.036% 99.986% ( 14000, 22000 ] 5 0.014% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 8242.8667 StdDev: 3867.91 Min: 1618 Median: 8250.0000 Max: 14032 Percentiles: P50: 8250.00 P75: 12120.83 P99: 14032.00 P99.9: 14032.00 P99.99: 14032.00 ------------------------------------------------------ ( 1300, 1900 ] 1 6.667% 6.667% # ( 4400, 6600 ] 6 40.000% 46.667% ######## ( 6600, 9900 ] 1 6.667% 53.333% # ( 9900, 14000 ] 6 40.000% 93.333% ######## ( 14000, 22000 ] 1 6.667% 100.000% # ** DB Stats ** Uptime(secs): 7.7 total, 7.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 127.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/09-05:08:30 ... thread 0: (1000000,2000000) ops and (127487.7,129690.2) ops/second in (7.843896,15.421362) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 1.35 GB 6.3 0.7 0.0 0.7 2.6 1.8 0.0 1.4 48.5 169.5 15.57 14.04 33 0.472 766K 3690 0.0 0.0 L1 1/1 49.82 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 100.0 99.4 6.28 6.09 2 3.142 638K 4208 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 105.2 105.0 1.53 1.45 1 1.528 163K 330 0.0 0.0 L3 21/2 1.08 GB 0.9 1.4 0.5 0.9 1.4 0.5 0.0 2.7 100.4 100.1 14.60 13.68 5 2.921 1489K 3924 0.0 0.0 L4 140/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 120/0 8.92 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 295/15 21.06 GB 0.0 2.9 1.0 1.9 4.8 2.9 1.0 2.6 79.3 128.6 37.98 35.25 41 0.926 3057K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.0 1.9 4.8 2.9 1.0 2.6 79.3 128.6 37.98 35.25 41 0.926 3057K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.0 1.9 2.9 1.0 0.0 0.0 109.0 108.6 27.61 26.29 11 2.510 3057K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 182.0 10.37 8.96 30 0.346 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.77 GB write, 313.82 MB/s write, 2.94 GB read, 193.37 MB/s read, 38.0 seconds Interval compaction: 4.77 GB write, 316.78 MB/s write, 2.94 GB read, 195.19 MB/s read, 38.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 452860 Average: 4.4167 StdDev: 18.00 Min: 1 Median: 3.1351 Max: 3389 Percentiles: P50: 3.14 P75: 4.16 P99: 13.02 P99.9: 31.08 P99.99: 358.21 ------------------------------------------------------ [ 0, 1 ] 115 0.025% 0.025% ( 1, 2 ] 69801 15.413% 15.439% ### ( 2, 3 ] 140025 30.920% 46.359% ###### ( 3, 4 ] 122062 26.954% 73.313% ##### ( 4, 6 ] 96082 21.217% 94.529% #### ( 6, 10 ] 16681 3.683% 98.213% # ( 10, 15 ] 5907 1.304% 99.517% ( 15, 22 ] 1388 0.306% 99.824% ( 22, 34 ] 459 0.101% 99.925% ( 34, 51 ] 25 0.006% 99.930% ( 51, 76 ] 5 0.001% 99.932% ( 110, 170 ] 16 0.004% 99.935% ( 170, 250 ] 144 0.032% 99.967% ( 250, 380 ] 127 0.028% 99.995% ( 380, 580 ] 84 0.019% 100.013% ( 580, 870 ] 54 0.012% 100.025% ( 870, 1300 ] 11 0.002% 100.028% ( 1300, 1900 ] 10 0.002% 100.030% ( 1900, 2900 ] 4 0.001% 100.031% ( 2900, 4400 ] 2 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 145885 Average: 5.7136 StdDev: 21.15 Min: 2 Median: 4.2719 Max: 3898 Percentiles: P50: 4.27 P75: 5.42 P99: 17.61 P99.9: 51.96 P99.99: 809.52 ------------------------------------------------------ ( 1, 2 ] 4 0.003% 0.003% ( 2, 3 ] 1697 1.163% 1.166% ( 3, 4 ] 62619 42.924% 44.090% ######### ( 4, 6 ] 63417 43.471% 87.560% ######### ( 6, 10 ] 13241 9.076% 96.636% ## ( 10, 15 ] 3016 2.067% 98.704% ( 15, 22 ] 1160 0.795% 99.499% ( 22, 34 ] 547 0.375% 99.874% ( 34, 51 ] 38 0.026% 99.900% ( 51, 76 ] 3 0.002% 99.902% ( 110, 170 ] 2 0.001% 99.903% ( 170, 250 ] 26 0.018% 99.921% ( 250, 380 ] 48 0.033% 99.954% ( 380, 580 ] 35 0.024% 99.978% ( 580, 870 ] 22 0.015% 99.993% ( 870, 1300 ] 5 0.003% 99.997% ( 1300, 1900 ] 2 0.001% 99.998% ( 1900, 2900 ] 3 0.002% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 65640 Average: 6.0534 StdDev: 48.84 Min: 2 Median: 3.7642 Max: 6658 Percentiles: P50: 3.76 P75: 4.87 P99: 18.84 P99.9: 294.45 P99.99: 2118.00 ------------------------------------------------------ ( 1, 2 ] 1 0.002% 0.002% ( 2, 3 ] 4613 7.028% 7.029% # ( 3, 4 ] 36907 56.226% 63.256% ########### ( 4, 6 ] 17667 26.915% 90.171% ##### ( 6, 10 ] 4109 6.260% 96.431% # ( 10, 15 ] 1344 2.048% 98.478% ( 15, 22 ] 624 0.951% 99.429% ( 22, 34 ] 193 0.294% 99.723% ( 34, 51 ] 12 0.018% 99.741% ( 51, 76 ] 1 0.002% 99.743% ( 76, 110 ] 1 0.002% 99.744% ( 110, 170 ] 23 0.035% 99.779% ( 170, 250 ] 65 0.099% 99.878% ( 250, 380 ] 42 0.064% 99.942% ( 380, 580 ] 20 0.030% 99.973% ( 580, 870 ] 5 0.008% 99.980% ( 870, 1300 ] 5 0.008% 99.988% ( 1300, 1900 ] 1 0.002% 99.989% ( 1900, 2900 ] 2 0.003% 99.992% ( 2900, 4400 ] 2 0.003% 99.995% ( 4400, 6600 ] 2 0.003% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 237603 Average: 8.6554 StdDev: 129.79 Min: 2 Median: 4.5576 Max: 16460 Percentiles: P50: 4.56 P75: 5.53 P99: 21.28 P99.9: 532.93 P99.99: 5290.92 ------------------------------------------------------ ( 1, 2 ] 11 0.005% 0.005% ( 2, 3 ] 911 0.383% 0.388% ( 3, 4 ] 83729 35.239% 35.627% ####### ( 4, 6 ] 122484 51.550% 87.177% ########## ( 6, 10 ] 19457 8.189% 95.366% ## ( 10, 15 ] 5375 2.262% 97.628% ( 15, 22 ] 3635 1.530% 99.158% ( 22, 34 ] 903 0.380% 99.538% ( 34, 51 ] 61 0.026% 99.564% ( 51, 76 ] 2 0.001% 99.564% ( 76, 110 ] 5 0.002% 99.567% ( 110, 170 ] 25 0.011% 99.577% ( 170, 250 ] 385 0.162% 99.739% ( 250, 380 ] 218 0.092% 99.831% ( 380, 580 ] 215 0.090% 99.921% ( 580, 870 ] 76 0.032% 99.953% ( 870, 1300 ] 35 0.015% 99.968% ( 1300, 1900 ] 21 0.009% 99.977% ( 1900, 2900 ] 15 0.006% 99.983% ( 2900, 4400 ] 13 0.005% 99.989% ( 4400, 6600 ] 8 0.003% 99.992% ( 6600, 9900 ] 5 0.002% 99.994% ( 9900, 14000 ] 13 0.005% 100.000% ( 14000, 22000 ] 5 0.002% 100.002% ** Level 4 read latency histogram (micros): Count: 15 Average: 8242.8667 StdDev: 3867.91 Min: 1618 Median: 8250.0000 Max: 14032 Percentiles: P50: 8250.00 P75: 12120.83 P99: 14032.00 P99.9: 14032.00 P99.99: 14032.00 ------------------------------------------------------ ( 1300, 1900 ] 1 6.667% 6.667% # ( 4400, 6600 ] 6 40.000% 46.667% ######## ( 6600, 9900 ] 1 6.667% 53.333% # ( 9900, 14000 ] 6 40.000% 93.333% ######## ( 14000, 22000 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1735.6000 StdDev: 1662.98 Min: 281 Median: 1085.0000 Max: 6732 Percentiles: P50: 1085.00 P75: 1900.00 P99: 6732.00 P99.9: 6732.00 P99.99: 6732.00 ------------------------------------------------------ ( 250, 380 ] 2 10.000% 10.000% ## ( 380, 580 ] 2 10.000% 20.000% ## ( 580, 870 ] 5 25.000% 45.000% ##### ( 870, 1300 ] 2 10.000% 55.000% ## ( 1300, 1900 ] 4 20.000% 75.000% #### ( 1900, 2900 ] 1 5.000% 80.000% # ( 2900, 4400 ] 2 10.000% 90.000% ## ( 4400, 6600 ] 1 5.000% 95.000% # ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 7.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 126.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 7.681 micros/op 130184 ops/sec 20.002 seconds 2603999 operations; 126.1 MB/s Microseconds per write: Count: 2603999 Average: 7.6813 StdDev: 21.25 Min: 3 Median: 5.8209 Max: 30815 Percentiles: P50: 5.82 P75: 8.64 P99: 20.27 P99.9: 174.32 P99.99: 369.00 ------------------------------------------------------ ( 2, 3 ] 4227 0.162% 0.162% ( 3, 4 ] 167763 6.443% 6.605% # ( 4, 6 ] 1241131 47.662% 54.267% ########## ( 6, 10 ] 818889 31.447% 85.715% ###### ( 10, 15 ] 316501 12.154% 97.869% ## ( 15, 22 ] 39152 1.504% 99.373% ( 22, 34 ] 12293 0.472% 99.845% ( 34, 51 ] 1107 0.043% 99.887% ( 51, 76 ] 215 0.008% 99.896% ( 76, 110 ] 59 0.002% 99.898% ( 110, 170 ] 14 0.001% 99.898% ( 170, 250 ] 814 0.031% 99.930% ( 250, 380 ] 1719 0.066% 99.996% ( 380, 580 ] 102 0.004% 100.000% ( 580, 870 ] 9 0.000% 100.000% ( 1300, 1900 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 42872 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 2603999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 2687326968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 130 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 0 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 5370552540 rocksdb.compact.write.bytes COUNT : 5323706470 rocksdb.flush.write.bytes COUNT : 2572848785 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 19 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 55 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 2555505664 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4099072 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 5401020596 rocksdb.non.last.level.read.count COUNT : 1302160 rocksdb.block.checksum.compute.count COUNT : 1301919 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 4.810012 P95 : 12.046365 P99 : 17.276718 P100 : 1558.000000 COUNT : 2603999 SUM : 16475833 rocksdb.compaction.times.micros P50 : 1850000.000000 P95 : 8562500.000000 P99 : 8881420.000000 P100 : 8881420.000000 COUNT : 15 SUM : 40925460 rocksdb.compaction.times.cpu_micros P50 : 1850000.000000 P95 : 7325000.000000 P99 : 8344758.000000 P100 : 8344758.000000 COUNT : 15 SUM : 38900217 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1490.909091 P95 : 3336.000000 P99 : 3336.000000 P100 : 3336.000000 COUNT : 39 SUM : 65164 rocksdb.compaction.outfile.sync.micros P50 : 1590.000000 P95 : 2756.666667 P99 : 3413.000000 P100 : 3413.000000 COUNT : 63 SUM : 99403 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 279.791667 P95 : 739.500000 P99 : 934.000000 P100 : 934.000000 COUNT : 65 SUM : 21527 rocksdb.table.open.io.micros P50 : 2150.000000 P95 : 39954.545455 P99 : 43783.000000 P100 : 43783.000000 COUNT : 130 SUM : 843272 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 7.592161 P95 : 14.519553 P99 : 25.313497 P100 : 8113.000000 COUNT : 1301663 SUM : 12094921 rocksdb.read.block.get.micros P50 : 863.555556 P95 : 11813.333333 P99 : 16616.000000 P100 : 16616.000000 COUNT : 260 SUM : 570326 rocksdb.write.raw.block.micros P50 : 0.812200 P95 : 1.934279 P99 : 7.096500 P100 : 5935.000000 COUNT : 1927906 SUM : 7113416 rocksdb.numfiles.in.singlecompaction P50 : 3.375000 P95 : 9.200000 P99 : 12.000000 P100 : 12.000000 COUNT : 28 SUM : 116 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.sst.read.micros P50 : 3.627044 P95 : 8.299481 P99 : 15.804875 P100 : 16460.000000 COUNT : 1302406 SUM : 7371508 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 2603999 SUM : 2687326968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 384750.000000 P95 : 478643.000000 P99 : 478643.000000 P100 : 478643.000000 COUNT : 39 SUM : 13847203 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 68 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0