[2024-07-15 13:34:08.490294] Starting SPDK v24.09-pre git sha1 9cede6267 / DPDK 24.03.0 initialization... [2024-07-15 13:34:08.490423] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1486777 ] Set seed to 1721043248487627 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 13:34:08.624641] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 13:34:08.850041] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 13:34:08.850094] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1486777' to capture a snapshot of events at runtime. [2024-07-15 13:34:08.850108] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 13:34:08.850121] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 13:34:08.850131] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1486777 for offline analysis/debug. [2024-07-15 13:34:08.850288] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 13:34:12 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/15-13:34:18 ... thread 0: (1000000,1000000) ops and (165151.7,165151.7) ops/second in (6.055040,6.055040) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.32 GB 56.4 0.3 0.0 0.3 1.2 0.9 0.0 1.4 39.0 147.8 8.07 4.16 12 0.673 319K 1957 0.0 0.0 L1 3/3 186.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 12/12 1.43 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 28/8 1.74 GB 1.2 2.3 1.9 0.5 2.3 1.8 0.0 1.2 128.9 126.7 18.40 12.54 9 2.044 249K 0 0.0 0.0 L4 137/28 10.06 GB 0.8 1.4 0.5 0.9 1.2 0.4 0.1 2.5 143.1 130.7 9.72 6.11 6 1.620 379K 51 0.0 0.0 L5 124/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 317/60 24.26 GB 0.0 4.0 2.3 1.6 4.7 3.0 0.1 5.4 112.7 132.5 36.19 22.81 27 1.340 948K 2008 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 2.3 1.6 4.7 3.0 0.1 5.4 112.7 132.5 36.19 22.81 27 1.340 948K 2008 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 2.3 1.6 3.8 2.2 0.0 0.0 133.3 127.9 30.59 20.14 16 1.912 948K 2008 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 157.2 5.60 2.67 11 0.509 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 6.1 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.68 GB write, 781.52 MB/s write, 3.98 GB read, 664.73 MB/s read, 36.2 seconds Interval compaction: 4.68 GB write, 791.34 MB/s write, 3.98 GB read, 673.09 MB/s read, 36.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 191136 Average: 45.3829 StdDev: 441.10 Min: 1 Median: 2.1626 Max: 51776 Percentiles: P50: 2.16 P75: 3.17 P99: 1019.88 P99.9: 4044.52 P99.99: 6328.33 ------------------------------------------------------ [ 0, 1 ] 3809 1.993% 1.993% ( 1, 2 ] 83066 43.459% 45.452% ######### ( 2, 3 ] 53466 27.973% 73.425% ###### ( 3, 4 ] 18082 9.460% 82.885% ## ( 4, 6 ] 19275 10.084% 92.969% ## ( 6, 10 ] 5161 2.700% 95.670% # ( 10, 15 ] 925 0.484% 96.154% ( 15, 22 ] 94 0.049% 96.203% ( 22, 34 ] 21 0.011% 96.214% ( 34, 51 ] 26 0.014% 96.227% ( 51, 76 ] 10 0.005% 96.233% ( 76, 110 ] 5 0.003% 96.235% ( 110, 170 ] 42 0.022% 96.257% ( 170, 250 ] 246 0.129% 96.386% ( 250, 380 ] 811 0.424% 96.810% ( 380, 580 ] 1790 0.937% 97.747% ( 580, 870 ] 2007 1.050% 98.797% ( 870, 1300 ] 1115 0.583% 99.380% ( 1300, 1900 ] 327 0.171% 99.551% ( 1900, 2900 ] 367 0.192% 99.743% ( 2900, 4400 ] 393 0.206% 99.949% ( 4400, 6600 ] 90 0.047% 99.996% ( 6600, 9900 ] 25 0.013% 100.009% ( 9900, 14000 ] 10 0.005% 100.014% ( 14000, 22000 ] 19 0.010% 100.024% ( 22000, 33000 ] 8 0.004% 100.028% ( 33000, 50000 ] 5 0.003% 100.031% ( 50000, 75000 ] 1 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 199 Average: 1096.9146 StdDev: 1536.86 Min: 135 Median: 648.9344 Max: 11414 Percentiles: P50: 648.93 P75: 930.76 P99: 9920.50 P99.9: 11414.00 P99.99: 11414.00 ------------------------------------------------------ ( 110, 170 ] 3 1.508% 1.508% ( 170, 250 ] 8 4.020% 5.528% # ( 250, 380 ] 23 11.558% 17.085% ## ( 380, 580 ] 51 25.628% 42.714% ##### ( 580, 870 ] 61 30.653% 73.367% ###### ( 870, 1300 ] 23 11.558% 84.925% ## ( 1300, 1900 ] 5 2.513% 87.437% # ( 1900, 2900 ] 8 4.020% 91.457% # ( 2900, 4400 ] 8 4.020% 95.477% # ( 4400, 6600 ] 5 2.513% 97.990% # ( 6600, 9900 ] 2 1.005% 98.995% ( 9900, 14000 ] 2 1.005% 100.000% ** Level 2 read latency histogram (micros): Count: 510356 Average: 13.2847 StdDev: 272.36 Min: 1 Median: 2.2220 Max: 47485 Percentiles: P50: 2.22 P75: 3.16 P99: 12.84 P99.9: 790.88 P99.99: 1154.37 ------------------------------------------------------ [ 0, 1 ] 4795 0.940% 0.940% ( 1, 2 ] 216452 42.412% 43.352% ######## ( 2, 3 ] 152816 29.943% 73.295% ###### ( 3, 4 ] 55968 10.966% 84.261% ## ( 4, 6 ] 58567 11.476% 95.737% ## ( 6, 10 ] 14853 2.910% 98.647% # ( 10, 15 ] 3170 0.621% 99.268% ( 15, 22 ] 385 0.075% 99.344% ( 22, 34 ] 64 0.013% 99.356% ( 34, 51 ] 124 0.024% 99.380% ( 51, 76 ] 103 0.020% 99.401% ( 76, 110 ] 35 0.007% 99.407% ( 110, 170 ] 44 0.009% 99.416% ( 170, 250 ] 215 0.042% 99.458% ( 250, 380 ] 714 0.140% 99.598% ( 380, 580 ] 988 0.194% 99.792% ( 580, 870 ] 760 0.149% 99.941% ( 870, 1300 ] 381 0.075% 100.015% ( 1300, 1900 ] 197 0.039% 100.054% ( 1900, 2900 ] 235 0.046% 100.100% ( 2900, 4400 ] 182 0.036% 100.136% ( 4400, 6600 ] 65 0.013% 100.148% ( 6600, 9900 ] 40 0.008% 100.156% ( 9900, 14000 ] 26 0.005% 100.161% ( 14000, 22000 ] 37 0.007% 100.169% ( 22000, 33000 ] 8 0.002% 100.170% ( 33000, 50000 ] 5 0.001% 100.171% ** Level 3 read latency histogram (micros): Count: 272889 Average: 19.2142 StdDev: 316.72 Min: 1 Median: 2.3444 Max: 63940 Percentiles: P50: 2.34 P75: 3.38 P99: 372.26 P99.9: 1987.49 P99.99: 3286.67 ------------------------------------------------------ [ 0, 1 ] 2188 0.802% 0.802% ( 1, 2 ] 104853 38.423% 39.225% ######## ( 2, 3 ] 85364 31.282% 70.507% ###### ( 3, 4 ] 31868 11.678% 82.185% ## ( 4, 6 ] 34839 12.767% 94.951% ### ( 6, 10 ] 8248 3.022% 97.974% # ( 10, 15 ] 1746 0.640% 98.614% ( 15, 22 ] 204 0.075% 98.688% ( 22, 34 ] 48 0.018% 98.706% ( 34, 51 ] 96 0.035% 98.741% ( 51, 76 ] 84 0.031% 98.772% ( 76, 110 ] 27 0.010% 98.782% ( 110, 170 ] 45 0.016% 98.798% ( 170, 250 ] 157 0.058% 98.856% ( 250, 380 ] 418 0.153% 99.009% ( 380, 580 ] 776 0.284% 99.293% ( 580, 870 ] 899 0.329% 99.623% ( 870, 1300 ] 523 0.192% 99.815% ( 1300, 1900 ] 215 0.079% 99.893% ( 1900, 2900 ] 207 0.076% 99.969% ( 2900, 4400 ] 220 0.081% 100.050% ( 4400, 6600 ] 32 0.012% 100.062% ( 6600, 9900 ] 10 0.004% 100.065% ( 9900, 14000 ] 4 0.001% 100.067% ( 14000, 22000 ] 20 0.007% 100.074% ( 22000, 33000 ] 11 0.004% 100.078% ( 33000, 50000 ] 1 0.000% 100.078% ( 50000, 75000 ] 1 0.000% 100.079% ** Level 4 read latency histogram (micros): Count: 473294 Average: 28.3992 StdDev: 358.03 Min: 1 Median: 2.3717 Max: 62817 Percentiles: P50: 2.37 P75: 3.48 P99: 542.46 P99.9: 1175.98 P99.99: 1367.68 ------------------------------------------------------ [ 0, 1 ] 3218 0.680% 0.680% ( 1, 2 ] 179363 37.897% 38.577% ######## ( 2, 3 ] 145454 30.732% 69.309% ###### ( 3, 4 ] 56014 11.835% 81.144% ## ( 4, 6 ] 61363 12.965% 94.109% ### ( 6, 10 ] 14948 3.158% 97.267% # ( 10, 15 ] 3184 0.673% 97.940% ( 15, 22 ] 378 0.080% 98.020% ( 22, 34 ] 75 0.016% 98.036% ( 34, 51 ] 155 0.033% 98.068% ( 51, 76 ] 131 0.028% 98.096% ( 76, 110 ] 44 0.009% 98.105% ( 110, 170 ] 76 0.016% 98.121% ( 170, 250 ] 430 0.091% 98.212% ( 250, 380 ] 1448 0.306% 98.518% ( 380, 580 ] 2807 0.593% 99.111% ( 580, 870 ] 2829 0.598% 99.709% ( 870, 1300 ] 1270 0.268% 99.977% ( 1300, 1900 ] 529 0.112% 100.089% ( 1900, 2900 ] 622 0.131% 100.221% ( 2900, 4400 ] 643 0.136% 100.356% ( 4400, 6600 ] 143 0.030% 100.387% ( 6600, 9900 ] 28 0.006% 100.393% ( 9900, 14000 ] 8 0.002% 100.394% ( 14000, 22000 ] 28 0.006% 100.400% ( 22000, 33000 ] 5 0.001% 100.401% ( 33000, 50000 ] 6 0.001% 100.402% ( 50000, 75000 ] 5 0.001% 100.404% ** Level 5 read latency histogram (micros): Count: 8275 Average: 975.4599 StdDev: 1639.95 Min: 108 Median: 618.4490 Max: 51410 Percentiles: P50: 618.45 P75: 947.32 P99: 5507.24 P99.9: 25162.50 P99.99: 51410.00 ------------------------------------------------------ ( 76, 110 ] 2 0.024% 0.024% ( 110, 170 ] 58 0.701% 0.725% ( 170, 250 ] 357 4.314% 5.039% # ( 250, 380 ] 1145 13.837% 18.876% ### ( 380, 580 ] 2287 27.637% 46.514% ###### ( 580, 870 ] 2176 26.296% 72.810% ##### ( 870, 1300 ] 1008 12.181% 84.991% ## ( 1300, 1900 ] 366 4.423% 89.414% # ( 1900, 2900 ] 381 4.604% 94.018% # ( 2900, 4400 ] 374 4.520% 98.538% # ( 4400, 6600 ] 76 0.918% 99.456% ( 6600, 9900 ] 13 0.157% 99.613% ( 9900, 14000 ] 9 0.109% 99.722% ( 14000, 22000 ] 13 0.157% 99.879% ( 22000, 33000 ] 6 0.073% 99.952% ( 33000, 50000 ] 3 0.036% 99.988% ( 50000, 75000 ] 1 0.012% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 6.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 160.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.422 H:M:S, 23.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 162.45 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.422 H:M:S, 23.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/15-13:34:24 ... thread 0: (1000000,2000000) ops and (158987.1,162010.8) ops/second in (6.289819,12.344859) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.23 GB 112.6 1.4 0.0 1.4 3.2 1.8 0.0 1.8 55.9 126.1 25.87 11.88 30 0.862 1468K 8071 0.0 0.0 L1 3/3 186.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 31/15 2.41 GB 0.9 3.9 3.3 0.6 3.8 3.2 0.0 1.2 137.5 135.3 28.80 20.33 10 2.880 1731K 0 0.0 0.0 L4 141/5 9.57 GB 1.0 5.4 1.2 4.3 4.6 0.4 0.2 4.0 160.2 136.9 34.59 23.00 17 2.035 1078K 51 0.0 0.0 L5 132/0 10.09 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 322/32 24.48 GB 0.0 10.7 4.4 6.3 11.6 5.4 0.7 6.5 122.7 133.2 89.27 55.21 57 1.566 4278K 8122 0.0 0.0 Int 0/0 0.00 KB 0.0 10.7 4.4 6.3 11.6 5.4 0.7 6.5 122.7 133.2 89.27 55.21 57 1.566 4278K 8122 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.7 4.4 6.3 9.8 3.6 0.0 0.0 138.4 127.3 79.10 49.84 32 2.472 4278K 8122 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 179.3 10.17 5.36 25 0.407 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.3 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.61 GB write, 957.29 MB/s write, 10.69 GB read, 881.41 MB/s read, 89.3 seconds Interval compaction: 11.61 GB write, 963.20 MB/s write, 10.69 GB read, 886.84 MB/s read, 89.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 11, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 541722 Average: 48.7034 StdDev: 362.86 Min: 1 Median: 2.0351 Max: 51776 Percentiles: P50: 2.04 P75: 3.15 P99: 855.92 P99.9: 3304.62 P99.99: 4105.63 ------------------------------------------------------ [ 0, 1 ] 16993 3.137% 3.137% # ( 1, 2 ] 249166 45.995% 49.132% ######### ( 2, 3 ] 133775 24.694% 73.826% ##### ( 3, 4 ] 43776 8.081% 81.907% ## ( 4, 6 ] 45247 8.352% 90.260% ## ( 6, 10 ] 11929 2.202% 92.462% ( 10, 15 ] 1931 0.356% 92.818% ( 15, 22 ] 236 0.044% 92.862% ( 22, 34 ] 35 0.006% 92.868% ( 34, 51 ] 49 0.009% 92.877% ( 51, 76 ] 24 0.004% 92.882% ( 76, 110 ] 20 0.004% 92.885% ( 110, 170 ] 1343 0.248% 93.133% ( 170, 250 ] 7968 1.471% 94.604% ( 250, 380 ] 9923 1.832% 96.436% ( 380, 580 ] 8165 1.507% 97.943% ( 580, 870 ] 6017 1.111% 99.054% ( 870, 1300 ] 2653 0.490% 99.544% ( 1300, 1900 ] 804 0.148% 99.692% ( 1900, 2900 ] 880 0.162% 99.855% ( 2900, 4400 ] 913 0.169% 100.023% ( 4400, 6600 ] 167 0.031% 100.054% ( 6600, 9900 ] 35 0.006% 100.060% ( 9900, 14000 ] 13 0.002% 100.063% ( 14000, 22000 ] 25 0.005% 100.067% ( 22000, 33000 ] 18 0.003% 100.071% ( 33000, 50000 ] 8 0.001% 100.072% ( 50000, 75000 ] 1 0.000% 100.072% ** Level 1 read latency histogram (micros): Count: 36013 Average: 17.4287 StdDev: 190.29 Min: 1 Median: 2.7878 Max: 14805 Percentiles: P50: 2.79 P75: 4.63 P99: 378.37 P99.9: 2765.80 P99.99: 8907.85 ------------------------------------------------------ [ 0, 1 ] 212 0.589% 0.589% ( 1, 2 ] 10147 28.176% 28.765% ###### ( 2, 3 ] 9707 26.954% 55.719% ##### ( 3, 4 ] 4559 12.659% 68.378% ### ( 4, 6 ] 7537 20.929% 89.307% #### ( 6, 10 ] 2625 7.289% 96.596% # ( 10, 15 ] 341 0.947% 97.543% ( 15, 22 ] 193 0.536% 98.078% ( 22, 34 ] 24 0.067% 98.145% ( 34, 51 ] 4 0.011% 98.156% ( 51, 76 ] 2 0.006% 98.162% ( 76, 110 ] 3 0.008% 98.170% ( 110, 170 ] 26 0.072% 98.242% ( 170, 250 ] 105 0.292% 98.534% ( 250, 380 ] 170 0.472% 99.006% ( 380, 580 ] 141 0.392% 99.397% ( 580, 870 ] 117 0.325% 99.722% ( 870, 1300 ] 41 0.114% 99.836% ( 1300, 1900 ] 10 0.028% 99.864% ( 1900, 2900 ] 15 0.042% 99.906% ( 2900, 4400 ] 22 0.061% 99.967% ( 4400, 6600 ] 7 0.019% 99.986% ( 6600, 9900 ] 2 0.006% 99.992% ( 9900, 14000 ] 2 0.006% 99.997% ( 14000, 22000 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 690884 Average: 12.8514 StdDev: 253.09 Min: 1 Median: 2.1750 Max: 47485 Percentiles: P50: 2.17 P75: 3.07 P99: 14.33 P99.9: 846.02 P99.99: 1362.02 ------------------------------------------------------ [ 0, 1 ] 7296 1.056% 1.056% ( 1, 2 ] 302578 43.796% 44.852% ######### ( 2, 3 ] 203298 29.426% 74.278% ###### ( 3, 4 ] 72302 10.465% 84.743% ## ( 4, 6 ] 75467 10.923% 95.666% ## ( 6, 10 ] 19730 2.856% 98.522% # ( 10, 15 ] 3818 0.553% 99.074% ( 15, 22 ] 482 0.070% 99.144% ( 22, 34 ] 84 0.012% 99.156% ( 34, 51 ] 144 0.021% 99.177% ( 51, 76 ] 126 0.018% 99.195% ( 76, 110 ] 42 0.006% 99.201% ( 110, 170 ] 194 0.028% 99.230% ( 170, 250 ] 881 0.128% 99.357% ( 250, 380 ] 1362 0.197% 99.554% ( 380, 580 ] 1403 0.203% 99.757% ( 580, 870 ] 1075 0.156% 99.913% ( 870, 1300 ] 508 0.074% 99.986% ( 1300, 1900 ] 241 0.035% 100.021% ( 1900, 2900 ] 303 0.044% 100.065% ( 2900, 4400 ] 230 0.033% 100.098% ( 4400, 6600 ] 71 0.010% 100.109% ( 6600, 9900 ] 43 0.006% 100.115% ( 9900, 14000 ] 30 0.004% 100.119% ( 14000, 22000 ] 40 0.006% 100.125% ( 22000, 33000 ] 11 0.002% 100.127% ( 33000, 50000 ] 6 0.001% 100.128% ** Level 3 read latency histogram (micros): Count: 760986 Average: 14.3798 StdDev: 225.54 Min: 1 Median: 2.2931 Max: 63940 Percentiles: P50: 2.29 P75: 3.24 P99: 186.32 P99.9: 1044.76 P99.99: 1469.75 ------------------------------------------------------ [ 0, 1 ] 5571 0.732% 0.732% ( 1, 2 ] 304459 40.008% 40.741% ######## ( 2, 3 ] 240376 31.587% 72.328% ###### ( 3, 4 ] 84519 11.107% 83.435% ## ( 4, 6 ] 90172 11.849% 95.284% ## ( 6, 10 ] 22219 2.920% 98.204% # ( 10, 15 ] 4460 0.586% 98.790% ( 15, 22 ] 596 0.078% 98.868% ( 22, 34 ] 99 0.013% 98.881% ( 34, 51 ] 232 0.030% 98.912% ( 51, 76 ] 151 0.020% 98.931% ( 76, 110 ] 66 0.009% 98.940% ( 110, 170 ] 249 0.033% 98.973% ( 170, 250 ] 1025 0.135% 99.107% ( 250, 380 ] 1700 0.223% 99.331% ( 380, 580 ] 2072 0.272% 99.603% ( 580, 870 ] 1868 0.245% 99.849% ( 870, 1300 ] 967 0.127% 99.976% ( 1300, 1900 ] 392 0.052% 100.027% ( 1900, 2900 ] 419 0.055% 100.082% ( 2900, 4400 ] 403 0.053% 100.135% ( 4400, 6600 ] 59 0.008% 100.143% ( 6600, 9900 ] 18 0.002% 100.145% ( 9900, 14000 ] 8 0.001% 100.146% ( 14000, 22000 ] 25 0.003% 100.150% ( 22000, 33000 ] 12 0.002% 100.151% ( 33000, 50000 ] 2 0.000% 100.152% ( 50000, 75000 ] 1 0.000% 100.152% ** Level 4 read latency histogram (micros): Count: 1132554 Average: 23.9663 StdDev: 301.96 Min: 1 Median: 2.3188 Max: 62817 Percentiles: P50: 2.32 P75: 3.39 P99: 428.45 P99.9: 863.88 P99.99: 1032.48 ------------------------------------------------------ [ 0, 1 ] 9817 0.867% 0.867% ( 1, 2 ] 447853 39.544% 40.410% ######## ( 2, 3 ] 340646 30.078% 70.488% ###### ( 3, 4 ] 129476 11.432% 81.920% ## ( 4, 6 ] 137550 12.145% 94.065% ## ( 6, 10 ] 34271 3.026% 97.091% # ( 10, 15 ] 7032 0.621% 97.712% ( 15, 22 ] 844 0.075% 97.787% ( 22, 34 ] 192 0.017% 97.804% ( 34, 51 ] 318 0.028% 97.832% ( 51, 76 ] 244 0.022% 97.853% ( 76, 110 ] 97 0.009% 97.862% ( 110, 170 ] 848 0.075% 97.937% ( 170, 250 ] 4487 0.396% 98.333% ( 250, 380 ] 5979 0.528% 98.861% ( 380, 580 ] 6499 0.574% 99.435% ( 580, 870 ] 5382 0.475% 99.910% ( 870, 1300 ] 2397 0.212% 100.122% ( 1300, 1900 ] 906 0.080% 100.202% ( 1900, 2900 ] 1107 0.098% 100.299% ( 2900, 4400 ] 1033 0.091% 100.391% ( 4400, 6600 ] 215 0.019% 100.410% ( 6600, 9900 ] 41 0.004% 100.413% ( 9900, 14000 ] 27 0.002% 100.416% ( 14000, 22000 ] 50 0.004% 100.420% ( 22000, 33000 ] 12 0.001% 100.421% ( 33000, 50000 ] 14 0.001% 100.422% ( 50000, 75000 ] 5 0.000% 100.423% ** Level 5 read latency histogram (micros): Count: 22150 Average: 700.8698 StdDev: 1260.82 Min: 95 Median: 445.8590 Max: 51410 Percentiles: P50: 445.86 P75: 738.46 P99: 4260.84 P99.9: 18925.00 P99.99: 45869.00 ------------------------------------------------------ ( 76, 110 ] 19 0.086% 0.086% ( 110, 170 ] 700 3.160% 3.246% # ( 170, 250 ] 3865 17.449% 20.695% ### ( 250, 380 ] 4833 21.819% 42.515% #### ( 380, 580 ] 5035 22.731% 65.246% ##### ( 580, 870 ] 3954 17.851% 83.097% #### ( 870, 1300 ] 1779 8.032% 91.129% ## ( 1300, 1900 ] 574 2.591% 93.720% # ( 1900, 2900 ] 617 2.786% 96.506% # ( 2900, 4400 ] 609 2.749% 99.255% # ( 4400, 6600 ] 103 0.465% 99.720% ( 6600, 9900 ] 20 0.090% 99.810% ( 9900, 14000 ] 10 0.045% 99.856% ( 14000, 22000 ] 16 0.072% 99.928% ( 22000, 33000 ] 10 0.045% 99.973% ( 33000, 50000 ] 5 0.023% 99.995% ( 50000, 75000 ] 1 0.005% 100.000% ** DB Stats ** Uptime(secs): 12.4 total, 6.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 158.44 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.389 H:M:S, 27.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 156.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.966 H:M:S, 31.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/15-13:34:28 ... thread 0: (1000000,3000000) ops and (261487.6,185538.7) ops/second in (3.824273,16.169132) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 2.81 GB 168.9 2.1 0.0 2.1 5.0 2.8 0.0 1.8 68.1 157.3 32.32 17.73 50 0.646 2235K 11K 0.0 0.0 L1 9/0 647.24 MB 64.7 0.6 0.5 0.2 0.6 0.4 0.0 1.4 49.7 49.1 13.18 3.96 1 13.183 665K 8204 0.0 0.0 L3 16/0 942.82 MB 0.9 3.9 3.3 0.6 3.8 3.2 0.0 1.2 137.5 135.3 28.80 20.33 10 2.880 1731K 0 0.0 0.0 L4 141/0 9.57 GB 1.0 6.9 2.6 4.3 6.1 1.8 0.2 2.3 160.0 141.6 44.47 30.37 22 2.021 2622K 51 0.0 0.0 L5 152/0 11.57 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 336/12 25.50 GB 0.0 13.6 6.4 7.2 15.5 8.3 2.2 5.5 117.3 134.1 118.77 72.39 83 1.431 7255K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.6 6.4 7.2 15.5 8.3 2.2 5.5 117.3 134.1 118.77 72.39 83 1.431 7255K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.6 6.4 7.2 12.7 5.5 0.0 0.0 132.5 123.9 105.15 64.03 41 2.565 7255K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 212.4 13.62 8.36 42 0.324 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.2 total, 16.2 interval Flush(GB): cumulative 2.825, interval 2.825 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.55 GB write, 979.95 MB/s write, 13.60 GB read, 857.42 MB/s read, 118.8 seconds Interval compaction: 15.55 GB write, 984.56 MB/s write, 13.60 GB read, 861.46 MB/s read, 118.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 11, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 906536 Average: 35.4471 StdDev: 283.86 Min: 1 Median: 1.8079 Max: 51776 Percentiles: P50: 1.81 P75: 2.77 P99: 680.08 P99.9: 2445.57 P99.99: 3564.15 ------------------------------------------------------ [ 0, 1 ] 74489 8.217% 8.217% ## ( 1, 2 ] 468858 51.720% 59.937% ########## ( 2, 3 ] 177397 19.569% 79.505% #### ( 3, 4 ] 54801 6.045% 85.550% # ( 4, 6 ] 52903 5.836% 91.386% # ( 6, 10 ] 15125 1.668% 93.055% ( 10, 15 ] 2322 0.256% 93.311% ( 15, 22 ] 293 0.032% 93.343% ( 22, 34 ] 48 0.005% 93.348% ( 34, 51 ] 57 0.006% 93.355% ( 51, 76 ] 28 0.003% 93.358% ( 76, 110 ] 208 0.023% 93.381% ( 110, 170 ] 6454 0.712% 94.093% ( 170, 250 ] 19948 2.200% 96.293% ( 250, 380 ] 13058 1.440% 97.733% ( 380, 580 ] 9305 1.026% 98.760% ( 580, 870 ] 6310 0.696% 99.456% ( 870, 1300 ] 2719 0.300% 99.756% ( 1300, 1900 ] 817 0.090% 99.846% ( 1900, 2900 ] 899 0.099% 99.945% ( 2900, 4400 ] 920 0.101% 100.047% ( 4400, 6600 ] 167 0.018% 100.065% ( 6600, 9900 ] 35 0.004% 100.069% ( 9900, 14000 ] 13 0.001% 100.070% ( 14000, 22000 ] 25 0.003% 100.073% ( 22000, 33000 ] 18 0.002% 100.075% ( 33000, 50000 ] 8 0.001% 100.076% ( 50000, 75000 ] 1 0.000% 100.076% ** Level 1 read latency histogram (micros): Count: 49795 Average: 21.9206 StdDev: 168.95 Min: 1 Median: 2.8586 Max: 14805 Percentiles: P50: 2.86 P75: 4.81 P99: 372.11 P99.9: 1966.94 P99.99: 6292.16 ------------------------------------------------------ [ 0, 1 ] 304 0.611% 0.611% ( 1, 2 ] 13810 27.734% 28.344% ###### ( 2, 3 ] 12560 25.223% 53.568% ##### ( 3, 4 ] 6659 13.373% 66.940% ### ( 4, 6 ] 9867 19.815% 86.756% #### ( 6, 10 ] 3248 6.523% 93.278% # ( 10, 15 ] 504 1.012% 94.291% ( 15, 22 ] 271 0.544% 94.835% ( 22, 34 ] 49 0.098% 94.933% ( 34, 51 ] 5 0.010% 94.943% ( 51, 76 ] 3 0.006% 94.949% ( 76, 110 ] 11 0.022% 94.971% ( 110, 170 ] 474 0.952% 95.923% ( 170, 250 ] 1146 2.301% 98.225% ( 250, 380 ] 411 0.825% 99.050% ( 380, 580 ] 223 0.448% 99.498% ( 580, 870 ] 139 0.279% 99.777% ( 870, 1300 ] 47 0.094% 99.871% ( 1300, 1900 ] 13 0.026% 99.898% ( 1900, 2900 ] 18 0.036% 99.934% ( 2900, 4400 ] 22 0.044% 99.978% ( 4400, 6600 ] 7 0.014% 99.992% ( 6600, 9900 ] 2 0.004% 99.996% ( 9900, 14000 ] 2 0.004% 100.000% ( 14000, 22000 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 690884 Average: 12.8514 StdDev: 253.09 Min: 1 Median: 2.1750 Max: 47485 Percentiles: P50: 2.17 P75: 3.07 P99: 14.33 P99.9: 846.02 P99.99: 1362.02 ------------------------------------------------------ [ 0, 1 ] 7296 1.056% 1.056% ( 1, 2 ] 302578 43.796% 44.852% ######### ( 2, 3 ] 203298 29.426% 74.278% ###### ( 3, 4 ] 72302 10.465% 84.743% ## ( 4, 6 ] 75467 10.923% 95.666% ## ( 6, 10 ] 19730 2.856% 98.522% # ( 10, 15 ] 3818 0.553% 99.074% ( 15, 22 ] 482 0.070% 99.144% ( 22, 34 ] 84 0.012% 99.156% ( 34, 51 ] 144 0.021% 99.177% ( 51, 76 ] 126 0.018% 99.195% ( 76, 110 ] 42 0.006% 99.201% ( 110, 170 ] 194 0.028% 99.230% ( 170, 250 ] 881 0.128% 99.357% ( 250, 380 ] 1362 0.197% 99.554% ( 380, 580 ] 1403 0.203% 99.757% ( 580, 870 ] 1075 0.156% 99.913% ( 870, 1300 ] 508 0.074% 99.986% ( 1300, 1900 ] 241 0.035% 100.021% ( 1900, 2900 ] 303 0.044% 100.065% ( 2900, 4400 ] 230 0.033% 100.098% ( 4400, 6600 ] 71 0.010% 100.109% ( 6600, 9900 ] 43 0.006% 100.115% ( 9900, 14000 ] 30 0.004% 100.119% ( 14000, 22000 ] 40 0.006% 100.125% ( 22000, 33000 ] 11 0.002% 100.127% ( 33000, 50000 ] 6 0.001% 100.128% ** Level 3 read latency histogram (micros): Count: 804976 Average: 14.6159 StdDev: 220.21 Min: 1 Median: 2.2844 Max: 63940 Percentiles: P50: 2.28 P75: 3.23 P99: 229.00 P99.9: 1004.88 P99.99: 1376.91 ------------------------------------------------------ [ 0, 1 ] 5780 0.718% 0.718% ( 1, 2 ] 324687 40.335% 41.053% ######## ( 2, 3 ] 253245 31.460% 72.513% ###### ( 3, 4 ] 88129 10.948% 83.461% ## ( 4, 6 ] 93260 11.585% 95.046% ## ( 6, 10 ] 23252 2.889% 97.935% # ( 10, 15 ] 4637 0.576% 98.511% ( 15, 22 ] 605 0.075% 98.586% ( 22, 34 ] 102 0.013% 98.599% ( 34, 51 ] 237 0.029% 98.628% ( 51, 76 ] 152 0.019% 98.647% ( 76, 110 ] 98 0.012% 98.659% ( 110, 170 ] 894 0.111% 98.770% ( 170, 250 ] 2506 0.311% 99.082% ( 250, 380 ] 2136 0.265% 99.347% ( 380, 580 ] 2224 0.276% 99.623% ( 580, 870 ] 1919 0.238% 99.862% ( 870, 1300 ] 982 0.122% 99.984% ( 1300, 1900 ] 394 0.049% 100.033% ( 1900, 2900 ] 430 0.053% 100.086% ( 2900, 4400 ] 410 0.051% 100.137% ( 4400, 6600 ] 59 0.007% 100.144% ( 6600, 9900 ] 18 0.002% 100.147% ( 9900, 14000 ] 8 0.001% 100.148% ( 14000, 22000 ] 25 0.003% 100.151% ( 22000, 33000 ] 12 0.001% 100.152% ( 33000, 50000 ] 2 0.000% 100.152% ( 50000, 75000 ] 1 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 1159032 Average: 28.1008 StdDev: 300.36 Min: 1 Median: 2.3544 Max: 62817 Percentiles: P50: 2.35 P75: 3.53 P99: 453.83 P99.9: 866.39 P99.99: 1041.63 ------------------------------------------------------ [ 0, 1 ] 9871 0.852% 0.852% ( 1, 2 ] 448669 38.711% 39.562% ######## ( 2, 3 ] 341333 29.450% 69.012% ###### ( 3, 4 ] 129802 11.199% 80.211% ## ( 4, 6 ] 137898 11.898% 92.109% ## ( 6, 10 ] 34332 2.962% 95.071% # ( 10, 15 ] 7045 0.608% 95.679% ( 15, 22 ] 848 0.073% 95.752% ( 22, 34 ] 194 0.017% 95.769% ( 34, 51 ] 318 0.027% 95.796% ( 51, 76 ] 244 0.021% 95.817% ( 76, 110 ] 305 0.026% 95.844% ( 110, 170 ] 6518 0.562% 96.406% ( 170, 250 ] 17939 1.548% 97.954% ( 250, 380 ] 9270 0.800% 98.754% ( 380, 580 ] 7736 0.667% 99.421% ( 580, 870 ] 5621 0.485% 99.906% ( 870, 1300 ] 2438 0.210% 100.116% ( 1300, 1900 ] 917 0.079% 100.196% ( 1900, 2900 ] 1120 0.097% 100.292% ( 2900, 4400 ] 1038 0.090% 100.382% ( 4400, 6600 ] 215 0.019% 100.400% ( 6600, 9900 ] 41 0.004% 100.404% ( 9900, 14000 ] 27 0.002% 100.406% ( 14000, 22000 ] 50 0.004% 100.410% ( 22000, 33000 ] 12 0.001% 100.411% ( 33000, 50000 ] 14 0.001% 100.413% ( 50000, 75000 ] 5 0.000% 100.413% ** Level 5 read latency histogram (micros): Count: 40649 Average: 484.9454 StdDev: 964.40 Min: 93 Median: 268.6584 Max: 51410 Percentiles: P50: 268.66 P75: 507.67 P99: 3810.04 P99.9: 10453.91 P99.99: 39579.34 ------------------------------------------------------ ( 76, 110 ] 195 0.480% 0.480% ( 110, 170 ] 5153 12.677% 13.157% ### ( 170, 250 ] 13919 34.242% 47.398% ####### ( 250, 380 ] 7368 18.126% 65.524% #### ( 380, 580 ] 6034 14.844% 80.369% ### ( 580, 870 ] 4173 10.266% 90.634% ## ( 870, 1300 ] 1816 4.468% 95.102% # ( 1300, 1900 ] 579 1.424% 96.526% ( 1900, 2900 ] 633 1.557% 98.084% ( 2900, 4400 ] 614 1.510% 99.594% ( 4400, 6600 ] 103 0.253% 99.847% ( 6600, 9900 ] 20 0.049% 99.897% ( 9900, 14000 ] 10 0.025% 99.921% ( 14000, 22000 ] 16 0.039% 99.961% ( 22000, 33000 ] 10 0.025% 99.985% ( 33000, 50000 ] 5 0.012% 99.998% ( 50000, 75000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 16.2 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 181.72 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.389 H:M:S, 20.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 257.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 457.803 micros/op 8718 ops/sec 20.186 seconds 175996 operations; 8.4 MB/s (43999 of 43999 found) Microseconds per read: Count: 175996 Average: 457.8223 StdDev: 1179.52 Min: 2 Median: 270.8988 Max: 77407 Percentiles: P50: 270.90 P75: 454.36 P99: 3657.69 P99.9: 17000.27 P99.99: 49622.47 ------------------------------------------------------ ( 1, 2 ] 2 0.001% 0.001% ( 2, 3 ] 32 0.018% 0.019% ( 3, 4 ] 50 0.028% 0.048% ( 4, 6 ] 143 0.081% 0.129% ( 6, 10 ] 293 0.166% 0.295% ( 10, 15 ] 921 0.523% 0.819% ( 15, 22 ] 1985 1.128% 1.947% ( 22, 34 ] 3254 1.849% 3.796% ( 34, 51 ] 1516 0.861% 4.657% ( 51, 76 ] 256 0.145% 4.802% ( 76, 110 ] 75 0.043% 4.845% ( 110, 170 ] 9176 5.214% 10.059% # ( 170, 250 ] 63677 36.181% 46.240% ####### ( 250, 380 ] 41167 23.391% 69.631% ##### ( 380, 580 ] 25416 14.441% 84.072% ### ( 580, 870 ] 14877 8.453% 92.525% ## ( 870, 1300 ] 6633 3.769% 96.294% # ( 1300, 1900 ] 2289 1.301% 97.594% ( 1900, 2900 ] 1633 0.928% 98.522% ( 2900, 4400 ] 1665 0.946% 99.468% ( 4400, 6600 ] 415 0.236% 99.704% ( 6600, 9900 ] 196 0.111% 99.815% ( 9900, 14000 ] 104 0.059% 99.874% ( 14000, 22000 ] 120 0.068% 99.943% ( 22000, 33000 ] 57 0.032% 99.975% ( 33000, 50000 ] 27 0.015% 99.990% ( 50000, 75000 ] 16 0.009% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 2874716 rocksdb.bloom.filter.full.positive COUNT : 202955 rocksdb.bloom.filter.full.true.positive COUNT : 175171 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 825 rocksdb.memtable.miss COUNT : 175171 rocksdb.l0.hit COUNT : 20545 rocksdb.l1.hit COUNT : 3547 rocksdb.l2andup.hit COUNT : 151079 rocksdb.compaction.key.drop.new COUNT : 930079 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3892067 rocksdb.number.keys.read COUNT : 175996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4016613144 rocksdb.bytes.read COUNT : 175996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 529 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4064987 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 16580894791 rocksdb.compact.write.bytes COUNT : 15618886409 rocksdb.flush.write.bytes COUNT : 3957370266 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 36 rocksdb.number.superversion_acquires COUNT : 703 rocksdb.number.superversion_releases COUNT : 674 rocksdb.number.superversion_cleanups COUNT : 170 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 132 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3931476992 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7036928 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16745276291 rocksdb.non.last.level.read.count COUNT : 4018884 rocksdb.block.checksum.compute.count COUNT : 4223012 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 268.998573 P95 : 1151.604781 P99 : 3657.238896 P100 : 77407.000000 COUNT : 175996 SUM : 80412582 rocksdb.db.write.micros P50 : 1.639988 P95 : 5.159703 P99 : 7.628764 P100 : 529734.000000 COUNT : 3892067 SUM : 14923686 rocksdb.compaction.times.micros P50 : 2005263.157895 P95 : 6170000.000000 P99 : 13034000.000000 P100 : 13182891.000000 COUNT : 46 SUM : 109910785 rocksdb.compaction.times.cpu_micros P50 : 1368000.000000 P95 : 2750000.000000 P99 : 7788334.000000 P100 : 7788334.000000 COUNT : 46 SUM : 68714384 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 969.230769 P95 : 3050.000000 P99 : 5368.000000 P100 : 6321.000000 COUNT : 56 SUM : 69553 rocksdb.compaction.outfile.sync.micros P50 : 1820.000000 P95 : 6224.705882 P99 : 9385.200000 P100 : 10066.000000 COUNT : 178 SUM : 436734 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 224.400000 P95 : 1017.428571 P99 : 1292.628571 P100 : 24044.000000 COUNT : 112 SUM : 58908 rocksdb.table.open.io.micros P50 : 4980.000000 P95 : 15636.363636 P99 : 30140.000000 P100 : 69222.000000 COUNT : 530 SUM : 3171856 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.412690 P95 : 9.775982 P99 : 247.032528 P100 : 63947.000000 COUNT : 4016905 SUM : 64438038 rocksdb.read.block.get.micros P50 : 222.561760 P95 : 913.346176 P99 : 3115.436354 P100 : 56697.000000 COUNT : 205562 SUM : 72726198 rocksdb.write.raw.block.micros P50 : 0.531659 P95 : 1.251012 P99 : 3.764142 P100 : 60639.000000 COUNT : 4743464 SUM : 16046494 rocksdb.numfiles.in.singlecompaction P50 : 3.519231 P95 : 5.878571 P99 : 12.150000 P100 : 13.000000 COUNT : 57 SUM : 230 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559803 P95 : 1114.879042 P99 : 1294.754099 P100 : 529517.000000 COUNT : 18113 SUM : 4066576 rocksdb.sst.read.micros P50 : 2.117999 P95 : 179.233381 P99 : 570.197068 P100 : 63940.000000 COUNT : 4018918 SUM : 123825375 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 175996 SUM : 175996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3892067 SUM : 4016613144 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 234000.000000 P95 : 697600.000000 P99 : 804092.000000 P100 : 804092.000000 COUNT : 56 SUM : 16310730 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 195 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0