[2024-12-14 00:49:43.654767] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-14 00:49:43.655022] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2007757 ] Set seed to 1734133783648096 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 00:49:43.769912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 00:49:43.975057] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 00:49:43.975101] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2007757' to capture a snapshot of events at runtime. [2024-12-14 00:49:43.975112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2007757 for offline analysis/debug. [2024-12-14 00:49:43.975135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 00:49:52 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-00:50:01 ... thread 0: (1000000,1000000) ops and (116576.9,116576.9) ops/second in (8.578031,8.578031) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 2.88 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 104.6 267.1 5.42 4.51 15 0.361 575K 602 0.0 0.0 L1 13/13 1.61 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 73.18 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 945.19 MB 0.9 1.5 0.9 0.6 1.5 0.9 0.0 1.7 109.8 108.7 14.46 7.46 10 1.446 289K 0 0.0 0.0 L4 165/0 9.41 GB 1.0 4.2 2.3 1.8 4.1 2.3 0.0 1.8 118.7 117.2 35.89 19.59 25 1.436 1657K 0 0.0 0.0 L5 1116/0 91.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/21 106.80 GB 0.0 6.3 3.2 3.0 7.1 4.0 2.3 8.2 115.0 129.6 55.77 31.56 50 1.115 2522K 602 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 3.2 3.0 7.1 4.0 2.3 8.2 115.0 129.6 55.77 31.56 50 1.115 2522K 602 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 3.2 3.0 6.2 3.2 0.0 0.0 122.1 120.8 52.52 29.19 37 1.420 2522K 602 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 272.0 3.24 2.38 13 0.249 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.8 total, 8.6 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.06 GB write, 820.95 MB/s write, 6.26 GB read, 728.57 MB/s read, 55.8 seconds Interval compaction: 7.06 GB write, 842.38 MB/s write, 6.26 GB read, 747.58 MB/s read, 55.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 25, pending-compaction-bytes-stops: 0, total-delays: 25, total-stops: 7, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 493562 Average: 9.5139 StdDev: 151.32 Min: 1 Median: 1.7866 Max: 41483 Percentiles: P50: 1.79 P75: 2.66 P99: 131.35 P99.9: 1225.29 P99.99: 2424.54 ------------------------------------------------------ [ 0, 1 ] 40275 8.160% 8.160% ## ( 1, 2 ] 262514 53.188% 61.348% ########### ( 2, 3 ] 101517 20.568% 81.916% #### ( 3, 4 ] 32804 6.646% 88.562% # ( 4, 6 ] 37808 7.660% 96.223% ## ( 6, 10 ] 10165 2.060% 98.282% ( 10, 15 ] 2477 0.502% 98.784% ( 15, 22 ] 340 0.069% 98.853% ( 22, 34 ] 39 0.008% 98.861% ( 34, 51 ] 5 0.001% 98.862% ( 51, 76 ] 10 0.002% 98.864% ( 76, 110 ] 141 0.029% 98.892% ( 110, 170 ] 1496 0.303% 99.195% ( 170, 250 ] 1518 0.308% 99.503% ( 250, 380 ] 738 0.150% 99.653% ( 380, 580 ] 595 0.121% 99.773% ( 580, 870 ] 406 0.082% 99.855% ( 870, 1300 ] 268 0.054% 99.910% ( 1300, 1900 ] 277 0.056% 99.966% ( 1900, 2900 ] 230 0.047% 100.012% ( 2900, 4400 ] 131 0.027% 100.039% ( 4400, 6600 ] 26 0.005% 100.044% ( 9900, 14000 ] 1 0.000% 100.044% ( 14000, 22000 ] 2 0.000% 100.045% ( 22000, 33000 ] 1 0.000% 100.045% ( 33000, 50000 ] 3 0.001% 100.046% ** Level 1 read latency histogram (micros): Count: 684 Average: 1313.3991 StdDev: 5049.68 Min: 86 Median: 227.1429 Max: 42940 Percentiles: P50: 227.14 P75: 486.85 P99: 35465.00 P99.9: 42940.00 P99.99: 42940.00 ------------------------------------------------------ ( 76, 110 ] 23 3.363% 3.363% # ( 110, 170 ] 199 29.094% 32.456% ###### ( 170, 250 ] 168 24.561% 57.018% ##### ( 250, 380 ] 84 12.281% 69.298% ## ( 380, 580 ] 73 10.673% 79.971% ## ( 580, 870 ] 47 6.871% 86.842% # ( 870, 1300 ] 21 3.070% 89.912% # ( 1300, 1900 ] 18 2.632% 92.544% # ( 1900, 2900 ] 14 2.047% 94.591% ( 2900, 4400 ] 9 1.316% 95.906% ( 4400, 6600 ] 3 0.439% 96.345% ( 6600, 9900 ] 3 0.439% 96.784% ( 9900, 14000 ] 5 0.731% 97.515% ( 14000, 22000 ] 3 0.439% 97.953% ( 22000, 33000 ] 6 0.877% 98.830% ( 33000, 50000 ] 8 1.170% 100.000% ** Level 2 read latency histogram (micros): Count: 29466 Average: 10.2220 StdDev: 131.65 Min: 1 Median: 1.9552 Max: 5182 Percentiles: P50: 1.96 P75: 3.18 P99: 12.15 P99.9: 2382.08 P99.99: 5182.00 ------------------------------------------------------ [ 0, 1 ] 1071 3.635% 3.635% # ( 1, 2 ] 14303 48.541% 52.175% ########## ( 2, 3 ] 6177 20.963% 73.139% #### ( 3, 4 ] 2974 10.093% 83.232% ## ( 4, 6 ] 3668 12.448% 95.680% ## ( 6, 10 ] 892 3.027% 98.707% # ( 10, 15 ] 201 0.682% 99.389% ( 15, 22 ] 36 0.122% 99.511% ( 22, 34 ] 1 0.003% 99.515% ( 51, 76 ] 1 0.003% 99.518% ( 76, 110 ] 1 0.003% 99.521% ( 110, 170 ] 14 0.048% 99.569% ( 170, 250 ] 12 0.041% 99.610% ( 250, 380 ] 3 0.010% 99.620% ( 380, 580 ] 11 0.037% 99.657% ( 580, 870 ] 9 0.031% 99.688% ( 870, 1300 ] 22 0.075% 99.762% ( 1300, 1900 ] 28 0.095% 99.857% ( 1900, 2900 ] 26 0.088% 99.946% ( 2900, 4400 ] 10 0.034% 99.980% ( 4400, 6600 ] 6 0.020% 100.000% ** Level 3 read latency histogram (micros): Count: 663401 Average: 13.0629 StdDev: 157.60 Min: 1 Median: 2.0478 Max: 10307 Percentiles: P50: 2.05 P75: 3.20 P99: 11.33 P99.9: 1329.63 P99.99: 1726.35 ------------------------------------------------------ [ 0, 1 ] 17092 2.576% 2.576% # ( 1, 2 ] 306992 46.275% 48.852% ######### ( 2, 3 ] 159471 24.038% 72.890% ##### ( 3, 4 ] 71247 10.740% 83.630% ## ( 4, 6 ] 82688 12.464% 96.094% ## ( 6, 10 ] 18051 2.721% 98.815% # ( 10, 15 ] 4619 0.696% 99.511% ( 15, 22 ] 610 0.092% 99.603% ( 22, 34 ] 59 0.009% 99.612% ( 34, 51 ] 24 0.004% 99.616% ( 51, 76 ] 32 0.005% 99.621% ( 76, 110 ] 43 0.006% 99.627% ( 110, 170 ] 159 0.024% 99.651% ( 170, 250 ] 146 0.022% 99.673% ( 250, 380 ] 131 0.020% 99.693% ( 380, 580 ] 217 0.033% 99.726% ( 580, 870 ] 420 0.063% 99.789% ( 870, 1300 ] 692 0.104% 99.893% ( 1300, 1900 ] 903 0.136% 100.029% ( 1900, 2900 ] 780 0.118% 100.147% ( 2900, 4400 ] 426 0.064% 100.211% ( 4400, 6600 ] 114 0.017% 100.228% ( 6600, 9900 ] 9 0.001% 100.230% ( 9900, 14000 ] 1 0.000% 100.230% ** Level 4 read latency histogram (micros): Count: 473193 Average: 23.0084 StdDev: 214.96 Min: 1 Median: 1.9830 Max: 9549 Percentiles: P50: 1.98 P75: 3.11 P99: 356.83 P99.9: 2465.50 P99.99: 2892.66 ------------------------------------------------------ [ 0, 1 ] 14415 3.046% 3.046% # ( 1, 2 ] 226017 47.764% 50.811% ########## ( 2, 3 ] 108944 23.023% 73.834% ##### ( 3, 4 ] 48005 10.145% 83.979% ## ( 4, 6 ] 52962 11.192% 95.171% ## ( 6, 10 ] 12038 2.544% 97.715% # ( 10, 15 ] 2975 0.629% 98.344% ( 15, 22 ] 314 0.066% 98.410% ( 22, 34 ] 30 0.006% 98.417% ( 34, 51 ] 13 0.003% 98.419% ( 51, 76 ] 19 0.004% 98.423% ( 76, 110 ] 140 0.030% 98.453% ( 110, 170 ] 1060 0.224% 98.677% ( 170, 250 ] 1036 0.219% 98.896% ( 250, 380 ] 600 0.127% 99.023% ( 380, 580 ] 617 0.130% 99.153% ( 580, 870 ] 834 0.176% 99.329% ( 870, 1300 ] 988 0.209% 99.538% ( 1300, 1900 ] 1149 0.243% 99.781% ( 1900, 2900 ] 997 0.211% 99.992% ( 2900, 4400 ] 546 0.115% 100.107% ( 4400, 6600 ] 162 0.034% 100.141% ( 6600, 9900 ] 15 0.003% 100.144% ** Level 5 read latency histogram (micros): Count: 34337 Average: 713.9582 StdDev: 1147.92 Min: 81 Median: 241.8045 Max: 11412 Percentiles: P50: 241.80 P75: 640.45 P99: 6032.87 P99.9: 9264.70 P99.99: 11412.00 ------------------------------------------------------ ( 76, 110 ] 1043 3.038% 3.038% # ( 110, 170 ] 9112 26.537% 29.575% ##### ( 170, 250 ] 7814 22.757% 52.331% ##### ( 250, 380 ] 3901 11.361% 63.692% ## ( 380, 580 ] 3401 9.905% 73.597% ## ( 580, 870 ] 2311 6.730% 80.327% # ( 870, 1300 ] 1711 4.983% 85.310% # ( 1300, 1900 ] 1451 4.226% 89.536% # ( 1900, 2900 ] 1401 4.080% 93.616% # ( 2900, 4400 ] 1289 3.754% 97.370% # ( 4400, 6600 ] 754 2.196% 99.566% ( 6600, 9900 ] 142 0.414% 99.980% ( 9900, 14000 ] 7 0.020% 100.000% ** DB Stats ** Uptime(secs): 8.8 total, 8.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 111.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.920 H:M:S, 55.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 114.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.920 H:M:S, 57.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-00:50:39 ... thread 0: (1000000,2000000) ops and (26530.7,43224.3) ops/second in (37.692208,46.270239) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/4 1.78 GB 6.3 2.8 0.0 2.8 4.6 1.8 0.0 2.6 165.7 269.8 17.48 15.69 35 0.499 2941K 8761 0.0 0.0 L1 14/14 1.60 GB 0.0 3.6 2.0 1.6 3.6 2.0 0.0 1.8 81.7 80.7 45.40 24.65 1 45.402 3767K 45K 0.0 0.0 L2 12/9 1.08 GB 2.6 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 26/9 1.90 GB 1.4 1.5 0.9 0.6 1.5 0.9 1.0 1.7 109.8 108.7 14.46 7.46 10 1.446 289K 0 0.0 0.0 L4 165/0 9.41 GB 1.0 4.2 2.3 1.8 4.1 2.3 0.0 1.8 118.7 117.2 35.89 19.59 25 1.436 1657K 0 0.0 0.0 L5 1116/0 91.91 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1338/36 107.67 GB 0.0 12.2 5.3 6.9 13.8 6.9 5.3 7.7 110.0 125.1 113.22 67.38 71 1.595 8656K 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 5.3 6.9 13.8 6.9 5.3 7.7 110.0 125.1 113.22 67.38 71 1.595 8656K 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 5.3 6.9 12.0 5.1 0.0 0.0 116.8 115.6 106.65 62.43 43 2.480 8656K 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 277.8 6.58 4.95 28 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.5 total, 46.3 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.83 GB write, 304.51 MB/s write, 12.16 GB read, 267.84 MB/s read, 113.2 seconds Interval compaction: 13.83 GB write, 305.99 MB/s write, 12.16 GB read, 269.14 MB/s read, 113.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 37, pending-compaction-bytes-stops: 0, total-delays: 37, total-stops: 8, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1350100 Average: 27.0013 StdDev: 118.64 Min: 1 Median: 1.7059 Max: 41483 Percentiles: P50: 1.71 P75: 2.83 P99: 249.94 P99.9: 769.12 P99.99: 1554.91 ------------------------------------------------------ [ 0, 1 ] 202282 14.983% 14.983% ### ( 1, 2 ] 669771 49.609% 64.592% ########## ( 2, 3 ] 170022 12.593% 77.185% ### ( 3, 4 ] 55724 4.127% 81.312% # ( 4, 6 ] 56626 4.194% 85.507% # ( 6, 10 ] 13920 1.031% 86.538% ( 10, 15 ] 3302 0.245% 86.782% ( 15, 22 ] 492 0.036% 86.819% ( 22, 34 ] 63 0.005% 86.823% ( 34, 51 ] 11 0.001% 86.824% ( 51, 76 ] 15 0.001% 86.825% ( 76, 110 ] 9897 0.733% 87.558% ( 110, 170 ] 103823 7.690% 95.248% ## ( 170, 250 ] 50688 3.754% 99.003% # ( 250, 380 ] 7155 0.530% 99.533% ( 380, 580 ] 3997 0.296% 99.829% ( 580, 870 ] 1475 0.109% 99.938% ( 870, 1300 ] 538 0.040% 99.978% ( 1300, 1900 ] 386 0.029% 100.006% ( 1900, 2900 ] 307 0.023% 100.029% ( 2900, 4400 ] 231 0.017% 100.046% ( 4400, 6600 ] 40 0.003% 100.049% ( 6600, 9900 ] 1 0.000% 100.049% ( 9900, 14000 ] 1 0.000% 100.049% ( 14000, 22000 ] 2 0.000% 100.050% ( 22000, 33000 ] 1 0.000% 100.050% ( 33000, 50000 ] 3 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 542552 Average: 11.3062 StdDev: 199.55 Min: 1 Median: 2.8903 Max: 42940 Percentiles: P50: 2.89 P75: 3.99 P99: 169.56 P99.9: 518.94 P99.99: 1164.05 ------------------------------------------------------ [ 0, 1 ] 6744 1.243% 1.243% ( 1, 2 ] 151427 27.910% 29.153% ###### ( 2, 3 ] 127042 23.416% 52.569% ##### ( 3, 4 ] 122621 22.601% 75.170% ##### ( 4, 6 ] 99890 18.411% 93.581% #### ( 6, 10 ] 11311 2.085% 95.665% ( 10, 15 ] 4403 0.812% 96.477% ( 15, 22 ] 3489 0.643% 97.120% ( 22, 34 ] 154 0.028% 97.148% ( 34, 51 ] 21 0.004% 97.152% ( 51, 76 ] 6 0.001% 97.153% ( 76, 110 ] 1020 0.188% 97.341% ( 110, 170 ] 9066 1.671% 99.012% ( 170, 250 ] 3817 0.704% 99.716% ( 250, 380 ] 666 0.123% 99.839% ( 380, 580 ] 480 0.088% 99.927% ( 580, 870 ] 259 0.048% 99.975% ( 870, 1300 ] 121 0.022% 99.997% ( 1300, 1900 ] 65 0.012% 100.009% ( 1900, 2900 ] 72 0.013% 100.022% ( 2900, 4400 ] 98 0.018% 100.041% ( 4400, 6600 ] 22 0.004% 100.045% ( 6600, 9900 ] 6 0.001% 100.046% ( 9900, 14000 ] 5 0.001% 100.047% ( 14000, 22000 ] 3 0.001% 100.047% ( 22000, 33000 ] 6 0.001% 100.048% ( 33000, 50000 ] 8 0.001% 100.050% ** Level 2 read latency histogram (micros): Count: 30223 Average: 14.1629 StdDev: 134.36 Min: 1 Median: 1.9816 Max: 5182 Percentiles: P50: 1.98 P75: 3.38 P99: 195.76 P99.9: 2391.42 P99.99: 5182.00 ------------------------------------------------------ [ 0, 1 ] 1071 3.544% 3.544% # ( 1, 2 ] 14303 47.325% 50.869% ######### ( 2, 3 ] 6177 20.438% 71.307% #### ( 3, 4 ] 2974 9.840% 81.147% ## ( 4, 6 ] 3668 12.136% 93.283% ## ( 6, 10 ] 892 2.951% 96.235% # ( 10, 15 ] 201 0.665% 96.900% ( 15, 22 ] 36 0.119% 97.019% ( 22, 34 ] 1 0.003% 97.022% ( 51, 76 ] 1 0.003% 97.025% ( 76, 110 ] 59 0.195% 97.221% ( 110, 170 ] 465 1.539% 98.759% ( 170, 250 ] 226 0.748% 99.507% ( 250, 380 ] 22 0.073% 99.580% ( 380, 580 ] 21 0.069% 99.649% ( 580, 870 ] 12 0.040% 99.689% ( 870, 1300 ] 23 0.076% 99.765% ( 1300, 1900 ] 28 0.093% 99.858% ( 1900, 2900 ] 26 0.086% 99.944% ( 2900, 4400 ] 11 0.036% 99.980% ( 4400, 6600 ] 6 0.020% 100.000% ** Level 3 read latency histogram (micros): Count: 735712 Average: 14.9212 StdDev: 156.07 Min: 1 Median: 2.0695 Max: 10307 Percentiles: P50: 2.07 P75: 3.27 P99: 153.22 P99.9: 1316.71 P99.99: 1737.56 ------------------------------------------------------ [ 0, 1 ] 18457 2.509% 2.509% # ( 1, 2 ] 337237 45.838% 48.347% ######### ( 2, 3 ] 174995 23.786% 72.133% ##### ( 3, 4 ] 77222 10.496% 82.629% ## ( 4, 6 ] 89674 12.189% 94.818% ## ( 6, 10 ] 19834 2.696% 97.514% # ( 10, 15 ] 5131 0.697% 98.211% ( 15, 22 ] 661 0.090% 98.301% ( 22, 34 ] 62 0.008% 98.309% ( 34, 51 ] 29 0.004% 98.313% ( 51, 76 ] 37 0.005% 98.318% ( 76, 110 ] 734 0.100% 98.418% ( 110, 170 ] 5946 0.808% 99.226% ( 170, 250 ] 2573 0.350% 99.576% ( 250, 380 ] 540 0.073% 99.649% ( 380, 580 ] 506 0.069% 99.718% ( 580, 870 ] 564 0.077% 99.795% ( 870, 1300 ] 749 0.102% 99.897% ( 1300, 1900 ] 944 0.128% 100.025% ( 1900, 2900 ] 827 0.112% 100.137% ( 2900, 4400 ] 462 0.063% 100.200% ( 4400, 6600 ] 122 0.017% 100.217% ( 6600, 9900 ] 9 0.001% 100.218% ( 9900, 14000 ] 1 0.000% 100.218% ** Level 4 read latency histogram (micros): Count: 558919 Average: 44.7748 StdDev: 209.24 Min: 1 Median: 2.3563 Max: 9549 Percentiles: P50: 2.36 P75: 4.79 P99: 482.76 P99.9: 2419.25 P99.99: 2937.26 ------------------------------------------------------ [ 0, 1 ] 14416 2.579% 2.579% # ( 1, 2 ] 226091 40.451% 43.031% ######## ( 2, 3 ] 109312 19.558% 62.588% #### ( 3, 4 ] 48307 8.643% 71.231% ## ( 4, 6 ] 53455 9.564% 80.795% ## ( 6, 10 ] 12090 2.163% 82.959% ( 10, 15 ] 2999 0.537% 83.495% ( 15, 22 ] 317 0.057% 83.552% ( 22, 34 ] 31 0.006% 83.557% ( 34, 51 ] 13 0.002% 83.560% ( 51, 76 ] 19 0.003% 83.563% ( 76, 110 ] 6297 1.127% 84.690% ( 110, 170 ] 53769 9.620% 94.310% ## ( 170, 250 ] 22043 3.944% 98.254% # ( 250, 380 ] 3135 0.561% 98.815% ( 380, 580 ] 2016 0.361% 99.175% ( 580, 870 ] 1245 0.223% 99.398% ( 870, 1300 ] 1097 0.196% 99.594% ( 1300, 1900 ] 1180 0.211% 99.806% ( 1900, 2900 ] 1017 0.182% 99.987% ( 2900, 4400 ] 568 0.102% 100.089% ( 4400, 6600 ] 170 0.030% 100.120% ( 6600, 9900 ] 15 0.003% 100.122% ** Level 5 read latency histogram (micros): Count: 642425 Average: 196.6657 StdDev: 312.85 Min: 79 Median: 152.5107 Max: 11412 Percentiles: P50: 152.51 P75: 193.92 P99: 1177.45 P99.9: 5248.78 P99.99: 8519.44 ------------------------------------------------------ ( 76, 110 ] 46239 7.198% 7.198% # ( 110, 170 ] 388100 60.412% 67.609% ############ ( 170, 250 ] 158809 24.720% 92.330% ##### ( 250, 380 ] 22448 3.494% 95.824% # ( 380, 580 ] 13326 2.074% 97.898% ( 580, 870 ] 5332 0.830% 98.728% ( 870, 1300 ] 2443 0.380% 99.108% ( 1300, 1900 ] 1744 0.271% 99.380% ( 1900, 2900 ] 1592 0.248% 99.628% ( 2900, 4400 ] 1439 0.224% 99.852% ( 4400, 6600 ] 805 0.125% 99.977% ( 6600, 9900 ] 144 0.022% 99.999% ( 9900, 14000 ] 7 0.001% 100.000% ** DB Stats ** Uptime(secs): 46.5 total, 37.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 42.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:38.087 H:M:S, 81.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 26.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:33.167 H:M:S, 88.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/14-00:50:46 ... thread 0: (1000000,3000000) ops and (131511.1,55685.3) ops/second in (7.603919,53.874158) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 2.76 GB 81.8 3.5 0.0 3.5 6.3 2.8 0.0 2.3 129.2 230.9 27.78 21.52 50 0.556 3644K 9623 0.0 0.0 L1 14/14 1.60 GB 0.0 3.6 2.0 1.6 3.6 2.0 0.0 1.8 81.7 80.7 45.40 24.65 1 45.402 3767K 45K 0.0 0.0 L2 1/0 104.47 MB 1.0 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/1 1.08 GB 1.0 3.2 1.9 1.3 3.2 1.9 1.0 1.7 113.0 111.9 29.04 16.07 20 1.452 1657K 7401 0.0 0.0 L4 171/7 9.82 GB 1.0 8.3 4.1 4.2 8.2 4.0 0.0 2.0 114.4 112.7 74.19 41.53 49 1.514 4537K 7175 0.0 0.0 L5 1132/0 93.20 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/30 108.56 GB 0.0 18.6 8.0 10.6 21.2 10.6 6.6 7.7 108.1 122.9 176.40 103.76 120 1.470 13M 69K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.6 8.0 10.6 21.2 10.6 6.6 7.7 108.1 122.9 176.40 103.76 120 1.470 13M 69K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.6 8.0 10.6 18.4 7.8 0.0 0.0 116.9 115.5 163.17 95.82 79 2.065 13M 69K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 214.2 13.23 7.94 41 0.323 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.1 total, 53.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.18 GB write, 400.91 MB/s write, 18.62 GB read, 352.48 MB/s read, 176.4 seconds Interval compaction: 21.18 GB write, 402.57 MB/s write, 18.62 GB read, 353.95 MB/s read, 176.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 47, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 32, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1819376 Average: 23.2515 StdDev: 161.78 Min: 1 Median: 1.7643 Max: 49977 Percentiles: P50: 1.76 P75: 2.85 P99: 247.05 P99.9: 893.87 P99.99: 1910.23 ------------------------------------------------------ [ 0, 1 ] 221416 12.170% 12.170% ## ( 1, 2 ] 900513 49.496% 61.666% ########## ( 2, 3 ] 284644 15.645% 77.311% ### ( 3, 4 ] 95576 5.253% 82.564% # ( 4, 6 ] 103956 5.714% 88.278% # ( 6, 10 ] 24829 1.365% 89.642% ( 10, 15 ] 5881 0.323% 89.966% ( 15, 22 ] 758 0.042% 90.007% ( 22, 34 ] 96 0.005% 90.013% ( 34, 51 ] 34 0.002% 90.015% ( 51, 76 ] 40 0.002% 90.017% ( 76, 110 ] 9930 0.546% 90.563% ( 110, 170 ] 104175 5.726% 96.288% # ( 170, 250 ] 51224 2.815% 99.104% # ( 250, 380 ] 7710 0.424% 99.528% ( 380, 580 ] 4627 0.254% 99.782% ( 580, 870 ] 2091 0.115% 99.897% ( 870, 1300 ] 1038 0.057% 99.954% ( 1300, 1900 ] 652 0.036% 99.990% ( 1900, 2900 ] 495 0.027% 100.017% ( 2900, 4400 ] 429 0.024% 100.041% ( 4400, 6600 ] 109 0.006% 100.047% ( 6600, 9900 ] 23 0.001% 100.048% ( 9900, 14000 ] 10 0.001% 100.048% ( 14000, 22000 ] 17 0.001% 100.049% ( 22000, 33000 ] 8 0.000% 100.050% ( 33000, 50000 ] 9 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 824162 Average: 13.1943 StdDev: 252.47 Min: 1 Median: 2.6092 Max: 49499 Percentiles: P50: 2.61 P75: 3.84 P99: 161.56 P99.9: 953.86 P99.99: 2539.25 ------------------------------------------------------ [ 0, 1 ] 11291 1.370% 1.370% ( 1, 2 ] 279167 33.873% 35.243% ####### ( 2, 3 ] 199650 24.225% 59.467% ##### ( 3, 4 ] 152246 18.473% 77.940% #### ( 4, 6 ] 134885 16.366% 94.307% ### ( 6, 10 ] 19212 2.331% 96.638% ( 10, 15 ] 6627 0.804% 97.442% ( 15, 22 ] 3700 0.449% 97.891% ( 22, 34 ] 175 0.021% 97.912% ( 34, 51 ] 39 0.005% 97.917% ( 51, 76 ] 38 0.005% 97.921% ( 76, 110 ] 1028 0.125% 98.046% ( 110, 170 ] 9150 1.110% 99.156% ( 170, 250 ] 3935 0.477% 99.634% ( 250, 380 ] 835 0.101% 99.735% ( 380, 580 ] 717 0.087% 99.822% ( 580, 870 ] 558 0.068% 99.890% ( 870, 1300 ] 435 0.053% 99.942% ( 1300, 1900 ] 242 0.029% 99.972% ( 1900, 2900 ] 234 0.028% 100.000% ( 2900, 4400 ] 325 0.039% 100.040% ( 4400, 6600 ] 106 0.013% 100.053% ( 6600, 9900 ] 36 0.004% 100.057% ( 9900, 14000 ] 16 0.002% 100.059% ( 14000, 22000 ] 26 0.003% 100.062% ( 22000, 33000 ] 21 0.003% 100.065% ( 33000, 50000 ] 9 0.001% 100.066% ** Level 2 read latency histogram (micros): Count: 30256 Average: 16.5069 StdDev: 298.29 Min: 1 Median: 1.9828 Max: 45935 Percentiles: P50: 1.98 P75: 3.38 P99: 205.98 P99.9: 2505.54 P99.99: 5857.28 ------------------------------------------------------ [ 0, 1 ] 1071 3.540% 3.540% # ( 1, 2 ] 14303 47.273% 50.813% ######### ( 2, 3 ] 6177 20.416% 71.229% #### ( 3, 4 ] 2974 9.829% 81.058% ## ( 4, 6 ] 3668 12.123% 93.182% ## ( 6, 10 ] 892 2.948% 96.130% # ( 10, 15 ] 201 0.664% 96.794% ( 15, 22 ] 36 0.119% 96.913% ( 22, 34 ] 1 0.003% 96.916% ( 51, 76 ] 1 0.003% 96.920% ( 76, 110 ] 59 0.195% 97.115% ( 110, 170 ] 467 1.543% 98.658% ( 170, 250 ] 230 0.760% 99.418% ( 250, 380 ] 26 0.086% 99.504% ( 380, 580 ] 25 0.083% 99.587% ( 580, 870 ] 20 0.066% 99.653% ( 870, 1300 ] 30 0.099% 99.752% ( 1300, 1900 ] 29 0.096% 99.848% ( 1900, 2900 ] 26 0.086% 99.934% ( 2900, 4400 ] 13 0.043% 99.977% ( 4400, 6600 ] 6 0.020% 99.997% ( 33000, 50000 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 1209303 Average: 12.4295 StdDev: 165.79 Min: 1 Median: 2.0458 Max: 49697 Percentiles: P50: 2.05 P75: 3.20 P99: 117.26 P99.9: 1188.53 P99.99: 1734.80 ------------------------------------------------------ [ 0, 1 ] 29225 2.417% 2.417% ( 1, 2 ] 562149 46.485% 48.902% ######### ( 2, 3 ] 290013 23.982% 72.884% ##### ( 3, 4 ] 126410 10.453% 83.337% ## ( 4, 6 ] 147582 12.204% 95.541% ## ( 6, 10 ] 31404 2.597% 98.138% # ( 10, 15 ] 7811 0.646% 98.784% ( 15, 22 ] 894 0.074% 98.858% ( 22, 34 ] 83 0.007% 98.864% ( 34, 51 ] 73 0.006% 98.871% ( 51, 76 ] 89 0.007% 98.878% ( 76, 110 ] 750 0.062% 98.940% ( 110, 170 ] 6008 0.497% 99.437% ( 170, 250 ] 2666 0.220% 99.657% ( 250, 380 ] 635 0.053% 99.710% ( 380, 580 ] 663 0.055% 99.764% ( 580, 870 ] 852 0.070% 99.835% ( 870, 1300 ] 1062 0.088% 99.923% ( 1300, 1900 ] 1122 0.093% 100.016% ( 1900, 2900 ] 980 0.081% 100.097% ( 2900, 4400 ] 616 0.051% 100.148% ( 4400, 6600 ] 178 0.015% 100.162% ( 6600, 9900 ] 22 0.002% 100.164% ( 9900, 14000 ] 4 0.000% 100.164% ( 14000, 22000 ] 7 0.001% 100.165% ( 22000, 33000 ] 6 0.000% 100.165% ( 33000, 50000 ] 1 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 1251848 Average: 31.5884 StdDev: 314.57 Min: 1 Median: 2.1549 Max: 46752 Percentiles: P50: 2.15 P75: 3.64 P99: 354.56 P99.9: 2147.98 P99.99: 2882.92 ------------------------------------------------------ [ 0, 1 ] 28235 2.255% 2.255% ( 1, 2 ] 554362 44.283% 46.539% ######### ( 2, 3 ] 279679 22.341% 68.880% #### ( 3, 4 ] 118903 9.498% 78.378% ## ( 4, 6 ] 133262 10.645% 89.024% ## ( 6, 10 ] 29471 2.354% 91.378% ( 10, 15 ] 8010 0.640% 92.018% ( 15, 22 ] 693 0.055% 92.073% ( 22, 34 ] 64 0.005% 92.078% ( 34, 51 ] 81 0.006% 92.085% ( 51, 76 ] 116 0.009% 92.094% ( 76, 110 ] 6353 0.507% 92.601% ( 110, 170 ] 54179 4.328% 96.929% # ( 170, 250 ] 22787 1.820% 98.750% ( 250, 380 ] 3897 0.311% 99.061% ( 380, 580 ] 3142 0.251% 99.312% ( 580, 870 ] 2623 0.210% 99.521% ( 870, 1300 ] 2414 0.193% 99.714% ( 1300, 1900 ] 1945 0.155% 99.870% ( 1900, 2900 ] 1533 0.122% 99.992% ( 2900, 4400 ] 1211 0.097% 100.089% ( 4400, 6600 ] 334 0.027% 100.116% ( 6600, 9900 ] 65 0.005% 100.121% ( 9900, 14000 ] 26 0.002% 100.123% ( 14000, 22000 ] 63 0.005% 100.128% ( 22000, 33000 ] 48 0.004% 100.132% ( 33000, 50000 ] 14 0.001% 100.133% ** Level 5 read latency histogram (micros): Count: 667098 Average: 223.7404 StdDev: 494.78 Min: 79 Median: 154.1571 Max: 50148 Percentiles: P50: 154.16 P75: 201.41 P99: 1831.94 P99.9: 5878.21 P99.99: 18396.98 ------------------------------------------------------ ( 76, 110 ] 46375 6.952% 6.952% # ( 110, 170 ] 390208 58.493% 65.445% ############ ( 170, 250 ] 162365 24.339% 89.784% ##### ( 250, 380 ] 26030 3.902% 93.686% # ( 380, 580 ] 17327 2.597% 96.283% # ( 580, 870 ] 9465 1.419% 97.702% ( 870, 1300 ] 5656 0.848% 98.550% ( 1300, 1900 ] 3385 0.507% 99.058% ( 1900, 2900 ] 2463 0.369% 99.427% ( 2900, 4400 ] 2401 0.360% 99.787% ( 4400, 6600 ] 1125 0.169% 99.955% ( 6600, 9900 ] 199 0.030% 99.985% ( 9900, 14000 ] 18 0.003% 99.988% ( 14000, 22000 ] 26 0.004% 99.992% ( 22000, 33000 ] 37 0.006% 99.997% ( 33000, 50000 ] 20 0.003% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ** DB Stats ** Uptime(secs): 54.1 total, 7.6 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 54.58 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:41.766 H:M:S, 77.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 129.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.679 H:M:S, 48.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-00:50:50 ... thread 0: (1000000,4000000) ops and (286058.5,69722.9) ops/second in (3.495788,57.369946) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 3.74 GB 182.5 4.5 0.0 4.5 8.2 3.7 0.0 2.2 131.3 240.7 35.02 28.16 70 0.500 4668K 10K 0.0 0.0 L1 14/14 1.60 GB 0.0 3.6 2.0 1.6 3.6 2.0 0.0 1.8 81.7 80.7 45.40 24.65 1 45.402 3767K 45K 0.0 0.0 L3 15/0 957.52 MB 1.0 3.2 1.9 1.3 3.2 1.9 1.1 1.7 113.0 111.9 29.04 16.07 20 1.452 1657K 7401 0.0 0.0 L4 171/0 9.75 GB 1.0 9.3 4.3 5.0 9.2 4.2 0.0 2.1 120.3 118.4 79.50 46.35 52 1.529 5307K 16K 0.0 0.0 L5 1136/0 93.51 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1352/22 109.53 GB 0.0 20.7 8.3 12.4 24.2 11.8 5.0 6.4 111.9 131.0 188.96 115.22 143 1.321 15M 79K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.7 8.3 12.4 24.2 11.8 5.0 6.4 111.9 131.0 188.96 115.22 143 1.321 15M 79K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.7 8.3 12.4 20.4 8.0 0.0 0.0 122.7 121.3 172.44 104.50 86 2.005 15M 79K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 232.6 16.52 10.72 57 0.290 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.6 total, 57.4 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.18 GB write, 429.91 MB/s write, 20.65 GB read, 367.22 MB/s read, 189.0 seconds Interval compaction: 24.18 GB write, 431.58 MB/s write, 20.65 GB read, 368.65 MB/s read, 189.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 47, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 32, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2144550 Average: 21.2627 StdDev: 150.80 Min: 1 Median: 1.7558 Max: 49977 Percentiles: P50: 1.76 P75: 2.80 P99: 246.79 P99.9: 821.68 P99.99: 1571.68 ------------------------------------------------------ [ 0, 1 ] 260644 12.154% 12.154% ## ( 1, 2 ] 1073813 50.072% 62.226% ########## ( 2, 3 ] 341066 15.904% 78.129% ### ( 3, 4 ] 118370 5.520% 83.649% # ( 4, 6 ] 123090 5.740% 89.389% # ( 6, 10 ] 29460 1.374% 90.762% ( 10, 15 ] 6891 0.321% 91.084% ( 15, 22 ] 1094 0.051% 91.135% ( 22, 34 ] 162 0.008% 91.142% ( 34, 51 ] 48 0.002% 91.144% ( 51, 76 ] 51 0.002% 91.147% ( 76, 110 ] 10122 0.472% 91.619% ( 110, 170 ] 106547 4.968% 96.587% # ( 170, 250 ] 53910 2.514% 99.101% # ( 250, 380 ] 9153 0.427% 99.528% ( 380, 580 ] 5777 0.269% 99.797% ( 580, 870 ] 2650 0.124% 99.921% ( 870, 1300 ] 1182 0.055% 99.976% ( 1300, 1900 ] 677 0.032% 100.007% ( 1900, 2900 ] 503 0.023% 100.031% ( 2900, 4400 ] 433 0.020% 100.051% ( 4400, 6600 ] 109 0.005% 100.056% ( 6600, 9900 ] 23 0.001% 100.057% ( 9900, 14000 ] 10 0.000% 100.058% ( 14000, 22000 ] 17 0.001% 100.058% ( 22000, 33000 ] 8 0.000% 100.059% ( 33000, 50000 ] 9 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 833317 Average: 13.4141 StdDev: 251.35 Min: 1 Median: 2.6044 Max: 49499 Percentiles: P50: 2.60 P75: 3.84 P99: 165.46 P99.9: 952.98 P99.99: 2535.33 ------------------------------------------------------ [ 0, 1 ] 11576 1.389% 1.389% ( 1, 2 ] 283326 34.000% 35.389% ####### ( 2, 3 ] 201448 24.174% 59.563% ##### ( 3, 4 ] 152982 18.358% 77.921% #### ( 4, 6 ] 135650 16.278% 94.200% ### ( 6, 10 ] 19505 2.341% 96.540% ( 10, 15 ] 6692 0.803% 97.343% ( 15, 22 ] 3710 0.445% 97.789% ( 22, 34 ] 177 0.021% 97.810% ( 34, 51 ] 40 0.005% 97.815% ( 51, 76 ] 38 0.005% 97.819% ( 76, 110 ] 1076 0.129% 97.948% ( 110, 170 ] 9482 1.138% 99.086% ( 170, 250 ] 4241 0.509% 99.595% ( 250, 380 ] 984 0.118% 99.713% ( 380, 580 ] 849 0.102% 99.815% ( 580, 870 ] 622 0.075% 99.890% ( 870, 1300 ] 444 0.053% 99.943% ( 1300, 1900 ] 243 0.029% 99.972% ( 1900, 2900 ] 234 0.028% 100.000% ( 2900, 4400 ] 326 0.039% 100.039% ( 4400, 6600 ] 106 0.013% 100.052% ( 6600, 9900 ] 36 0.004% 100.056% ( 9900, 14000 ] 16 0.002% 100.058% ( 14000, 22000 ] 26 0.003% 100.061% ( 22000, 33000 ] 21 0.003% 100.064% ( 33000, 50000 ] 9 0.001% 100.065% ** Level 2 read latency histogram (micros): Count: 48853 Average: 11.7033 StdDev: 235.21 Min: 1 Median: 1.8987 Max: 45935 Percentiles: P50: 1.90 P75: 2.94 P99: 166.64 P99.9: 1840.97 P99.99: 5175.39 ------------------------------------------------------ [ 0, 1 ] 1826 3.738% 3.738% # ( 1, 2 ] 25149 51.479% 55.217% ########## ( 2, 3 ] 10241 20.963% 76.180% #### ( 3, 4 ] 4112 8.417% 84.597% ## ( 4, 6 ] 4926 10.083% 94.680% ## ( 6, 10 ] 1250 2.559% 97.239% # ( 10, 15 ] 291 0.596% 97.834% ( 15, 22 ] 45 0.092% 97.926% ( 22, 34 ] 1 0.002% 97.928% ( 51, 76 ] 1 0.002% 97.931% ( 76, 110 ] 59 0.121% 98.051% ( 110, 170 ] 491 1.005% 99.056% ( 170, 250 ] 255 0.522% 99.578% ( 250, 380 ] 38 0.078% 99.656% ( 380, 580 ] 37 0.076% 99.732% ( 580, 870 ] 24 0.049% 99.781% ( 870, 1300 ] 32 0.066% 99.846% ( 1300, 1900 ] 29 0.059% 99.906% ( 1900, 2900 ] 26 0.053% 99.959% ( 2900, 4400 ] 13 0.027% 99.986% ( 4400, 6600 ] 6 0.012% 99.998% ( 33000, 50000 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 1225588 Average: 12.3703 StdDev: 164.78 Min: 1 Median: 2.0392 Max: 49697 Percentiles: P50: 2.04 P75: 3.19 P99: 118.41 P99.9: 1183.41 P99.99: 1734.61 ------------------------------------------------------ [ 0, 1 ] 29860 2.436% 2.436% ( 1, 2 ] 571421 46.624% 49.061% ######### ( 2, 3 ] 293481 23.946% 73.007% ##### ( 3, 4 ] 127543 10.407% 83.413% ## ( 4, 6 ] 148637 12.128% 95.541% ## ( 6, 10 ] 31760 2.591% 98.133% # ( 10, 15 ] 7868 0.642% 98.775% ( 15, 22 ] 901 0.074% 98.848% ( 22, 34 ] 85 0.007% 98.855% ( 34, 51 ] 73 0.006% 98.861% ( 51, 76 ] 89 0.007% 98.868% ( 76, 110 ] 761 0.062% 98.930% ( 110, 170 ] 6087 0.497% 99.427% ( 170, 250 ] 2756 0.225% 99.652% ( 250, 380 ] 694 0.057% 99.709% ( 380, 580 ] 697 0.057% 99.765% ( 580, 870 ] 871 0.071% 99.836% ( 870, 1300 ] 1068 0.087% 99.924% ( 1300, 1900 ] 1123 0.092% 100.015% ( 1900, 2900 ] 981 0.080% 100.095% ( 2900, 4400 ] 616 0.050% 100.146% ( 4400, 6600 ] 178 0.015% 100.160% ( 6600, 9900 ] 22 0.002% 100.162% ( 9900, 14000 ] 4 0.000% 100.162% ( 14000, 22000 ] 7 0.001% 100.163% ( 22000, 33000 ] 6 0.000% 100.163% ( 33000, 50000 ] 1 0.000% 100.163% ** Level 4 read latency histogram (micros): Count: 1386824 Average: 29.8476 StdDev: 299.66 Min: 1 Median: 2.1065 Max: 46752 Percentiles: P50: 2.11 P75: 3.54 P99: 350.45 P99.9: 2035.36 P99.99: 2846.89 ------------------------------------------------------ [ 0, 1 ] 31778 2.291% 2.291% ( 1, 2 ] 628571 45.324% 47.616% ######### ( 2, 3 ] 310312 22.376% 69.992% #### ( 3, 4 ] 127750 9.212% 79.203% ## ( 4, 6 ] 142463 10.273% 89.476% ## ( 6, 10 ] 32009 2.308% 91.784% ( 10, 15 ] 8565 0.618% 92.402% ( 15, 22 ] 766 0.055% 92.457% ( 22, 34 ] 73 0.005% 92.462% ( 34, 51 ] 82 0.006% 92.468% ( 51, 76 ] 116 0.008% 92.476% ( 76, 110 ] 6530 0.471% 92.947% ( 110, 170 ] 55890 4.030% 96.977% # ( 170, 250 ] 24359 1.756% 98.734% ( 250, 380 ] 4778 0.345% 99.078% ( 380, 580 ] 3793 0.274% 99.352% ( 580, 870 ] 2942 0.212% 99.564% ( 870, 1300 ] 2489 0.179% 99.743% ( 1300, 1900 ] 1963 0.142% 99.885% ( 1900, 2900 ] 1538 0.111% 99.996% ( 2900, 4400 ] 1212 0.087% 100.083% ( 4400, 6600 ] 334 0.024% 100.107% ( 6600, 9900 ] 65 0.005% 100.112% ( 9900, 14000 ] 26 0.002% 100.114% ( 14000, 22000 ] 63 0.005% 100.118% ( 22000, 33000 ] 48 0.003% 100.122% ( 33000, 50000 ] 14 0.001% 100.123% ** Level 5 read latency histogram (micros): Count: 700113 Average: 226.3896 StdDev: 485.31 Min: 79 Median: 155.3324 Max: 50148 Percentiles: P50: 155.33 P75: 205.85 P99: 1784.35 P99.9: 5813.65 P99.99: 17381.14 ------------------------------------------------------ ( 76, 110 ] 47399 6.770% 6.770% # ( 110, 170 ] 400584 57.217% 63.987% ########### ( 170, 250 ] 172040 24.573% 88.560% ##### ( 250, 380 ] 31217 4.459% 93.019% # ( 380, 580 ] 21416 3.059% 96.078% # ( 580, 870 ] 11473 1.639% 97.717% ( 870, 1300 ] 6168 0.881% 98.598% ( 1300, 1900 ] 3487 0.498% 99.096% ( 1900, 2900 ] 2498 0.357% 99.453% ( 2900, 4400 ] 2408 0.344% 99.797% ( 4400, 6600 ] 1125 0.161% 99.957% ( 6600, 9900 ] 199 0.028% 99.986% ( 9900, 14000 ] 18 0.003% 99.988% ( 14000, 22000 ] 26 0.004% 99.992% ( 22000, 33000 ] 37 0.005% 99.997% ( 33000, 50000 ] 20 0.003% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ** DB Stats ** Uptime(secs): 57.6 total, 3.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 68.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:41.766 H:M:S, 72.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 281.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 270.527 micros/op 14779 ops/sec 60.150 seconds 888996 operations; 14.3 MB/s (223999 of 223999 found) Microseconds per read: Count: 888996 Average: 270.5288 StdDev: 834.39 Min: 2 Median: 193.4641 Max: 84999 Percentiles: P50: 193.46 P75: 239.58 P99: 1401.60 P99.9: 15386.41 P99.99: 32165.70 ------------------------------------------------------ ( 1, 2 ] 8 0.001% 0.001% ( 2, 3 ] 38 0.004% 0.005% ( 3, 4 ] 57 0.006% 0.012% ( 4, 6 ] 80 0.009% 0.021% ( 6, 10 ] 328 0.037% 0.057% ( 10, 15 ] 2273 0.256% 0.313% ( 15, 22 ] 2103 0.237% 0.550% ( 22, 34 ] 5055 0.569% 1.118% ( 34, 51 ] 1369 0.154% 1.272% ( 51, 76 ] 162 0.018% 1.291% ( 76, 110 ] 5456 0.614% 1.904% ( 110, 170 ] 314476 35.374% 37.279% ####### ( 170, 250 ] 385587 43.373% 80.652% ######### ( 250, 380 ] 91399 10.281% 90.933% ## ( 380, 580 ] 44137 4.965% 95.898% # ( 580, 870 ] 18715 2.105% 98.003% ( 870, 1300 ] 8247 0.928% 98.931% ( 1300, 1900 ] 3638 0.409% 99.340% ( 1900, 2900 ] 2012 0.226% 99.566% ( 2900, 4400 ] 1753 0.197% 99.763% ( 4400, 6600 ] 663 0.075% 99.838% ( 6600, 9900 ] 203 0.023% 99.861% ( 9900, 14000 ] 226 0.025% 99.886% ( 14000, 22000 ] 704 0.079% 99.965% ( 22000, 33000 ] 236 0.027% 99.992% ( 33000, 50000 ] 63 0.007% 99.999% ( 50000, 75000 ] 7 0.001% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 9000275 rocksdb.bloom.filter.full.positive COUNT : 975817 rocksdb.bloom.filter.full.true.positive COUNT : 888626 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 370 rocksdb.memtable.miss COUNT : 888626 rocksdb.l0.hit COUNT : 32485 rocksdb.l1.hit COUNT : 14481 rocksdb.l2andup.hit COUNT : 841660 rocksdb.compaction.key.drop.new COUNT : 241834 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4235646 rocksdb.number.keys.read COUNT : 888996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4371186672 rocksdb.bytes.read COUNT : 888996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1662 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 43707729 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24290588142 rocksdb.compact.write.bytes COUNT : 24041404181 rocksdb.flush.write.bytes COUNT : 4359909283 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 40 rocksdb.number.superversion_acquires COUNT : 933 rocksdb.number.superversion_releases COUNT : 899 rocksdb.number.superversion_cleanups COUNT : 234 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 158 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4324633600 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1577984 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27698612727 rocksdb.non.last.level.read.count COUNT : 6550789 rocksdb.block.checksum.compute.count COUNT : 6867282 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 192.333223 P95 : 542.944102 P99 : 1400.144313 P100 : 84999.000000 COUNT : 888996 SUM : 239701689 rocksdb.db.write.micros P50 : 1.552262 P95 : 4.881392 P99 : 13.314355 P100 : 778970.000000 COUNT : 4235646 SUM : 54625215 rocksdb.compaction.times.micros P50 : 1379487.179487 P95 : 2783333.333333 P99 : 34920000.000000 P100 : 45401840.000000 COUNT : 88 SUM : 174400383 rocksdb.compaction.times.cpu_micros P50 : 928000.000000 P95 : 1791111.111111 P99 : 23320000.000000 P100 : 24648032.000000 COUNT : 88 SUM : 106421543 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 870.000000 P95 : 13863.333333 P99 : 59500.000000 P100 : 60371.000000 COUNT : 62 SUM : 215040 rocksdb.compaction.outfile.sync.micros P50 : 11713.461538 P95 : 122200.000000 P99 : 170400.000000 P100 : 359279.000000 COUNT : 299 SUM : 8904553 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 260.833333 P95 : 4175.000000 P99 : 6287.600000 P100 : 31187.000000 COUNT : 171 SUM : 207507 rocksdb.table.open.io.micros P50 : 10574.081238 P95 : 20867.391304 P99 : 32545.333333 P100 : 60737.000000 COUNT : 1662 SUM : 17175819 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.119399 P95 : 9.933786 P99 : 200.357152 P100 : 49700.000000 COUNT : 5882891 SUM : 91624325 rocksdb.read.block.get.micros P50 : 156.768008 P95 : 468.061517 P99 : 1441.866812 P100 : 50153.000000 COUNT : 982812 SUM : 210971120 rocksdb.write.raw.block.micros P50 : 0.540955 P95 : 1.485157 P99 : 3.714269 P100 : 78991.000000 COUNT : 6879345 SUM : 19935419 rocksdb.numfiles.in.singlecompaction P50 : 2.897059 P95 : 5.500000 P99 : 17.975000 P100 : 18.000000 COUNT : 115 SUM : 410 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569119 P95 : 1243.081706 P99 : 2661.482519 P100 : 778795.000000 COUNT : 238553 SUM : 43728430 rocksdb.sst.read.micros P50 : 2.219330 P95 : 193.953661 P99 : 499.753778 P100 : 50148.000000 COUNT : 6550993 SUM : 283837235 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 888996 SUM : 888996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4235646 SUM : 4371186672 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 217692.307692 P95 : 845500.000000 P99 : 1103552.000000 P100 : 1103552.000000 COUNT : 62 SUM : 17515417 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 312 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0