[2024-12-12 09:38:48.079147] Starting SPDK v25.01-pre git sha1 955e8c8b4 / DPDK 24.03.0 initialization... [2024-12-12 09:38:48.079434] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid406798 ] Set seed to 1733992728072312 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-12 09:38:48.214821] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-12 09:38:48.323268] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-12 09:38:48.323317] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 406798' to capture a snapshot of events at runtime. [2024-12-12 09:38:48.323328] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-12 09:38:48.323338] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-12 09:38:48.323346] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid406798 for offline analysis/debug. [2024-12-12 09:38:48.324758] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 12 09:38:54 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/12-09:39:01 ... thread 0: (1000000,1000000) ops and (128646.7,128646.7) ops/second in (7.773225,7.773225) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 565.56 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 117.0 6.98 2.37 9 0.776 0 0 0.0 0.0 L1 1/0 70.43 MB 7.0 0.6 0.4 0.2 0.6 0.4 0.0 1.4 101.5 100.9 5.73 2.70 2 2.865 590K 3523 0.0 0.0 L2 7/2 471.50 MB 2.8 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 54/27 3.89 GB 1.7 4.8 3.9 1.0 4.7 3.7 0.0 1.2 104.1 100.7 47.47 23.46 15 3.165 2116K 0 0.0 0.0 L4 138/9 10.47 GB 1.0 1.1 0.8 0.3 1.1 0.7 0.2 1.3 114.2 107.4 10.20 5.34 5 2.039 573K 0 0.0 0.0 L5 120/0 9.84 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 326/42 25.29 GB 0.0 6.5 5.1 1.5 7.1 5.6 0.5 8.9 95.0 103.3 70.38 33.88 31 2.270 3279K 3523 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 5.1 1.5 7.1 5.6 0.5 8.9 95.0 103.3 70.38 33.88 31 2.270 3279K 3523 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 5.1 1.5 6.3 4.8 0.0 0.0 105.5 101.8 63.40 31.51 22 2.882 3279K 3523 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 117.0 6.98 2.37 9 0.776 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.8 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.10 GB write, 921.97 MB/s write, 6.53 GB read, 848.01 MB/s read, 70.4 seconds Interval compaction: 7.10 GB write, 934.28 MB/s write, 6.53 GB read, 859.34 MB/s read, 70.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 108406 Average: 42.8867 StdDev: 308.65 Min: 1 Median: 2.0453 Max: 21358 Percentiles: P50: 2.05 P75: 3.15 P99: 1289.24 P99.9: 4214.30 P99.99: 7468.83 ------------------------------------------------------ [ 0, 1 ] 2913 2.687% 2.687% # ( 1, 2 ] 50073 46.190% 48.877% ######### ( 2, 3 ] 26849 24.767% 73.644% ##### ( 3, 4 ] 10072 9.291% 82.935% ## ( 4, 6 ] 11396 10.512% 93.448% ## ( 6, 10 ] 3195 2.947% 96.395% # ( 10, 15 ] 564 0.520% 96.915% ( 15, 22 ] 72 0.066% 96.982% ( 22, 34 ] 10 0.009% 96.991% ( 34, 51 ] 5 0.005% 96.996% ( 51, 76 ] 8 0.007% 97.003% ( 76, 110 ] 5 0.005% 97.008% ( 110, 170 ] 29 0.027% 97.034% ( 170, 250 ] 93 0.086% 97.120% ( 250, 380 ] 193 0.178% 97.298% ( 380, 580 ] 457 0.422% 97.720% ( 580, 870 ] 684 0.631% 98.351% ( 870, 1300 ] 722 0.666% 99.017% ( 1300, 1900 ] 419 0.387% 99.403% ( 1900, 2900 ] 288 0.266% 99.669% ( 2900, 4400 ] 286 0.264% 99.933% ( 4400, 6600 ] 59 0.054% 99.987% ( 6600, 9900 ] 12 0.011% 99.998% ( 9900, 14000 ] 2 0.002% 100.000% ( 14000, 22000 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 42184 Average: 20.0350 StdDev: 201.59 Min: 1 Median: 2.0600 Max: 8463 Percentiles: P50: 2.06 P75: 3.05 P99: 515.13 P99.9: 3574.04 P99.99: 6156.32 ------------------------------------------------------ [ 0, 1 ] 926 2.195% 2.195% ( 1, 2 ] 19506 46.240% 48.435% ######### ( 2, 3 ] 11002 26.081% 74.516% ##### ( 3, 4 ] 4137 9.807% 84.323% ## ( 4, 6 ] 4568 10.829% 95.152% ## ( 6, 10 ] 1349 3.198% 98.350% # ( 10, 15 ] 177 0.420% 98.770% ( 15, 22 ] 26 0.062% 98.831% ( 22, 34 ] 3 0.007% 98.838% ( 34, 51 ] 2 0.005% 98.843% ( 51, 76 ] 2 0.005% 98.848% ( 76, 110 ] 1 0.002% 98.850% ( 110, 170 ] 3 0.007% 98.857% ( 170, 250 ] 9 0.021% 98.879% ( 250, 380 ] 14 0.033% 98.912% ( 380, 580 ] 55 0.130% 99.042% ( 580, 870 ] 114 0.270% 99.313% ( 870, 1300 ] 99 0.235% 99.547% ( 1300, 1900 ] 71 0.168% 99.716% ( 1900, 2900 ] 54 0.128% 99.844% ( 2900, 4400 ] 53 0.126% 99.969% ( 4400, 6600 ] 11 0.026% 99.995% ( 6600, 9900 ] 2 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 803986 Average: 16.3150 StdDev: 239.66 Min: 1 Median: 2.1563 Max: 39331 Percentiles: P50: 2.16 P75: 3.11 P99: 11.86 P99.9: 1156.78 P99.99: 1510.94 ------------------------------------------------------ [ 0, 1 ] 9653 1.201% 1.201% ( 1, 2 ] 356837 44.383% 45.584% ######### ( 2, 3 ] 227163 28.255% 73.839% ###### ( 3, 4 ] 84094 10.460% 84.298% ## ( 4, 6 ] 92374 11.490% 95.788% ## ( 6, 10 ] 24119 3.000% 98.788% # ( 10, 15 ] 4593 0.571% 99.359% ( 15, 22 ] 616 0.077% 99.436% ( 22, 34 ] 53 0.007% 99.442% ( 34, 51 ] 57 0.007% 99.449% ( 51, 76 ] 86 0.011% 99.460% ( 76, 110 ] 18 0.002% 99.462% ( 110, 170 ] 63 0.008% 99.470% ( 170, 250 ] 131 0.016% 99.486% ( 250, 380 ] 396 0.049% 99.536% ( 380, 580 ] 767 0.095% 99.631% ( 580, 870 ] 1277 0.159% 99.790% ( 870, 1300 ] 1327 0.165% 99.955% ( 1300, 1900 ] 801 0.100% 100.055% ( 1900, 2900 ] 734 0.091% 100.146% ( 2900, 4400 ] 736 0.092% 100.237% ( 4400, 6600 ] 200 0.025% 100.262% ( 6600, 9900 ] 34 0.004% 100.267% ( 9900, 14000 ] 6 0.001% 100.267% ( 14000, 22000 ] 22 0.003% 100.270% ( 22000, 33000 ] 18 0.002% 100.272% ( 33000, 50000 ] 2 0.000% 100.273% ** Level 3 read latency histogram (micros): Count: 640742 Average: 18.9456 StdDev: 203.52 Min: 1 Median: 2.2213 Max: 16148 Percentiles: P50: 2.22 P75: 3.14 P99: 14.21 P99.9: 1637.97 P99.99: 2139.31 ------------------------------------------------------ [ 0, 1 ] 6228 0.972% 0.972% ( 1, 2 ] 271248 42.333% 43.305% ######## ( 2, 3 ] 193860 30.256% 73.561% ###### ( 3, 4 ] 66977 10.453% 84.014% ## ( 4, 6 ] 73949 11.541% 95.555% ## ( 6, 10 ] 19179 2.993% 98.548% # ( 10, 15 ] 3438 0.537% 99.085% ( 15, 22 ] 467 0.073% 99.158% ( 22, 34 ] 46 0.007% 99.165% ( 34, 51 ] 55 0.009% 99.174% ( 51, 76 ] 47 0.007% 99.181% ( 76, 110 ] 17 0.003% 99.184% ( 110, 170 ] 47 0.007% 99.191% ( 170, 250 ] 128 0.020% 99.211% ( 250, 380 ] 329 0.051% 99.262% ( 380, 580 ] 836 0.130% 99.393% ( 580, 870 ] 1360 0.212% 99.605% ( 870, 1300 ] 1395 0.218% 99.823% ( 1300, 1900 ] 881 0.137% 99.960% ( 1900, 2900 ] 802 0.125% 100.085% ( 2900, 4400 ] 750 0.117% 100.202% ( 4400, 6600 ] 190 0.030% 100.232% ( 6600, 9900 ] 24 0.004% 100.236% ( 9900, 14000 ] 9 0.001% 100.237% ( 14000, 22000 ] 2 0.000% 100.238% ** Level 4 read latency histogram (micros): Count: 166537 Average: 78.2273 StdDev: 455.25 Min: 1 Median: 2.2523 Max: 32363 Percentiles: P50: 2.25 P75: 3.41 P99: 2141.56 P99.9: 4360.55 P99.99: 5685.15 ------------------------------------------------------ [ 0, 1 ] 2178 1.308% 1.308% ( 1, 2 ] 69352 41.644% 42.951% ######## ( 2, 3 ] 46534 27.942% 70.894% ###### ( 3, 4 ] 16514 9.916% 80.810% ## ( 4, 6 ] 17730 10.646% 91.456% ## ( 6, 10 ] 4629 2.780% 94.236% # ( 10, 15 ] 893 0.536% 94.772% ( 15, 22 ] 118 0.071% 94.843% ( 22, 34 ] 10 0.006% 94.849% ( 34, 51 ] 12 0.007% 94.856% ( 51, 76 ] 23 0.014% 94.870% ( 76, 110 ] 6 0.004% 94.873% ( 110, 170 ] 57 0.034% 94.907% ( 170, 250 ] 149 0.089% 94.997% ( 250, 380 ] 498 0.299% 95.296% ( 380, 580 ] 1162 0.698% 95.994% ( 580, 870 ] 1827 1.097% 97.091% ( 870, 1300 ] 1793 1.077% 98.167% ( 1300, 1900 ] 1177 0.707% 98.874% ( 1900, 2900 ] 876 0.526% 99.400% ( 2900, 4400 ] 857 0.515% 99.915% ( 4400, 6600 ] 218 0.131% 100.046% ( 6600, 9900 ] 31 0.019% 100.064% ( 9900, 14000 ] 3 0.002% 100.066% ( 14000, 22000 ] 3 0.002% 100.068% ( 22000, 33000 ] 5 0.003% 100.071% ** Level 5 read latency histogram (micros): Count: 7417 Average: 1486.6144 StdDev: 1873.44 Min: 100 Median: 1001.0673 Max: 48751 Percentiles: P50: 1001.07 P75: 1765.57 P99: 6401.81 P99.9: 30706.50 P99.99: 48198.73 ------------------------------------------------------ ( 76, 110 ] 3 0.040% 0.040% ( 110, 170 ] 32 0.431% 0.472% ( 170, 250 ] 137 1.847% 2.319% ( 250, 380 ] 419 5.649% 7.968% # ( 380, 580 ] 968 13.051% 21.019% ### ( 580, 870 ] 1674 22.570% 43.589% ##### ( 870, 1300 ] 1560 21.033% 64.622% #### ( 1300, 1900 ] 992 13.375% 77.996% ### ( 1900, 2900 ] 633 8.534% 86.531% ## ( 2900, 4400 ] 711 9.586% 96.117% ## ( 4400, 6600 ] 235 3.168% 99.285% # ( 6600, 9900 ] 37 0.499% 99.784% ( 9900, 14000 ] 3 0.040% 99.825% ( 14000, 22000 ] 4 0.054% 99.879% ( 22000, 33000 ] 2 0.027% 99.906% ( 33000, 50000 ] 7 0.094% 100.000% ** DB Stats ** Uptime(secs): 7.9 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 124.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.926 H:M:S, 49.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 126.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.926 H:M:S, 50.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/12-09:39:07 ... thread 0: (1000000,2000000) ops and (181632.0,150615.3) ops/second in (5.505639,13.278864) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.59 GB 125.3 0.8 0.0 0.8 2.6 1.8 0.0 1.4 43.4 143.2 18.86 9.01 26 0.725 830K 4226 0.0 0.0 L1 1/0 70.43 MB 7.0 0.6 0.4 0.2 0.6 0.4 0.0 1.4 101.5 100.9 5.73 2.70 2 2.865 590K 3523 0.0 0.0 L2 2/1 128.42 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 32/15 1.82 GB 1.0 6.0 4.1 1.9 5.8 3.9 0.1 1.4 110.0 106.7 55.65 29.00 18 3.092 3106K 14K 0.0 0.0 L4 142/3 9.88 GB 1.0 5.0 2.8 2.3 4.5 2.3 0.6 1.6 130.7 117.7 39.52 22.81 21 1.882 3075K 25K 0.0 0.0 L5 152/0 12.38 GB 0.1 0.0 0.0 0.0 0.0 0.0 2.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 340/23 25.87 GB 0.0 12.4 7.3 5.1 13.5 8.4 3.6 7.4 105.9 115.8 119.76 63.52 67 1.787 7602K 47K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.4 7.3 5.1 13.5 8.4 3.6 7.4 105.9 115.8 119.76 63.52 67 1.787 7602K 47K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.4 7.3 5.1 11.7 6.6 0.0 0.0 118.5 111.9 107.06 58.15 44 2.433 7602K 47K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 148.5 12.70 5.37 23 0.552 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.4 total, 13.3 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.54 GB write, 1035.44 MB/s write, 12.39 GB read, 947.37 MB/s read, 119.8 seconds Interval compaction: 13.54 GB write, 1043.54 MB/s write, 12.39 GB read, 954.78 MB/s read, 119.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 41, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 324535 Average: 48.4624 StdDev: 374.99 Min: 1 Median: 1.9972 Max: 45454 Percentiles: P50: 2.00 P75: 3.06 P99: 1234.07 P99.9: 4025.39 P99.99: 5654.68 ------------------------------------------------------ [ 0, 1 ] 9487 2.923% 2.923% # ( 1, 2 ] 153207 47.208% 50.131% ######### ( 2, 3 ] 79106 24.375% 74.507% ##### ( 3, 4 ] 28729 8.852% 83.359% ## ( 4, 6 ] 31249 9.629% 92.988% ## ( 6, 10 ] 7845 2.417% 95.405% ( 10, 15 ] 1185 0.365% 95.770% ( 15, 22 ] 133 0.041% 95.811% ( 22, 34 ] 16 0.005% 95.816% ( 34, 51 ] 16 0.005% 95.821% ( 51, 76 ] 16 0.005% 95.826% ( 76, 110 ] 16 0.005% 95.831% ( 110, 170 ] 322 0.099% 95.930% ( 170, 250 ] 968 0.298% 96.228% ( 250, 380 ] 1562 0.481% 96.710% ( 380, 580 ] 2400 0.740% 97.449% ( 580, 870 ] 3076 0.948% 98.397% ( 870, 1300 ] 2311 0.712% 99.109% ( 1300, 1900 ] 1157 0.357% 99.466% ( 1900, 2900 ] 789 0.243% 99.709% ( 2900, 4400 ] 827 0.255% 99.964% ( 4400, 6600 ] 150 0.046% 100.010% ( 6600, 9900 ] 29 0.009% 100.019% ( 9900, 14000 ] 7 0.002% 100.021% ( 14000, 22000 ] 15 0.005% 100.026% ( 22000, 33000 ] 10 0.003% 100.029% ( 33000, 50000 ] 3 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 80848 Average: 26.4148 StdDev: 276.05 Min: 1 Median: 2.1080 Max: 38113 Percentiles: P50: 2.11 P75: 3.01 P99: 811.04 P99.9: 3639.03 P99.99: 6100.75 ------------------------------------------------------ [ 0, 1 ] 1520 1.880% 1.880% ( 1, 2 ] 36462 45.099% 46.980% ######### ( 2, 3 ] 22612 27.969% 74.948% ###### ( 3, 4 ] 7628 9.435% 84.383% ## ( 4, 6 ] 8319 10.290% 94.673% ## ( 6, 10 ] 2383 2.948% 97.620% # ( 10, 15 ] 372 0.460% 98.080% ( 15, 22 ] 44 0.054% 98.135% ( 22, 34 ] 6 0.007% 98.142% ( 34, 51 ] 7 0.009% 98.151% ( 51, 76 ] 9 0.011% 98.162% ( 76, 110 ] 2 0.002% 98.164% ( 110, 170 ] 24 0.030% 98.194% ( 170, 250 ] 55 0.068% 98.262% ( 250, 380 ] 121 0.150% 98.412% ( 380, 580 ] 215 0.266% 98.678% ( 580, 870 ] 327 0.404% 99.082% ( 870, 1300 ] 311 0.385% 99.467% ( 1300, 1900 ] 175 0.216% 99.683% ( 1900, 2900 ] 118 0.146% 99.829% ( 2900, 4400 ] 116 0.143% 99.973% ( 4400, 6600 ] 18 0.022% 99.995% ( 6600, 9900 ] 4 0.005% 100.000% ( 9900, 14000 ] 1 0.001% 100.001% ( 14000, 22000 ] 1 0.001% 100.002% ( 22000, 33000 ] 1 0.001% 100.004% ( 33000, 50000 ] 1 0.001% 100.005% ** Level 2 read latency histogram (micros): Count: 836619 Average: 16.0183 StdDev: 236.09 Min: 1 Median: 2.1569 Max: 39331 Percentiles: P50: 2.16 P75: 3.11 P99: 11.78 P99.9: 1163.00 P99.99: 1535.67 ------------------------------------------------------ [ 0, 1 ] 9992 1.194% 1.194% ( 1, 2 ] 371157 44.364% 45.558% ######### ( 2, 3 ] 236808 28.305% 73.864% ###### ( 3, 4 ] 87540 10.464% 84.327% ## ( 4, 6 ] 95940 11.468% 95.795% ## ( 6, 10 ] 25127 3.003% 98.798% # ( 10, 15 ] 4744 0.567% 99.365% ( 15, 22 ] 639 0.076% 99.442% ( 22, 34 ] 54 0.006% 99.448% ( 34, 51 ] 60 0.007% 99.455% ( 51, 76 ] 88 0.011% 99.466% ( 76, 110 ] 18 0.002% 99.468% ( 110, 170 ] 65 0.008% 99.476% ( 170, 250 ] 134 0.016% 99.492% ( 250, 380 ] 400 0.048% 99.539% ( 380, 580 ] 783 0.094% 99.633% ( 580, 870 ] 1306 0.156% 99.789% ( 870, 1300 ] 1361 0.163% 99.952% ( 1300, 1900 ] 813 0.097% 100.049% ( 1900, 2900 ] 745 0.089% 100.138% ( 2900, 4400 ] 750 0.090% 100.228% ( 4400, 6600 ] 203 0.024% 100.252% ( 6600, 9900 ] 35 0.004% 100.256% ( 9900, 14000 ] 6 0.001% 100.257% ( 14000, 22000 ] 22 0.003% 100.259% ( 22000, 33000 ] 18 0.002% 100.262% ( 33000, 50000 ] 2 0.000% 100.262% ** Level 3 read latency histogram (micros): Count: 1327987 Average: 16.3802 StdDev: 206.07 Min: 1 Median: 2.1915 Max: 35081 Percentiles: P50: 2.19 P75: 3.03 P99: 13.44 P99.9: 1345.96 P99.99: 1854.55 ------------------------------------------------------ [ 0, 1 ] 11115 0.837% 0.837% ( 1, 2 ] 575299 43.321% 44.158% ######### ( 2, 3 ] 405197 30.512% 74.670% ###### ( 3, 4 ] 134077 10.096% 84.766% ## ( 4, 6 ] 146437 11.027% 95.793% ## ( 6, 10 ] 38030 2.864% 98.657% # ( 10, 15 ] 6622 0.499% 99.156% ( 15, 22 ] 859 0.065% 99.221% ( 22, 34 ] 85 0.006% 99.227% ( 34, 51 ] 142 0.011% 99.238% ( 51, 76 ] 113 0.009% 99.246% ( 76, 110 ] 39 0.003% 99.249% ( 110, 170 ] 202 0.015% 99.264% ( 170, 250 ] 502 0.038% 99.302% ( 250, 380 ] 984 0.074% 99.376% ( 380, 580 ] 1826 0.138% 99.514% ( 580, 870 ] 2571 0.194% 99.707% ( 870, 1300 ] 2452 0.185% 99.892% ( 1300, 1900 ] 1410 0.106% 99.998% ( 1900, 2900 ] 1249 0.094% 100.092% ( 2900, 4400 ] 1202 0.091% 100.183% ( 4400, 6600 ] 280 0.021% 100.204% ( 6600, 9900 ] 52 0.004% 100.208% ( 9900, 14000 ] 15 0.001% 100.209% ( 14000, 22000 ] 16 0.001% 100.210% ( 22000, 33000 ] 10 0.001% 100.211% ( 33000, 50000 ] 1 0.000% 100.211% ** Level 4 read latency histogram (micros): Count: 638487 Average: 43.4896 StdDev: 350.63 Min: 1 Median: 2.2151 Max: 37099 Percentiles: P50: 2.22 P75: 3.28 P99: 1136.30 P99.9: 3438.97 P99.99: 3961.69 ------------------------------------------------------ [ 0, 1 ] 8464 1.326% 1.326% ( 1, 2 ] 272095 42.616% 43.941% ######### ( 2, 3 ] 179886 28.174% 72.115% ###### ( 3, 4 ] 65374 10.239% 82.354% ## ( 4, 6 ] 71082 11.133% 93.487% ## ( 6, 10 ] 18391 2.880% 96.367% # ( 10, 15 ] 3465 0.543% 96.910% ( 15, 22 ] 456 0.071% 96.981% ( 22, 34 ] 37 0.006% 96.987% ( 34, 51 ] 61 0.010% 96.997% ( 51, 76 ] 90 0.014% 97.011% ( 76, 110 ] 32 0.005% 97.016% ( 110, 170 ] 392 0.061% 97.077% ( 170, 250 ] 894 0.140% 97.217% ( 250, 380 ] 1726 0.270% 97.487% ( 380, 580 ] 3077 0.482% 97.969% ( 580, 870 ] 4234 0.663% 98.633% ( 870, 1300 ] 3790 0.594% 99.226% ( 1300, 1900 ] 2126 0.333% 99.559% ( 1900, 2900 ] 1585 0.248% 99.807% ( 2900, 4400 ] 1649 0.258% 100.066% ( 4400, 6600 ] 388 0.061% 100.126% ( 6600, 9900 ] 75 0.012% 100.138% ( 9900, 14000 ] 21 0.003% 100.141% ( 14000, 22000 ] 19 0.003% 100.144% ( 22000, 33000 ] 15 0.002% 100.147% ( 33000, 50000 ] 1 0.000% 100.147% ** Level 5 read latency histogram (micros): Count: 14043 Average: 1259.7676 StdDev: 1664.86 Min: 90 Median: 825.9678 Max: 48751 Percentiles: P50: 825.97 P75: 1462.32 P99: 6115.21 P99.9: 23315.88 P99.99: 46589.56 ------------------------------------------------------ ( 76, 110 ] 20 0.142% 0.142% ( 110, 170 ] 232 1.652% 1.794% ( 170, 250 ] 658 4.686% 6.480% # ( 250, 380 ] 1295 9.222% 15.702% ## ( 380, 580 ] 2205 15.702% 31.404% ### ( 580, 870 ] 3079 21.926% 53.329% #### ( 870, 1300 ] 2638 18.785% 72.114% #### ( 1300, 1900 ] 1498 10.667% 82.781% ## ( 1900, 2900 ] 1010 7.192% 89.974% # ( 2900, 4400 ] 1029 7.327% 97.301% # ( 4400, 6600 ] 306 2.179% 99.480% ( 6600, 9900 ] 43 0.306% 99.786% ( 9900, 14000 ] 6 0.043% 99.829% ( 14000, 22000 ] 9 0.064% 99.893% ( 22000, 33000 ] 8 0.057% 99.950% ( 33000, 50000 ] 7 0.050% 100.000% ** DB Stats ** Uptime(secs): 13.4 total, 5.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 147.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.709 H:M:S, 42.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 178.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.783 H:M:S, 32.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/12-09:39:12 ... thread 0: (1000000,3000000) ops and (199407.0,163990.6) ops/second in (5.014870,18.293734) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 2.51 GB 193.9 1.5 0.0 1.5 4.3 2.8 0.0 1.6 42.7 119.2 36.85 15.21 41 0.899 1596K 9471 0.0 0.0 L1 1/0 70.43 MB 7.0 0.6 0.4 0.2 0.6 0.4 0.0 1.4 101.5 100.9 5.73 2.70 2 2.865 590K 3523 0.0 0.0 L2 1/0 63.69 MB 0.6 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/0 989.86 MB 1.0 6.8 4.1 2.7 6.6 3.9 0.1 1.6 113.2 110.0 61.92 33.19 19 3.259 4009K 32K 0.0 0.0 L4 145/0 9.58 GB 1.0 7.9 3.4 4.5 6.8 2.3 0.9 2.0 129.8 111.3 62.36 34.35 31 2.012 3743K 25K 0.0 0.0 L5 160/0 12.95 GB 0.1 0.0 0.0 0.0 0.0 0.0 3.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 342/9 26.14 GB 0.0 16.9 8.0 8.9 18.3 9.4 4.4 6.6 103.4 112.2 166.86 85.44 93 1.794 9939K 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.9 8.0 8.9 18.3 9.4 4.4 6.6 103.4 112.2 166.86 85.44 93 1.794 9939K 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.9 8.0 8.9 15.5 6.6 0.0 0.0 115.5 106.3 149.45 77.36 57 2.622 9939K 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 162.5 17.41 8.08 36 0.484 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.4 total, 18.3 interval Flush(GB): cumulative 2.763, interval 2.763 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.28 GB write, 1016.99 MB/s write, 16.85 GB read, 937.71 MB/s read, 166.9 seconds Interval compaction: 18.28 GB write, 1022.77 MB/s write, 16.85 GB read, 943.03 MB/s read, 166.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 51, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 567825 Average: 40.3276 StdDev: 313.78 Min: 1 Median: 1.9640 Max: 45454 Percentiles: P50: 1.96 P75: 3.08 P99: 977.61 P99.9: 3650.97 P99.99: 4387.35 ------------------------------------------------------ [ 0, 1 ] 28916 5.092% 5.092% # ( 1, 2 ] 264516 46.584% 51.676% ######### ( 2, 3 ] 128683 22.662% 74.339% ##### ( 3, 4 ] 48441 8.531% 82.870% ## ( 4, 6 ] 52294 9.210% 92.079% ## ( 6, 10 ] 12914 2.274% 94.354% ( 10, 15 ] 2162 0.381% 94.734% ( 15, 22 ] 266 0.047% 94.781% ( 22, 34 ] 32 0.006% 94.787% ( 34, 51 ] 23 0.004% 94.791% ( 51, 76 ] 23 0.004% 94.795% ( 76, 110 ] 397 0.070% 94.865% ( 110, 170 ] 5347 0.942% 95.807% ( 170, 250 ] 5610 0.988% 96.795% ( 250, 380 ] 3726 0.656% 97.451% ( 380, 580 ] 3989 0.703% 98.153% ( 580, 870 ] 4085 0.719% 98.873% ( 870, 1300 ] 2892 0.509% 99.382% ( 1300, 1900 ] 1433 0.252% 99.634% ( 1900, 2900 ] 988 0.174% 99.808% ( 2900, 4400 ] 1041 0.183% 99.992% ( 4400, 6600 ] 210 0.037% 100.029% ( 6600, 9900 ] 38 0.007% 100.035% ( 9900, 14000 ] 8 0.001% 100.037% ( 14000, 22000 ] 18 0.003% 100.040% ( 22000, 33000 ] 11 0.002% 100.042% ( 33000, 50000 ] 3 0.001% 100.042% ** Level 1 read latency histogram (micros): Count: 84007 Average: 28.7736 StdDev: 279.10 Min: 1 Median: 2.0963 Max: 38113 Percentiles: P50: 2.10 P75: 3.01 P99: 841.10 P99.9: 3674.11 P99.99: 6206.23 ------------------------------------------------------ [ 0, 1 ] 1738 2.069% 2.069% ( 1, 2 ] 38037 45.278% 47.347% ######### ( 2, 3 ] 23140 27.545% 74.893% ###### ( 3, 4 ] 7712 9.180% 84.073% ## ( 4, 6 ] 8380 9.975% 94.048% ## ( 6, 10 ] 2428 2.890% 96.938% # ( 10, 15 ] 379 0.451% 97.390% ( 15, 22 ] 46 0.055% 97.444% ( 22, 34 ] 6 0.007% 97.451% ( 34, 51 ] 7 0.008% 97.460% ( 51, 76 ] 9 0.011% 97.470% ( 76, 110 ] 16 0.019% 97.489% ( 110, 170 ] 219 0.261% 97.750% ( 170, 250 ] 227 0.270% 98.020% ( 250, 380 ] 199 0.237% 98.257% ( 380, 580 ] 289 0.344% 98.601% ( 580, 870 ] 372 0.443% 99.044% ( 870, 1300 ] 334 0.398% 99.442% ( 1300, 1900 ] 190 0.226% 99.668% ( 1900, 2900 ] 131 0.156% 99.824% ( 2900, 4400 ] 124 0.148% 99.971% ( 4400, 6600 ] 19 0.023% 99.994% ( 6600, 9900 ] 5 0.006% 100.000% ( 9900, 14000 ] 1 0.001% 100.001% ( 14000, 22000 ] 1 0.001% 100.002% ( 22000, 33000 ] 1 0.001% 100.004% ( 33000, 50000 ] 1 0.001% 100.005% ** Level 2 read latency histogram (micros): Count: 836619 Average: 16.0183 StdDev: 236.09 Min: 1 Median: 2.1569 Max: 39331 Percentiles: P50: 2.16 P75: 3.11 P99: 11.78 P99.9: 1163.00 P99.99: 1535.67 ------------------------------------------------------ [ 0, 1 ] 9992 1.194% 1.194% ( 1, 2 ] 371157 44.364% 45.558% ######### ( 2, 3 ] 236808 28.305% 73.864% ###### ( 3, 4 ] 87540 10.464% 84.327% ## ( 4, 6 ] 95940 11.468% 95.795% ## ( 6, 10 ] 25127 3.003% 98.798% # ( 10, 15 ] 4744 0.567% 99.365% ( 15, 22 ] 639 0.076% 99.442% ( 22, 34 ] 54 0.006% 99.448% ( 34, 51 ] 60 0.007% 99.455% ( 51, 76 ] 88 0.011% 99.466% ( 76, 110 ] 18 0.002% 99.468% ( 110, 170 ] 65 0.008% 99.476% ( 170, 250 ] 134 0.016% 99.492% ( 250, 380 ] 400 0.048% 99.539% ( 380, 580 ] 783 0.094% 99.633% ( 580, 870 ] 1306 0.156% 99.789% ( 870, 1300 ] 1361 0.163% 99.952% ( 1300, 1900 ] 813 0.097% 100.049% ( 1900, 2900 ] 745 0.089% 100.138% ( 2900, 4400 ] 750 0.090% 100.228% ( 4400, 6600 ] 203 0.024% 100.252% ( 6600, 9900 ] 35 0.004% 100.256% ( 9900, 14000 ] 6 0.001% 100.257% ( 14000, 22000 ] 22 0.003% 100.259% ( 22000, 33000 ] 18 0.002% 100.262% ( 33000, 50000 ] 2 0.000% 100.262% ** Level 3 read latency histogram (micros): Count: 1520778 Average: 16.6102 StdDev: 208.43 Min: 1 Median: 2.1876 Max: 59742 Percentiles: P50: 2.19 P75: 3.05 P99: 17.84 P99.9: 1408.66 P99.99: 1937.09 ------------------------------------------------------ [ 0, 1 ] 16746 1.101% 1.101% ( 1, 2 ] 657579 43.240% 44.341% ######### ( 2, 3 ] 458676 30.161% 74.501% ###### ( 3, 4 ] 153230 10.076% 84.577% ## ( 4, 6 ] 167451 11.011% 95.588% ## ( 6, 10 ] 43939 2.889% 98.477% # ( 10, 15 ] 7532 0.495% 98.973% ( 15, 22 ] 1027 0.068% 99.040% ( 22, 34 ] 102 0.007% 99.047% ( 34, 51 ] 159 0.010% 99.057% ( 51, 76 ] 131 0.009% 99.066% ( 76, 110 ] 107 0.007% 99.073% ( 110, 170 ] 1124 0.074% 99.147% ( 170, 250 ] 1512 0.099% 99.246% ( 250, 380 ] 1504 0.099% 99.345% ( 380, 580 ] 2337 0.154% 99.499% ( 580, 870 ] 3039 0.200% 99.699% ( 870, 1300 ] 2771 0.182% 99.881% ( 1300, 1900 ] 1608 0.106% 99.987% ( 1900, 2900 ] 1400 0.092% 100.079% ( 2900, 4400 ] 1348 0.089% 100.167% ( 4400, 6600 ] 314 0.021% 100.188% ( 6600, 9900 ] 57 0.004% 100.192% ( 9900, 14000 ] 16 0.001% 100.193% ( 14000, 22000 ] 17 0.001% 100.194% ( 22000, 33000 ] 11 0.001% 100.195% ( 33000, 50000 ] 1 0.000% 100.195% ( 50000, 75000 ] 1 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 1193729 Average: 36.6269 StdDev: 326.81 Min: 1 Median: 2.2454 Max: 58182 Percentiles: P50: 2.25 P75: 3.38 P99: 830.73 P99.9: 2751.44 P99.99: 3324.35 ------------------------------------------------------ [ 0, 1 ] 22845 1.914% 1.914% ( 1, 2 ] 492362 41.246% 43.159% ######## ( 2, 3 ] 332723 27.873% 71.032% ###### ( 3, 4 ] 126132 10.566% 81.598% ## ( 4, 6 ] 138562 11.607% 93.206% ## ( 6, 10 ] 36092 3.023% 96.229% # ( 10, 15 ] 6924 0.580% 96.809% ( 15, 22 ] 953 0.080% 96.889% ( 22, 34 ] 76 0.006% 96.895% ( 34, 51 ] 109 0.009% 96.905% ( 51, 76 ] 153 0.013% 96.917% ( 76, 110 ] 294 0.025% 96.942% ( 110, 170 ] 5001 0.419% 97.361% ( 170, 250 ] 5229 0.438% 97.799% ( 250, 380 ] 3923 0.329% 98.128% ( 380, 580 ] 5209 0.436% 98.564% ( 580, 870 ] 6020 0.504% 99.068% ( 870, 1300 ] 5096 0.427% 99.495% ( 1300, 1900 ] 2845 0.238% 99.734% ( 1900, 2900 ] 2334 0.196% 99.929% ( 2900, 4400 ] 2572 0.215% 100.145% ( 4400, 6600 ] 665 0.056% 100.200% ( 6600, 9900 ] 115 0.010% 100.210% ( 9900, 14000 ] 26 0.002% 100.212% ( 14000, 22000 ] 24 0.002% 100.214% ( 22000, 33000 ] 21 0.002% 100.216% ( 33000, 50000 ] 3 0.000% 100.216% ( 50000, 75000 ] 3 0.000% 100.216% ** Level 5 read latency histogram (micros): Count: 26056 Average: 894.0449 StdDev: 1442.35 Min: 85 Median: 507.7393 Max: 70708 Percentiles: P50: 507.74 P75: 1048.76 P99: 5583.16 P99.9: 13278.40 P99.99: 46100.69 ------------------------------------------------------ ( 76, 110 ] 270 1.036% 1.036% ( 110, 170 ] 3777 14.496% 15.532% ### ( 170, 250 ] 3919 15.041% 30.573% ### ( 250, 380 ] 2847 10.926% 41.499% ## ( 380, 580 ] 3468 13.310% 54.809% ### ( 580, 870 ] 3949 15.156% 69.965% ### ( 870, 1300 ] 3156 12.112% 82.077% ## ( 1300, 1900 ] 1745 6.697% 88.774% # ( 1900, 2900 ] 1207 4.632% 93.407% # ( 2900, 4400 ] 1252 4.805% 98.212% # ( 4400, 6600 ] 382 1.466% 99.678% ( 6600, 9900 ] 53 0.203% 99.881% ( 9900, 14000 ] 6 0.023% 99.904% ( 14000, 22000 ] 9 0.035% 99.939% ( 22000, 33000 ] 8 0.031% 99.969% ( 33000, 50000 ] 7 0.027% 99.996% ( 50000, 75000 ] 1 0.004% 100.000% ** DB Stats ** Uptime(secs): 18.4 total, 5.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 160.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.059 H:M:S, 38.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 196.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.350 H:M:S, 26.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 804.129 micros/op 4958 ops/sec 20.167 seconds 99996 operations; 4.8 MB/s (24999 of 24999 found) Microseconds per read: Count: 99996 Average: 804.1641 StdDev: 1716.81 Min: 2 Median: 372.1828 Max: 97978 Percentiles: P50: 372.18 P75: 837.39 P99: 5811.77 P99.9: 26991.15 P99.99: 48057.34 ------------------------------------------------------ ( 1, 2 ] 1 0.001% 0.001% ( 2, 3 ] 4 0.004% 0.005% ( 3, 4 ] 9 0.009% 0.014% ( 4, 6 ] 74 0.074% 0.088% ( 6, 10 ] 189 0.189% 0.277% ( 10, 15 ] 248 0.248% 0.525% ( 15, 22 ] 353 0.353% 0.878% ( 22, 34 ] 1554 1.554% 2.432% ( 34, 51 ] 2039 2.039% 4.471% ( 51, 76 ] 326 0.326% 4.797% ( 76, 110 ] 36 0.036% 4.833% ( 110, 170 ] 6184 6.184% 11.017% # ( 170, 250 ] 25164 25.165% 36.182% ##### ( 250, 380 ] 14701 14.702% 50.884% ### ( 380, 580 ] 13121 13.122% 64.006% ### ( 580, 870 ] 12387 12.387% 76.393% ## ( 870, 1300 ] 9644 9.644% 86.037% ## ( 1300, 1900 ] 5225 5.225% 91.263% # ( 1900, 2900 ] 3620 3.620% 94.883% # ( 2900, 4400 ] 3458 3.458% 98.341% # ( 4400, 6600 ] 1027 1.027% 99.368% ( 6600, 9900 ] 268 0.268% 99.636% ( 9900, 14000 ] 95 0.095% 99.731% ( 14000, 22000 ] 120 0.120% 99.851% ( 22000, 33000 ] 108 0.108% 99.959% ( 33000, 50000 ] 35 0.035% 99.994% ( 50000, 75000 ] 5 0.005% 99.999% ( 75000, 110000 ] 1 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 1365157 rocksdb.bloom.filter.full.positive COUNT : 112573 rocksdb.bloom.filter.full.true.positive COUNT : 99402 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 594 rocksdb.memtable.miss COUNT : 99402 rocksdb.l0.hit COUNT : 8589 rocksdb.l1.hit COUNT : 363 rocksdb.l2andup.hit COUNT : 90450 rocksdb.compaction.key.drop.new COUNT : 1394777 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3450691 rocksdb.number.keys.read COUNT : 99996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 3561113112 rocksdb.bytes.read COUNT : 99996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 572 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 7353627 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 18840674844 rocksdb.compact.write.bytes COUNT : 17401185629 rocksdb.flush.write.bytes COUNT : 3494391691 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 37 rocksdb.number.superversion_acquires COUNT : 699 rocksdb.number.superversion_releases COUNT : 676 rocksdb.number.superversion_cleanups COUNT : 173 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 188 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3472804864 rocksdb.memtable.garbage.bytes.at.flush COUNT : 7420928 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 18357524086 rocksdb.non.last.level.read.count COUNT : 4407678 rocksdb.block.checksum.compute.count COUNT : 4679080 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 371.220686 P95 : 2949.985537 P99 : 5811.001949 P100 : 97977.000000 COUNT : 99996 SUM : 80297852 rocksdb.db.write.micros P50 : 1.527056 P95 : 3.947695 P99 : 5.901494 P100 : 910525.000000 COUNT : 3450691 SUM : 15836603 rocksdb.compaction.times.micros P50 : 2261111.111111 P95 : 5427500.000000 P99 : 10709270.000000 P100 : 10709270.000000 COUNT : 59 SUM : 151359671 rocksdb.compaction.times.cpu_micros P50 : 1258333.333333 P95 : 2737500.000000 P99 : 3474000.000000 P100 : 4190256.000000 COUNT : 59 SUM : 79236185 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1600.000000 P95 : 106500.000000 P99 : 427970.000000 P100 : 427970.000000 COUNT : 44 SUM : 1086850 rocksdb.compaction.outfile.sync.micros P50 : 28470.588235 P95 : 236666.666667 P99 : 487666.666667 P100 : 725318.000000 COUNT : 230 SUM : 13720473 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 467.500000 P95 : 3387.500000 P99 : 4932.000000 P100 : 4932.000000 COUNT : 121 SUM : 120641 rocksdb.table.open.io.micros P50 : 7604.347826 P95 : 20795.876289 P99 : 26786.000000 P100 : 26786.000000 COUNT : 572 SUM : 4755259 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.405606 P95 : 9.571882 P99 : 166.982207 P100 : 59746.000000 COUNT : 4564112 SUM : 80366307 rocksdb.read.block.get.micros P50 : 276.801541 P95 : 2688.643881 P99 : 4597.422222 P100 : 70718.000000 COUNT : 114516 SUM : 74776247 rocksdb.write.raw.block.micros P50 : 0.528199 P95 : 1.103082 P99 : 4.248580 P100 : 79984.000000 COUNT : 5062609 SUM : 19125246 rocksdb.numfiles.in.singlecompaction P50 : 3.232558 P95 : 5.200000 P99 : 11.000000 P100 : 15.000000 COUNT : 80 SUM : 299 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.566807 P95 : 1151.847162 P99 : 2642.500000 P100 : 910314.000000 COUNT : 2418 SUM : 7353964 rocksdb.sst.read.micros P50 : 2.159603 P95 : 8.755345 P99 : 818.161141 P100 : 70708.000000 COUNT : 4407989 SUM : 139338957 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 99996 SUM : 99996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3450691 SUM : 3561113112 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 315000.000000 P95 : 1075333.333333 P99 : 1162409.000000 P100 : 1162409.000000 COUNT : 44 SUM : 19039779 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 228 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0