[2024-11-30 19:01:57.319787] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-30 19:01:57.319925] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid212981 ] Set seed to 1732989717316326 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-30 19:01:57.423051] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-30 19:01:57.462965] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-30 19:01:57.463006] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 212981' to capture a snapshot of events at runtime. [2024-11-30 19:01:57.463019] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid212981 for offline analysis/debug. [2024-11-30 19:01:57.463042] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 30 19:02:01 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/30-19:02:06 ... thread 0: (1000000,1000000) ops and (225785.6,225785.6) ops/second in (4.428981,4.428981) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.93 GB 62.9 0.6 0.0 0.6 1.4 0.9 0.0 1.6 94.9 242.5 5.97 4.67 15 0.398 575K 700 0.0 0.0 L3 17/0 995.12 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.1 3.2 123.6 123.5 1.52 0.88 1 1.520 190K 67 0.0 0.0 L4 173/0 9.51 GB 1.0 1.6 1.0 0.6 1.6 1.0 0.2 1.6 116.7 116.2 14.07 7.70 10 1.407 311K 0 0.0 0.0 L5 1120/0 92.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1328/15 105.50 GB 0.0 2.3 1.1 1.3 3.2 1.9 3.3 3.7 111.2 151.7 21.56 13.25 26 0.829 1077K 767 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.1 1.3 3.2 1.9 3.3 3.7 111.2 151.7 21.56 13.25 26 0.829 1077K 767 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.1 1.3 2.3 1.1 0.0 0.0 135.0 134.5 17.76 10.71 13 1.366 1077K 767 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 231.7 3.81 2.54 13 0.293 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.6 total, 4.4 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.19 GB write, 708.04 MB/s write, 2.34 GB read, 519.09 MB/s read, 21.6 seconds Interval compaction: 3.19 GB write, 738.18 MB/s write, 2.34 GB read, 541.18 MB/s read, 21.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 10, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 298296 Average: 12.3057 StdDev: 108.43 Min: 1 Median: 1.5694 Max: 6845 Percentiles: P50: 1.57 P75: 1.99 P99: 235.89 P99.9: 1299.54 P99.99: 2390.29 ------------------------------------------------------ [ 0, 1 ] 48875 16.385% 16.385% ### ( 1, 2 ] 176113 59.040% 75.424% ############ ( 2, 3 ] 36036 12.081% 87.505% ## ( 3, 4 ] 14777 4.954% 92.459% # ( 4, 6 ] 10556 3.539% 95.998% # ( 6, 10 ] 3335 1.118% 97.116% ( 10, 15 ] 658 0.221% 97.336% ( 15, 22 ] 93 0.031% 97.367% ( 22, 34 ] 23 0.008% 97.375% ( 34, 51 ] 6 0.002% 97.377% ( 51, 76 ] 6 0.002% 97.379% ( 76, 110 ] 701 0.235% 97.614% ( 110, 170 ] 2847 0.954% 98.569% ( 170, 250 ] 1565 0.525% 99.093% ( 250, 380 ] 899 0.301% 99.395% ( 380, 580 ] 768 0.257% 99.652% ( 580, 870 ] 464 0.156% 99.808% ( 870, 1300 ] 278 0.093% 99.901% ( 1300, 1900 ] 201 0.067% 99.968% ( 1900, 2900 ] 137 0.046% 100.014% ( 2900, 4400 ] 75 0.025% 100.039% ( 4400, 6600 ] 15 0.005% 100.044% ( 6600, 9900 ] 1 0.000% 100.045% ** Level 2 read latency histogram (micros): Count: 15026 Average: 17.1609 StdDev: 166.68 Min: 1 Median: 1.8791 Max: 7466 Percentiles: P50: 1.88 P75: 2.91 P99: 440.42 P99.9: 2431.60 P99.99: 6231.43 ------------------------------------------------------ [ 0, 1 ] 924 6.149% 6.149% # ( 1, 2 ] 7495 49.880% 56.030% ########## ( 2, 3 ] 3127 20.811% 76.840% #### ( 3, 4 ] 1369 9.111% 85.951% ## ( 4, 6 ] 1435 9.550% 95.501% ## ( 6, 10 ] 356 2.369% 97.870% ( 10, 15 ] 110 0.732% 98.602% ( 15, 22 ] 10 0.067% 98.669% ( 22, 34 ] 3 0.020% 98.689% ( 34, 51 ] 2 0.013% 98.702% ( 76, 110 ] 6 0.040% 98.742% ( 110, 170 ] 15 0.100% 98.842% ( 170, 250 ] 8 0.053% 98.895% ( 250, 380 ] 10 0.067% 98.962% ( 380, 580 ] 19 0.126% 99.088% ( 580, 870 ] 37 0.246% 99.334% ( 870, 1300 ] 46 0.306% 99.641% ( 1300, 1900 ] 31 0.206% 99.847% ( 1900, 2900 ] 15 0.100% 99.947% ( 2900, 4400 ] 4 0.027% 99.973% ( 4400, 6600 ] 3 0.020% 99.993% ( 6600, 9900 ] 1 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 102607 Average: 11.6177 StdDev: 131.68 Min: 1 Median: 1.8162 Max: 8086 Percentiles: P50: 1.82 P75: 2.78 P99: 26.29 P99.9: 1879.96 P99.99: 4088.83 ------------------------------------------------------ [ 0, 1 ] 7151 6.969% 6.969% # ( 1, 2 ] 54097 52.723% 59.692% ########### ( 2, 3 ] 20016 19.507% 79.199% #### ( 3, 4 ] 8721 8.499% 87.699% ## ( 4, 6 ] 8011 7.807% 95.506% ## ( 6, 10 ] 2776 2.705% 98.212% # ( 10, 15 ] 677 0.660% 98.871% ( 15, 22 ] 123 0.120% 98.991% ( 22, 34 ] 25 0.024% 99.016% ( 34, 51 ] 8 0.008% 99.023% ( 51, 76 ] 2 0.002% 99.025% ( 76, 110 ] 27 0.026% 99.052% ( 110, 170 ] 120 0.117% 99.169% ( 170, 250 ] 97 0.095% 99.263% ( 250, 380 ] 125 0.122% 99.385% ( 380, 580 ] 137 0.134% 99.519% ( 580, 870 ] 155 0.151% 99.670% ( 870, 1300 ] 132 0.129% 99.798% ( 1300, 1900 ] 108 0.105% 99.904% ( 1900, 2900 ] 61 0.059% 99.963% ( 2900, 4400 ] 35 0.034% 99.997% ( 4400, 6600 ] 11 0.011% 100.008% ( 6600, 9900 ] 3 0.003% 100.011% ** Level 4 read latency histogram (micros): Count: 78723 Average: 38.4723 StdDev: 259.06 Min: 1 Median: 1.7849 Max: 8142 Percentiles: P50: 1.78 P75: 2.76 P99: 1186.76 P99.9: 3702.30 P99.99: 4960.03 ------------------------------------------------------ [ 0, 1 ] 6118 7.772% 7.772% ## ( 1, 2 ] 42352 53.799% 61.570% ########### ( 2, 3 ] 13973 17.750% 79.320% #### ( 3, 4 ] 5908 7.505% 86.825% ## ( 4, 6 ] 4656 5.914% 92.739% # ( 6, 10 ] 1671 2.123% 94.862% ( 10, 15 ] 369 0.469% 95.330% ( 15, 22 ] 75 0.095% 95.426% ( 22, 34 ] 22 0.028% 95.454% ( 34, 51 ] 10 0.013% 95.466% ( 51, 76 ] 2 0.003% 95.469% ( 76, 110 ] 194 0.246% 95.715% ( 110, 170 ] 753 0.957% 96.672% ( 170, 250 ] 458 0.582% 97.254% ( 250, 380 ] 344 0.437% 97.691% ( 380, 580 ] 392 0.498% 98.189% ( 580, 870 ] 364 0.462% 98.651% ( 870, 1300 ] 373 0.474% 99.125% ( 1300, 1900 ] 312 0.396% 99.521% ( 1900, 2900 ] 225 0.286% 99.807% ( 2900, 4400 ] 137 0.174% 99.981% ( 4400, 6600 ] 28 0.036% 100.017% ( 6600, 9900 ] 4 0.005% 100.022% ** Level 5 read latency histogram (micros): Count: 20819 Average: 583.4346 StdDev: 934.94 Min: 77 Median: 218.9174 Max: 11022 Percentiles: P50: 218.92 P75: 531.86 P99: 4801.75 P99.9: 7644.73 P99.99: 9776.89 ------------------------------------------------------ ( 76, 110 ] 1742 8.367% 8.367% ## ( 110, 170 ] 6572 31.567% 39.935% ###### ( 170, 250 ] 3427 16.461% 56.396% ### ( 250, 380 ] 2284 10.971% 67.366% ## ( 380, 580 ] 2093 10.053% 77.420% ## ( 580, 870 ] 1368 6.571% 83.991% # ( 870, 1300 ] 892 4.285% 88.275% # ( 1300, 1900 ] 720 3.458% 91.734% # ( 1900, 2900 ] 808 3.881% 95.615% # ( 2900, 4400 ] 665 3.194% 98.809% # ( 4400, 6600 ] 218 1.047% 99.856% ( 6600, 9900 ] 29 0.139% 99.995% ( 9900, 14000 ] 2 0.010% 100.005% ** DB Stats ** Uptime(secs): 4.6 total, 4.4 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 213.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.715 H:M:S, 15.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 222.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.715 H:M:S, 16.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/30-19:02:13 ... thread 0: (1000000,2000000) ops and (130129.9,165103.5) ops/second in (7.684631,12.113612) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.91 GB 163.2 2.6 0.0 2.6 4.4 1.8 0.0 2.4 156.9 268.6 16.86 15.01 36 0.468 2685K 6222 0.0 0.0 L3 17/0 995.12 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.1 3.2 123.6 123.5 1.52 0.88 1 1.520 190K 67 0.0 0.0 L4 173/0 9.51 GB 1.0 1.6 1.0 0.6 1.6 1.0 0.2 1.6 116.7 116.2 14.07 7.70 10 1.407 311K 0 0.0 0.0 L5 1120/0 92.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1328/15 106.48 GB 0.0 4.4 1.1 3.3 6.2 2.9 3.3 3.4 137.9 195.7 32.45 23.59 47 0.690 3187K 6289 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 1.1 3.3 6.2 2.9 3.3 3.4 137.9 195.7 32.45 23.59 47 0.690 3187K 6289 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 1.1 3.3 4.4 1.0 0.0 0.0 174.9 174.3 25.59 18.39 18 1.422 3187K 6289 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 275.4 6.86 5.20 29 0.237 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.20 GB write, 516.17 MB/s write, 4.37 GB read, 363.76 MB/s read, 32.5 seconds Interval compaction: 6.20 GB write, 524.21 MB/s write, 4.37 GB read, 369.43 MB/s read, 32.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 10, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 871484 Average: 16.6912 StdDev: 82.62 Min: 0 Median: 1.4738 Max: 6845 Percentiles: P50: 1.47 P75: 1.93 P99: 248.44 P99.9: 698.97 P99.99: 1043.27 ------------------------------------------------------ [ 0, 1 ] 211768 24.300% 24.300% ##### ( 1, 2 ] 472702 54.241% 78.541% ########### ( 2, 3 ] 69382 7.961% 86.502% ## ( 3, 4 ] 29043 3.333% 89.835% # ( 4, 6 ] 18501 2.123% 91.958% ( 6, 10 ] 4995 0.573% 92.531% ( 10, 15 ] 1084 0.124% 92.655% ( 15, 22 ] 178 0.020% 92.676% ( 22, 34 ] 38 0.004% 92.680% ( 34, 51 ] 9 0.001% 92.681% ( 51, 76 ] 24 0.003% 92.684% ( 76, 110 ] 9445 1.084% 93.768% ( 110, 170 ] 34139 3.917% 97.685% # ( 170, 250 ] 11689 1.341% 99.026% ( 250, 380 ] 4021 0.461% 99.488% ( 380, 580 ] 3149 0.361% 99.849% ( 580, 870 ] 1086 0.125% 99.973% ( 870, 1300 ] 357 0.041% 100.014% ( 1300, 1900 ] 212 0.024% 100.039% ( 1900, 2900 ] 171 0.020% 100.058% ( 2900, 4400 ] 87 0.010% 100.068% ( 4400, 6600 ] 15 0.002% 100.070% ( 6600, 9900 ] 1 0.000% 100.070% ** Level 2 read latency histogram (micros): Count: 15229 Average: 19.3810 StdDev: 167.26 Min: 1 Median: 1.8927 Max: 7466 Percentiles: P50: 1.89 P75: 2.96 P99: 519.47 P99.9: 2418.07 P99.99: 6216.54 ------------------------------------------------------ [ 0, 1 ] 924 6.067% 6.067% # ( 1, 2 ] 7495 49.215% 55.283% ########## ( 2, 3 ] 3127 20.533% 75.816% #### ( 3, 4 ] 1369 8.989% 84.805% ## ( 4, 6 ] 1435 9.423% 94.228% ## ( 6, 10 ] 356 2.338% 96.566% ( 10, 15 ] 110 0.722% 97.288% ( 15, 22 ] 10 0.066% 97.354% ( 22, 34 ] 3 0.020% 97.373% ( 34, 51 ] 2 0.013% 97.387% ( 76, 110 ] 29 0.190% 97.577% ( 110, 170 ] 141 0.926% 98.503% ( 170, 250 ] 38 0.250% 98.752% ( 250, 380 ] 14 0.092% 98.844% ( 380, 580 ] 34 0.223% 99.068% ( 580, 870 ] 42 0.276% 99.343% ( 870, 1300 ] 46 0.302% 99.645% ( 1300, 1900 ] 31 0.204% 99.849% ( 1900, 2900 ] 15 0.098% 99.947% ( 2900, 4400 ] 4 0.026% 99.974% ( 4400, 6600 ] 3 0.020% 99.993% ( 6600, 9900 ] 1 0.007% 100.000% ** Level 3 read latency histogram (micros): Count: 104523 Average: 14.3846 StdDev: 132.77 Min: 1 Median: 1.8337 Max: 8086 Percentiles: P50: 1.83 P75: 2.86 P99: 230.70 P99.9: 1869.32 P99.99: 4080.62 ------------------------------------------------------ [ 0, 1 ] 7151 6.842% 6.842% # ( 1, 2 ] 54106 51.765% 58.606% ########## ( 2, 3 ] 20041 19.174% 77.780% #### ( 3, 4 ] 8740 8.362% 86.142% ## ( 4, 6 ] 8054 7.705% 93.847% ## ( 6, 10 ] 2785 2.664% 96.512% # ( 10, 15 ] 679 0.650% 97.161% ( 15, 22 ] 123 0.118% 97.279% ( 22, 34 ] 25 0.024% 97.303% ( 34, 51 ] 8 0.008% 97.311% ( 51, 76 ] 2 0.002% 97.313% ( 76, 110 ] 286 0.274% 97.586% ( 110, 170 ] 1172 1.121% 98.707% ( 170, 250 ] 403 0.386% 99.093% ( 250, 380 ] 227 0.217% 99.310% ( 380, 580 ] 206 0.197% 99.507% ( 580, 870 ] 174 0.166% 99.674% ( 870, 1300 ] 134 0.128% 99.802% ( 1300, 1900 ] 108 0.103% 99.905% ( 1900, 2900 ] 61 0.058% 99.964% ( 2900, 4400 ] 35 0.033% 99.997% ( 4400, 6600 ] 11 0.011% 100.008% ( 6600, 9900 ] 3 0.003% 100.011% ** Level 4 read latency histogram (micros): Count: 92868 Average: 56.5860 StdDev: 246.61 Min: 1 Median: 1.9495 Max: 8142 Percentiles: P50: 1.95 P75: 4.19 P99: 1043.67 P99.9: 3547.43 P99.99: 4848.89 ------------------------------------------------------ [ 0, 1 ] 6118 6.588% 6.588% # ( 1, 2 ] 42460 45.721% 52.309% ######### ( 2, 3 ] 14379 15.483% 67.792% ### ( 3, 4 ] 6202 6.678% 74.470% # ( 4, 6 ] 5128 5.522% 79.992% # ( 6, 10 ] 1732 1.865% 81.857% ( 10, 15 ] 394 0.424% 82.281% ( 15, 22 ] 81 0.087% 82.369% ( 22, 34 ] 24 0.026% 82.394% ( 34, 51 ] 10 0.011% 82.405% ( 51, 76 ] 3 0.003% 82.408% ( 76, 110 ] 2219 2.389% 84.798% ( 110, 170 ] 7915 8.523% 93.321% ## ( 170, 250 ] 2653 2.857% 96.177% # ( 250, 380 ] 1033 1.112% 97.290% ( 380, 580 ] 936 1.008% 98.298% ( 580, 870 ] 494 0.532% 98.830% ( 870, 1300 ] 392 0.422% 99.252% ( 1300, 1900 ] 314 0.338% 99.590% ( 1900, 2900 ] 229 0.247% 99.836% ( 2900, 4400 ] 137 0.148% 99.984% ( 4400, 6600 ] 28 0.030% 100.014% ( 6600, 9900 ] 4 0.004% 100.018% ** Level 5 read latency histogram (micros): Count: 131945 Average: 238.1372 StdDev: 413.53 Min: 73 Median: 150.4833 Max: 11022 Percentiles: P50: 150.48 P75: 207.43 P99: 2417.12 P99.9: 5500.56 P99.99: 7715.80 ------------------------------------------------------ ( 51, 76 ] 7 0.005% 0.005% ( 76, 110 ] 19629 14.877% 14.882% ### ( 110, 170 ] 68675 52.048% 66.930% ########## ( 170, 250 ] 22757 17.247% 84.177% ### ( 250, 380 ] 8129 6.161% 90.338% # ( 380, 580 ] 6638 5.031% 95.369% # ( 580, 870 ] 2559 1.939% 97.309% ( 870, 1300 ] 1042 0.790% 98.098% ( 1300, 1900 ] 750 0.568% 98.667% ( 1900, 2900 ] 850 0.644% 99.311% ( 2900, 4400 ] 668 0.506% 99.817% ( 4400, 6600 ] 218 0.165% 99.983% ( 6600, 9900 ] 29 0.022% 100.005% ( 9900, 14000 ] 2 0.002% 100.006% ** DB Stats ** Uptime(secs): 12.3 total, 7.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 159.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.801 H:M:S, 39.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 128.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.086 H:M:S, 53.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/30-19:02:20 ... thread 0: (1000000,3000000) ops and (140831.8,156133.9) ops/second in (7.100671,19.214283) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.89 GB 288.8 4.4 0.0 4.4 7.2 2.8 0.0 2.5 166.6 274.3 26.83 24.46 57 0.471 4539K 9706 0.0 0.0 L3 17/0 995.12 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.1 3.2 123.6 123.5 1.52 0.88 1 1.520 190K 67 0.0 0.0 L4 173/0 9.51 GB 1.0 1.6 1.0 0.6 1.6 1.0 0.2 1.6 116.7 116.2 14.07 7.70 10 1.407 311K 0 0.0 0.0 L5 1120/0 92.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/11 107.46 GB 0.0 6.2 1.1 5.1 9.0 3.9 3.3 3.2 148.5 216.4 42.43 33.04 68 0.624 5041K 9773 0.0 0.0 Int 0/0 0.00 KB 0.0 6.2 1.1 5.1 9.0 3.9 3.3 3.2 148.5 216.4 42.43 33.04 68 0.624 5041K 9773 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.2 1.1 5.1 6.1 1.0 0.0 0.0 194.5 193.9 32.40 25.10 23 1.409 5041K 9773 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 289.0 10.03 7.94 45 0.223 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.4 total, 19.2 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.97 GB write, 473.17 MB/s write, 6.15 GB read, 324.76 MB/s read, 42.4 seconds Interval compaction: 8.97 GB write, 477.81 MB/s write, 6.15 GB read, 327.95 MB/s read, 42.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 10, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1399908 Average: 17.5765 StdDev: 77.02 Min: 0 Median: 1.4595 Max: 6845 Percentiles: P50: 1.46 P75: 1.92 P99: 249.72 P99.9: 617.39 P99.99: 834.35 ------------------------------------------------------ [ 0, 1 ] 354301 25.309% 25.309% ##### ( 1, 2 ] 752230 53.734% 79.043% ########### ( 2, 3 ] 101950 7.283% 86.326% # ( 3, 4 ] 42513 3.037% 89.363% # ( 4, 6 ] 25816 1.844% 91.207% ( 6, 10 ] 6435 0.460% 91.666% ( 10, 15 ] 1576 0.113% 91.779% ( 15, 22 ] 251 0.018% 91.797% ( 22, 34 ] 46 0.003% 91.800% ( 34, 51 ] 11 0.001% 91.801% ( 51, 76 ] 29 0.002% 91.803% ( 76, 110 ] 17347 1.239% 93.042% ( 110, 170 ] 62627 4.474% 97.516% # ( 170, 250 ] 20852 1.490% 99.005% ( 250, 380 ] 6915 0.494% 99.499% ( 380, 580 ] 5393 0.385% 99.885% ( 580, 870 ] 1684 0.120% 100.005% ( 870, 1300 ] 463 0.033% 100.038% ( 1300, 1900 ] 242 0.017% 100.055% ( 1900, 2900 ] 192 0.014% 100.069% ( 2900, 4400 ] 103 0.007% 100.076% ( 4400, 6600 ] 15 0.001% 100.077% ( 6600, 9900 ] 1 0.000% 100.077% ** Level 2 read latency histogram (micros): Count: 15430 Average: 21.5318 StdDev: 168.30 Min: 1 Median: 1.9061 Max: 7466 Percentiles: P50: 1.91 P75: 3.02 P99: 535.22 P99.9: 2404.67 P99.99: 6201.80 ------------------------------------------------------ [ 0, 1 ] 924 5.988% 5.988% # ( 1, 2 ] 7495 48.574% 54.563% ########## ( 2, 3 ] 3127 20.266% 74.828% #### ( 3, 4 ] 1369 8.872% 83.701% ## ( 4, 6 ] 1435 9.300% 93.001% ## ( 6, 10 ] 356 2.307% 95.308% ( 10, 15 ] 110 0.713% 96.021% ( 15, 22 ] 10 0.065% 96.086% ( 22, 34 ] 3 0.019% 96.105% ( 34, 51 ] 2 0.013% 96.118% ( 76, 110 ] 65 0.421% 96.539% ( 110, 170 ] 251 1.627% 98.166% ( 170, 250 ] 64 0.415% 98.581% ( 250, 380 ] 29 0.188% 98.769% ( 380, 580 ] 46 0.298% 99.067% ( 580, 870 ] 42 0.272% 99.339% ( 870, 1300 ] 46 0.298% 99.637% ( 1300, 1900 ] 33 0.214% 99.851% ( 1900, 2900 ] 15 0.097% 99.948% ( 2900, 4400 ] 4 0.026% 99.974% ( 4400, 6600 ] 3 0.019% 99.994% ( 6600, 9900 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 106261 Average: 16.9945 StdDev: 133.89 Min: 1 Median: 1.8498 Max: 8086 Percentiles: P50: 1.85 P75: 2.92 P99: 282.04 P99.9: 1860.03 P99.99: 4073.17 ------------------------------------------------------ [ 0, 1 ] 7151 6.730% 6.730% # ( 1, 2 ] 54106 50.918% 57.648% ########## ( 2, 3 ] 20041 18.860% 76.508% #### ( 3, 4 ] 8740 8.225% 84.733% ## ( 4, 6 ] 8054 7.579% 92.312% ## ( 6, 10 ] 2785 2.621% 94.933% # ( 10, 15 ] 679 0.639% 95.572% ( 15, 22 ] 123 0.116% 95.688% ( 22, 34 ] 25 0.024% 95.712% ( 34, 51 ] 8 0.008% 95.719% ( 51, 76 ] 2 0.002% 95.721% ( 76, 110 ] 581 0.547% 96.268% ( 110, 170 ] 2110 1.986% 98.253% ( 170, 250 ] 716 0.674% 98.927% ( 250, 380 ] 314 0.295% 99.223% ( 380, 580 ] 297 0.280% 99.502% ( 580, 870 ] 186 0.175% 99.677% ( 870, 1300 ] 135 0.127% 99.804% ( 1300, 1900 ] 109 0.103% 99.907% ( 1900, 2900 ] 61 0.057% 99.964% ( 2900, 4400 ] 35 0.033% 99.997% ( 4400, 6600 ] 11 0.010% 100.008% ( 6600, 9900 ] 3 0.003% 100.010% ** Level 4 read latency histogram (micros): Count: 105620 Average: 70.4773 StdDev: 237.83 Min: 1 Median: 2.2903 Max: 8142 Percentiles: P50: 2.29 P75: 95.26 P99: 938.72 P99.9: 3425.87 P99.99: 4827.27 ------------------------------------------------------ [ 0, 1 ] 6118 5.792% 5.792% # ( 1, 2 ] 42490 40.229% 46.022% ######## ( 2, 3 ] 14476 13.706% 59.727% ### ( 3, 4 ] 6260 5.927% 65.654% # ( 4, 6 ] 5231 4.953% 70.607% # ( 6, 10 ] 1738 1.646% 72.252% ( 10, 15 ] 396 0.375% 72.627% ( 15, 22 ] 81 0.077% 72.704% ( 22, 34 ] 24 0.023% 72.727% ( 34, 51 ] 10 0.009% 72.736% ( 51, 76 ] 3 0.003% 72.739% ( 76, 110 ] 4215 3.991% 76.730% # ( 110, 170 ] 14768 13.982% 90.712% ### ( 170, 250 ] 4881 4.621% 95.333% # ( 250, 380 ] 1696 1.606% 96.939% ( 380, 580 ] 1479 1.400% 98.339% ( 580, 870 ] 631 0.597% 98.937% ( 870, 1300 ] 418 0.396% 99.333% ( 1300, 1900 ] 320 0.303% 99.635% ( 1900, 2900 ] 231 0.219% 99.854% ( 2900, 4400 ] 138 0.131% 99.985% ( 4400, 6600 ] 28 0.027% 100.011% ( 6600, 9900 ] 4 0.004% 100.015% ** Level 5 read latency histogram (micros): Count: 233770 Average: 210.4172 StdDev: 322.13 Min: 73 Median: 148.5046 Max: 11022 Percentiles: P50: 148.50 P75: 197.09 P99: 1495.21 P99.9: 4412.41 P99.99: 6535.64 ------------------------------------------------------ ( 51, 76 ] 16 0.007% 0.007% ( 76, 110 ] 36354 15.551% 15.558% ### ( 110, 170 ] 125463 53.669% 69.227% ########### ( 170, 250 ] 39858 17.050% 86.278% ### ( 250, 380 ] 13610 5.822% 92.099% # ( 380, 580 ] 10977 4.696% 96.795% # ( 580, 870 ] 3661 1.566% 98.361% ( 870, 1300 ] 1234 0.528% 98.889% ( 1300, 1900 ] 797 0.341% 99.230% ( 1900, 2900 ] 886 0.379% 99.609% ( 2900, 4400 ] 679 0.290% 99.899% ( 4400, 6600 ] 218 0.093% 99.993% ( 6600, 9900 ] 29 0.012% 100.005% ( 9900, 14000 ] 2 0.001% 100.006% ** DB Stats ** Uptime(secs): 19.4 total, 7.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 152.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.340 H:M:S, 43.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 138.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.539 H:M:S, 49.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 217.937 micros/op 18329 ops/sec 60.177 seconds 1102996 operations; 17.8 MB/s (278999 of 278999 found) Microseconds per read: Count: 1102996 Average: 217.9387 StdDev: 446.07 Min: 2 Median: 177.9461 Max: 57636 Percentiles: P50: 177.95 P75: 235.54 P99: 741.63 P99.9: 4997.64 P99.99: 21585.34 ------------------------------------------------------ ( 1, 2 ] 9 0.001% 0.001% ( 2, 3 ] 44 0.004% 0.005% ( 3, 4 ] 63 0.006% 0.011% ( 4, 6 ] 90 0.008% 0.019% ( 6, 10 ] 391 0.035% 0.054% ( 10, 15 ] 4371 0.396% 0.450% ( 15, 22 ] 3497 0.317% 0.767% ( 22, 34 ] 11372 1.031% 1.798% ( 34, 51 ] 2008 0.182% 1.981% ( 51, 76 ] 236 0.021% 2.002% ( 76, 110 ] 16674 1.512% 3.514% ( 110, 170 ] 474701 43.037% 46.551% ######### ( 170, 250 ] 383002 34.724% 81.275% ####### ( 250, 380 ] 138813 12.585% 93.860% ### ( 380, 580 ] 49276 4.467% 98.327% # ( 580, 870 ] 13311 1.207% 99.534% ( 870, 1300 ] 2827 0.256% 99.790% ( 1300, 1900 ] 427 0.039% 99.829% ( 1900, 2900 ] 400 0.036% 99.865% ( 2900, 4400 ] 290 0.026% 99.892% ( 4400, 6600 ] 335 0.030% 99.922% ( 6600, 9900 ] 337 0.031% 99.953% ( 9900, 14000 ] 205 0.019% 99.971% ( 14000, 22000 ] 218 0.020% 99.991% ( 22000, 33000 ] 84 0.008% 99.999% ( 33000, 50000 ] 14 0.001% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 20542155 rocksdb.bloom.filter.full.positive COUNT : 1303430 rocksdb.bloom.filter.full.true.positive COUNT : 1102548 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 448 rocksdb.memtable.miss COUNT : 1102548 rocksdb.l0.hit COUNT : 58925 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 1043623 rocksdb.compaction.key.drop.new COUNT : 38904 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3988426 rocksdb.number.keys.read COUNT : 1102996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4116055632 rocksdb.bytes.read COUNT : 1102996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1437 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 45177900 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 11349163075 rocksdb.compact.write.bytes COUNT : 11311432715 rocksdb.flush.write.bytes COUNT : 4095767243 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 59 rocksdb.number.superversion_acquires COUNT : 655 rocksdb.number.superversion_releases COUNT : 625 rocksdb.number.superversion_cleanups COUNT : 164 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 0 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4062525440 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1395712 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 16309232681 rocksdb.non.last.level.read.count COUNT : 3795872 rocksdb.block.checksum.compute.count COUNT : 4064971 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 176.301772 P95 : 429.149228 P99 : 740.444599 P100 : 57633.000000 COUNT : 1102996 SUM : 239329358 rocksdb.db.write.micros P50 : 1.479528 P95 : 4.346670 P99 : 12.980139 P100 : 513316.000000 COUNT : 3988426 SUM : 54791025 rocksdb.compaction.times.micros P50 : 1146875.000000 P95 : 3792500.000000 P99 : 3991460.000000 P100 : 3991460.000000 COUNT : 29 SUM : 42200674 rocksdb.compaction.times.cpu_micros P50 : 1039444.444444 P95 : 3792500.000000 P99 : 3920640.000000 P100 : 3920640.000000 COUNT : 29 SUM : 34760932 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 721.375000 P95 : 1296.928571 P99 : 19560.000000 P100 : 20187.000000 COUNT : 61 SUM : 79917 rocksdb.compaction.outfile.sync.micros P50 : 1955.555556 P95 : 92750.000000 P99 : 102765.000000 P100 : 102765.000000 COUNT : 69 SUM : 1047406 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 148.863636 P95 : 2708.333333 P99 : 6033.500000 P100 : 6422.000000 COUNT : 103 SUM : 65801 rocksdb.table.open.io.micros P50 : 6179.633867 P95 : 15425.882353 P99 : 20835.764706 P100 : 27262.000000 COUNT : 1437 SUM : 9960815 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.542796 P95 : 147.568072 P99 : 238.951628 P100 : 13899.000000 COUNT : 2748816 SUM : 63056411 rocksdb.read.block.get.micros P50 : 140.193288 P95 : 262.535068 P99 : 563.064634 P100 : 15725.000000 COUNT : 1314676 SUM : 203006823 rocksdb.write.raw.block.micros P50 : 0.541773 P95 : 1.503459 P99 : 3.637149 P100 : 13855.000000 COUNT : 3731103 SUM : 8369453 rocksdb.numfiles.in.singlecompaction P50 : 3.403226 P95 : 4.850000 P99 : 11.000000 P100 : 11.000000 COUNT : 43 SUM : 162 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.570903 P95 : 1980.142202 P99 : 2716.214935 P100 : 513153.000000 COUNT : 236813 SUM : 45194557 rocksdb.sst.read.micros P50 : 2.128065 P95 : 205.939610 P99 : 437.724509 P100 : 11022.000000 COUNT : 3795898 SUM : 251746301 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 1102996 SUM : 1102996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3988426 SUM : 4116055632 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214363.636364 P95 : 345875.000000 P99 : 742525.000000 P100 : 742525.000000 COUNT : 61 SUM : 13330385 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 110 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0