[2024-07-11 00:26:48.941232] Starting SPDK v24.01.1-pre git sha1 4b94202c6 / DPDK 23.11.0 initialization... [2024-07-11 00:26:48.941330] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid982071 ] Set seed to 1720650408938899 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-11 00:26:49.040726] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-11 00:26:49.255861] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-11 00:26:49.255907] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 982071' to capture a snapshot of events at runtime. [2024-07-11 00:26:49.255917] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid982071 for offline analysis/debug. [2024-07-11 00:26:49.255941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Jul 11 00:26:58 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/11-00:27:03 ... thread 0: (1000000,1000000) ops and (217954.2,217954.2) ops/second in (4.588120,4.588120) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.13 GB 50.4 0.3 0.0 0.3 1.1 0.8 0.0 1.4 59.9 215.6 5.26 3.59 12 0.438 319K 380 0.0 0.0 L1 7/7 818.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 18/16 2.26 GB 2.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/2 1.02 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 176/0 9.63 GB 1.0 0.9 0.5 0.4 0.9 0.5 0.0 1.8 125.2 123.1 7.49 4.36 5 1.498 0 0 0.0 0.0 L5 1100/0 90.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1339/37 106.40 GB 0.0 1.2 0.5 0.7 2.0 1.3 0.7 2.5 98.3 161.2 12.75 7.95 17 0.750 319K 380 0.0 0.0 Int 0/0 0.00 KB 0.0 1.2 0.5 0.7 2.0 1.3 0.7 2.5 98.3 161.2 12.75 7.95 17 0.750 319K 380 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.2 0.5 0.7 1.2 0.5 0.0 0.0 144.0 142.2 8.70 5.53 6 1.450 319K 380 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 202.3 4.05 2.41 11 0.368 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.8 total, 4.6 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.01 GB write, 426.21 MB/s write, 1.22 GB read, 259.82 MB/s read, 12.7 seconds Interval compaction: 2.01 GB write, 447.94 MB/s write, 1.22 GB read, 273.06 MB/s read, 12.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 339989 Average: 7.7417 StdDev: 128.99 Min: 1 Median: 1.6854 Max: 19128 Percentiles: P50: 1.69 P75: 2.33 P99: 9.19 P99.9: 1268.10 P99.99: 2403.61 ------------------------------------------------------ [ 0, 1 ] 25190 7.409% 7.409% # ( 1, 2 ] 211272 62.141% 69.550% ############ ( 2, 3 ] 56230 16.539% 86.089% ### ( 3, 4 ] 21319 6.270% 92.359% # ( 4, 6 ] 18709 5.503% 97.862% # ( 6, 10 ] 4858 1.429% 99.291% ( 10, 15 ] 877 0.258% 99.549% ( 15, 22 ] 103 0.030% 99.579% ( 22, 34 ] 14 0.004% 99.583% ( 34, 51 ] 6 0.002% 99.585% ( 51, 76 ] 2 0.001% 99.586% ( 76, 110 ] 5 0.001% 99.587% ( 110, 170 ] 47 0.014% 99.601% ( 170, 250 ] 121 0.036% 99.636% ( 250, 380 ] 161 0.047% 99.684% ( 380, 580 ] 220 0.065% 99.749% ( 580, 870 ] 280 0.082% 99.831% ( 870, 1300 ] 256 0.075% 99.906% ( 1300, 1900 ] 217 0.064% 99.970% ( 1900, 2900 ] 139 0.041% 100.011% ( 2900, 4400 ] 59 0.017% 100.028% ( 4400, 6600 ] 12 0.004% 100.032% ( 6600, 9900 ] 4 0.001% 100.033% ( 9900, 14000 ] 4 0.001% 100.034% ( 14000, 22000 ] 7 0.002% 100.036% ** Level 1 read latency histogram (micros): Count: 84 Average: 2893.8929 StdDev: 5035.95 Min: 99 Median: 734.6667 Max: 20571 Percentiles: P50: 734.67 P75: 1675.00 P99: 20571.00 P99.9: 20571.00 P99.99: 20571.00 ------------------------------------------------------ ( 76, 110 ] 2 2.381% 2.381% ( 110, 170 ] 1 1.190% 3.571% ( 170, 250 ] 5 5.952% 9.524% # ( 250, 380 ] 11 13.095% 22.619% ### ( 380, 580 ] 15 17.857% 40.476% #### ( 580, 870 ] 15 17.857% 58.333% #### ( 870, 1300 ] 9 10.714% 69.048% ## ( 1300, 1900 ] 8 9.524% 78.571% ## ( 1900, 2900 ] 3 3.571% 82.143% # ( 2900, 4400 ] 1 1.190% 83.333% ( 4400, 6600 ] 2 2.381% 85.714% ( 6600, 9900 ] 2 2.381% 88.095% ( 9900, 14000 ] 2 2.381% 90.476% ( 14000, 22000 ] 8 9.524% 100.000% ## ** Level 2 read latency histogram (micros): Count: 254522 Average: 9.9950 StdDev: 115.29 Min: 1 Median: 1.8395 Max: 16925 Percentiles: P50: 1.84 P75: 2.75 P99: 13.09 P99.9: 1523.94 P99.99: 2179.15 ------------------------------------------------------ [ 0, 1 ] 10419 4.094% 4.094% # ( 1, 2 ] 139178 54.682% 58.776% ########### ( 2, 3 ] 54911 21.574% 80.350% #### ( 3, 4 ] 20502 8.055% 88.405% ## ( 4, 6 ] 19264 7.569% 95.974% ## ( 6, 10 ] 6739 2.648% 98.621% # ( 10, 15 ] 1562 0.614% 99.235% ( 15, 22 ] 361 0.142% 99.377% ( 22, 34 ] 41 0.016% 99.393% ( 34, 51 ] 6 0.002% 99.395% ( 51, 76 ] 3 0.001% 99.397% ( 76, 110 ] 3 0.001% 99.398% ( 110, 170 ] 50 0.020% 99.417% ( 170, 250 ] 91 0.036% 99.453% ( 250, 380 ] 160 0.063% 99.516% ( 380, 580 ] 187 0.073% 99.589% ( 580, 870 ] 330 0.130% 99.719% ( 870, 1300 ] 350 0.138% 99.857% ( 1300, 1900 ] 296 0.116% 99.973% ( 1900, 2900 ] 156 0.061% 100.034% ( 2900, 4400 ] 42 0.017% 100.051% ( 4400, 6600 ] 10 0.004% 100.055% ( 6600, 9900 ] 1 0.000% 100.055% ( 9900, 14000 ] 1 0.000% 100.055% ( 14000, 22000 ] 1 0.000% 100.056% ** Level 3 read latency histogram (micros): Count: 42961 Average: 15.7394 StdDev: 153.46 Min: 1 Median: 1.8315 Max: 5026 Percentiles: P50: 1.83 P75: 2.80 P99: 261.65 P99.9: 2567.32 P99.99: 4068.99 ------------------------------------------------------ [ 0, 1 ] 2265 5.272% 5.272% # ( 1, 2 ] 23109 53.791% 59.063% ########### ( 2, 3 ] 8564 19.934% 78.997% #### ( 3, 4 ] 3466 8.068% 87.065% ## ( 4, 6 ] 3477 8.093% 95.158% ## ( 6, 10 ] 1249 2.907% 98.066% # ( 10, 15 ] 280 0.652% 98.717% ( 15, 22 ] 60 0.140% 98.857% ( 22, 34 ] 14 0.033% 98.890% ( 34, 51 ] 2 0.005% 98.894% ( 51, 76 ] 1 0.002% 98.897% ( 76, 110 ] 2 0.005% 98.901% ( 110, 170 ] 13 0.030% 98.932% ( 170, 250 ] 25 0.058% 98.990% ( 250, 380 ] 49 0.114% 99.104% ( 380, 580 ] 65 0.151% 99.255% ( 580, 870 ] 68 0.158% 99.413% ( 870, 1300 ] 92 0.214% 99.628% ( 1300, 1900 ] 77 0.179% 99.807% ( 1900, 2900 ] 60 0.140% 99.946% ( 2900, 4400 ] 24 0.056% 100.002% ( 4400, 6600 ] 2 0.005% 100.007% ** Level 4 read latency histogram (micros): Count: 77329 Average: 37.3894 StdDev: 279.57 Min: 1 Median: 1.7803 Max: 8381 Percentiles: P50: 1.78 P75: 2.78 P99: 1385.24 P99.9: 3840.44 P99.99: 5284.47 ------------------------------------------------------ [ 0, 1 ] 5289 6.840% 6.840% # ( 1, 2 ] 42775 55.316% 62.155% ########### ( 2, 3 ] 12808 16.563% 78.718% ### ( 3, 4 ] 6149 7.952% 86.670% ## ( 4, 6 ] 5976 7.728% 94.398% ## ( 6, 10 ] 1873 2.422% 96.820% ( 10, 15 ] 513 0.663% 97.483% ( 15, 22 ] 65 0.084% 97.568% ( 22, 34 ] 13 0.017% 97.584% ( 34, 51 ] 2 0.003% 97.587% ( 51, 76 ] 1 0.001% 97.588% ( 76, 110 ] 6 0.008% 97.596% ( 110, 170 ] 41 0.053% 97.649% ( 170, 250 ] 107 0.138% 97.787% ( 250, 380 ] 105 0.136% 97.923% ( 380, 580 ] 203 0.263% 98.186% ( 580, 870 ] 242 0.313% 98.499% ( 870, 1300 ] 336 0.435% 98.933% ( 1300, 1900 ] 364 0.471% 99.404% ( 1900, 2900 ] 289 0.374% 99.778% ( 2900, 4400 ] 151 0.195% 99.973% ( 4400, 6600 ] 33 0.043% 100.016% ( 6600, 9900 ] 5 0.006% 100.022% ** Level 5 read latency histogram (micros): Count: 9039 Average: 1392.6284 StdDev: 1362.55 Min: 84 Median: 873.5885 Max: 10842 Percentiles: P50: 873.59 P75: 1845.22 P99: 6290.38 P99.9: 9188.26 P99.99: 10842.00 ------------------------------------------------------ ( 76, 110 ] 43 0.476% 0.476% ( 110, 170 ] 285 3.153% 3.629% # ( 170, 250 ] 592 6.549% 10.178% # ( 250, 380 ] 940 10.399% 20.577% ## ( 380, 580 ] 1193 13.198% 33.776% ### ( 580, 870 ] 1455 16.097% 49.873% ### ( 870, 1300 ] 1378 15.245% 65.118% ### ( 1300, 1900 ] 983 10.875% 75.993% ## ( 1900, 2900 ] 842 9.315% 85.308% ## ( 2900, 4400 ] 875 9.680% 94.988% ## ( 4400, 6600 ] 422 4.669% 99.657% # ( 6600, 9900 ] 28 0.310% 99.967% ( 9900, 14000 ] 3 0.033% 100.000% ** DB Stats ** Uptime(secs): 4.8 total, 4.6 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 204.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.045 H:M:S, 21.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 214.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.045 H:M:S, 22.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/11-00:27:09 ... thread 0: (1000000,2000000) ops and (152936.0,179746.2) ops/second in (6.538681,11.126801) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.17 GB 163.6 1.5 0.0 1.5 3.3 1.8 0.0 1.8 94.2 211.7 16.06 11.72 31 0.518 1535K 1672 0.0 0.0 L1 7/7 818.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 987.53 MB 1.0 2.3 2.1 0.1 2.3 2.1 0.1 1.1 156.5 155.9 14.91 10.98 3 4.970 686K 0 0.0 0.0 L4 186/0 9.59 GB 1.0 3.7 2.8 0.9 3.6 2.8 0.0 1.3 117.2 116.3 32.06 20.26 27 1.187 2346K 865 0.0 0.0 L5 1128/0 92.89 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1358/19 107.42 GB 0.0 7.4 4.9 2.5 9.2 6.7 3.1 5.0 120.6 150.0 63.02 42.96 61 1.033 4568K 2537 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 4.9 2.5 9.2 6.7 3.1 5.0 120.6 150.0 63.02 42.96 61 1.033 4568K 2537 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 4.9 2.5 7.4 4.9 0.0 0.0 141.6 140.8 53.69 37.39 35 1.534 4568K 2537 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 202.6 9.33 5.56 26 0.359 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.4 total, 11.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.23 GB write, 831.88 MB/s write, 7.42 GB read, 669.01 MB/s read, 63.0 seconds Interval compaction: 9.23 GB write, 849.37 MB/s write, 7.42 GB read, 683.08 MB/s read, 63.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 18, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 690348 Average: 17.0276 StdDev: 261.60 Min: 1 Median: 1.6919 Max: 49058 Percentiles: P50: 1.69 P75: 2.41 P99: 332.92 P99.9: 1678.06 P99.99: 3285.38 ------------------------------------------------------ [ 0, 1 ] 59182 8.573% 8.573% ## ( 1, 2 ] 413336 59.874% 68.446% ############ ( 2, 3 ] 110704 16.036% 84.482% ### ( 3, 4 ] 42622 6.174% 90.656% # ( 4, 6 ] 38053 5.512% 96.168% # ( 6, 10 ] 8115 1.175% 97.344% ( 10, 15 ] 1515 0.219% 97.563% ( 15, 22 ] 197 0.029% 97.592% ( 22, 34 ] 28 0.004% 97.596% ( 34, 51 ] 8 0.001% 97.597% ( 51, 76 ] 6 0.001% 97.598% ( 76, 110 ] 324 0.047% 97.645% ( 110, 170 ] 3771 0.546% 98.191% ( 170, 250 ] 4029 0.584% 98.775% ( 250, 380 ] 2437 0.353% 99.128% ( 380, 580 ] 2282 0.331% 99.458% ( 580, 870 ] 1690 0.245% 99.703% ( 870, 1300 ] 1031 0.149% 99.853% ( 1300, 1900 ] 520 0.075% 99.928% ( 1900, 2900 ] 356 0.052% 99.979% ( 2900, 4400 ] 284 0.041% 100.021% ( 4400, 6600 ] 88 0.013% 100.033% ( 6600, 9900 ] 43 0.006% 100.040% ( 9900, 14000 ] 11 0.002% 100.041% ( 14000, 22000 ] 19 0.003% 100.044% ( 22000, 33000 ] 12 0.002% 100.046% ( 33000, 50000 ] 9 0.001% 100.047% ** Level 1 read latency histogram (micros): Count: 429 Average: 935.3403 StdDev: 2493.98 Min: 99 Median: 334.1667 Max: 20571 Percentiles: P50: 334.17 P75: 666.74 P99: 17710.00 P99.9: 20571.00 P99.99: 20571.00 ------------------------------------------------------ ( 76, 110 ] 6 1.399% 1.399% ( 110, 170 ] 77 17.949% 19.347% #### ( 170, 250 ] 81 18.881% 38.228% #### ( 250, 380 ] 78 18.182% 56.410% #### ( 380, 580 ] 63 14.685% 71.096% ### ( 580, 870 ] 56 13.054% 84.149% ### ( 870, 1300 ] 26 6.061% 90.210% # ( 1300, 1900 ] 14 3.263% 93.473% # ( 1900, 2900 ] 8 1.865% 95.338% ( 2900, 4400 ] 4 0.932% 96.270% ( 4400, 6600 ] 3 0.699% 96.970% ( 6600, 9900 ] 3 0.699% 97.669% ( 9900, 14000 ] 2 0.466% 98.135% ( 14000, 22000 ] 8 1.865% 100.000% ** Level 2 read latency histogram (micros): Count: 523380 Average: 8.8554 StdDev: 177.75 Min: 1 Median: 1.8202 Max: 53058 Percentiles: P50: 1.82 P75: 2.70 P99: 11.30 P99.9: 1267.58 P99.99: 2306.13 ------------------------------------------------------ [ 0, 1 ] 20233 3.866% 3.866% # ( 1, 2 ] 294405 56.251% 60.117% ########### ( 2, 3 ] 111486 21.301% 81.418% #### ( 3, 4 ] 40788 7.793% 89.211% ## ( 4, 6 ] 38106 7.281% 96.492% # ( 6, 10 ] 12409 2.371% 98.863% ( 10, 15 ] 2767 0.529% 99.391% ( 15, 22 ] 461 0.088% 99.479% ( 22, 34 ] 55 0.011% 99.490% ( 34, 51 ] 20 0.004% 99.494% ( 51, 76 ] 19 0.004% 99.497% ( 76, 110 ] 17 0.003% 99.501% ( 110, 170 ] 182 0.035% 99.535% ( 170, 250 ] 325 0.062% 99.597% ( 250, 380 ] 343 0.066% 99.663% ( 380, 580 ] 351 0.067% 99.730% ( 580, 870 ] 468 0.089% 99.819% ( 870, 1300 ] 456 0.087% 99.907% ( 1300, 1900 ] 353 0.067% 99.974% ( 1900, 2900 ] 206 0.039% 100.013% ( 2900, 4400 ] 105 0.020% 100.033% ( 4400, 6600 ] 36 0.007% 100.040% ( 6600, 9900 ] 6 0.001% 100.041% ( 9900, 14000 ] 4 0.001% 100.042% ( 14000, 22000 ] 6 0.001% 100.043% ( 22000, 33000 ] 4 0.001% 100.044% ( 50000, 75000 ] 2 0.000% 100.045% ** Level 3 read latency histogram (micros): Count: 626662 Average: 11.8921 StdDev: 338.97 Min: 1 Median: 1.9103 Max: 81838 Percentiles: P50: 1.91 P75: 2.88 P99: 9.21 P99.9: 293.51 P99.99: 674.74 ------------------------------------------------------ [ 0, 1 ] 16779 2.678% 2.678% # ( 1, 2 ] 325761 51.984% 54.661% ########## ( 2, 3 ] 144679 23.087% 77.748% ##### ( 3, 4 ] 62334 9.947% 87.695% ## ( 4, 6 ] 62312 9.943% 97.639% ## ( 6, 10 ] 10630 1.696% 99.335% ( 10, 15 ] 2486 0.397% 99.732% ( 15, 22 ] 296 0.047% 99.779% ( 22, 34 ] 39 0.006% 99.785% ( 34, 51 ] 57 0.009% 99.794% ( 51, 76 ] 61 0.010% 99.804% ( 76, 110 ] 33 0.005% 99.809% ( 110, 170 ] 184 0.029% 99.839% ( 170, 250 ] 303 0.048% 99.887% ( 250, 380 ] 243 0.039% 99.926% ( 380, 580 ] 304 0.049% 99.974% ( 580, 870 ] 301 0.048% 100.022% ( 870, 1300 ] 276 0.044% 100.066% ( 1300, 1900 ] 170 0.027% 100.094% ( 1900, 2900 ] 168 0.027% 100.120% ( 2900, 4400 ] 177 0.028% 100.149% ( 4400, 6600 ] 68 0.011% 100.159% ( 6600, 9900 ] 197 0.031% 100.191% ( 9900, 14000 ] 17 0.003% 100.194% ( 14000, 22000 ] 24 0.004% 100.197% ( 22000, 33000 ] 23 0.004% 100.201% ( 33000, 50000 ] 10 0.002% 100.203% ( 50000, 75000 ] 1 0.000% 100.203% ( 75000, 110000 ] 2 0.000% 100.203% ** Level 4 read latency histogram (micros): Count: 198903 Average: 41.0931 StdDev: 483.11 Min: 1 Median: 1.8726 Max: 61862 Percentiles: P50: 1.87 P75: 2.91 P99: 1006.18 P99.9: 3706.97 P99.99: 5850.54 ------------------------------------------------------ [ 0, 1 ] 8344 4.195% 4.195% # ( 1, 2 ] 104411 52.493% 56.688% ########## ( 2, 3 ] 39995 20.108% 76.796% #### ( 3, 4 ] 16820 8.456% 85.253% ## ( 4, 6 ] 15920 8.004% 93.257% ## ( 6, 10 ] 4126 2.074% 95.331% ( 10, 15 ] 1166 0.586% 95.917% ( 15, 22 ] 133 0.067% 95.984% ( 22, 34 ] 21 0.011% 95.995% ( 34, 51 ] 8 0.004% 95.999% ( 51, 76 ] 6 0.003% 96.002% ( 76, 110 ] 94 0.047% 96.049% ( 110, 170 ] 1061 0.533% 96.582% ( 170, 250 ] 1366 0.687% 97.269% ( 250, 380 ] 999 0.502% 97.771% ( 380, 580 ] 1136 0.571% 98.342% ( 580, 870 ] 1028 0.517% 98.859% ( 870, 1300 ] 884 0.444% 99.304% ( 1300, 1900 ] 585 0.294% 99.598% ( 1900, 2900 ] 451 0.227% 99.825% ( 2900, 4400 ] 279 0.140% 99.965% ( 4400, 6600 ] 76 0.038% 100.003% ( 6600, 9900 ] 30 0.015% 100.018% ( 9900, 14000 ] 6 0.003% 100.021% ( 14000, 22000 ] 10 0.005% 100.026% ( 22000, 33000 ] 21 0.011% 100.037% ( 33000, 50000 ] 3 0.002% 100.038% ( 50000, 75000 ] 3 0.002% 100.040% ** Level 5 read latency histogram (micros): Count: 44391 Average: 695.6624 StdDev: 1539.15 Min: 84 Median: 314.5901 Max: 61014 Percentiles: P50: 314.59 P75: 695.32 P99: 5444.02 P99.9: 23654.13 P99.99: 56503.75 ------------------------------------------------------ ( 76, 110 ] 796 1.793% 1.793% ( 110, 170 ] 8595 19.362% 21.155% #### ( 170, 250 ] 9653 21.745% 42.901% #### ( 250, 380 ] 6343 14.289% 57.190% ### ( 380, 580 ] 6023 13.568% 70.758% ### ( 580, 870 ] 4736 10.669% 81.426% ## ( 870, 1300 ] 3183 7.170% 88.597% # ( 1300, 1900 ] 1676 3.776% 92.372% # ( 1900, 2900 ] 1338 3.014% 95.386% # ( 2900, 4400 ] 1354 3.050% 98.437% # ( 4400, 6600 ] 527 1.187% 99.624% ( 6600, 9900 ] 86 0.194% 99.818% ( 9900, 14000 ] 18 0.041% 99.858% ( 14000, 22000 ] 15 0.034% 99.892% ( 22000, 33000 ] 24 0.054% 99.946% ( 33000, 50000 ] 18 0.041% 99.986% ( 50000, 75000 ] 6 0.014% 100.000% ** DB Stats ** Uptime(secs): 11.4 total, 6.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 173.23 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.723 H:M:S, 32.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 150.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.678 H:M:S, 41.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/11-00:27:16 ... thread 0: (1000000,3000000) ops and (156236.3,171161.0) ops/second in (6.400561,17.527362) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 4.09 GB 257.8 3.3 0.0 3.3 6.0 2.8 0.0 2.2 129.7 239.6 25.74 20.84 51 0.505 3389K 5169 0.0 0.0 L1 7/7 818.36 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/0 987.53 MB 1.0 2.3 2.1 0.1 2.3 2.1 0.1 1.1 156.5 155.9 14.91 10.98 3 4.970 686K 0 0.0 0.0 L4 186/0 9.59 GB 1.0 3.7 2.8 0.9 3.6 2.8 0.0 1.3 117.2 116.3 32.06 20.26 27 1.187 2346K 865 0.0 0.0 L5 1128/0 92.89 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1358/19 108.34 GB 0.0 9.2 4.9 4.3 11.9 7.7 3.1 4.3 129.7 168.1 72.71 52.08 81 0.898 6422K 6034 0.0 0.0 Int 0/0 0.00 KB 0.0 9.2 4.9 4.3 11.9 7.7 3.1 4.3 129.7 168.1 72.71 52.08 81 0.898 6422K 6034 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.2 4.9 4.3 9.2 4.9 0.0 0.0 155.8 155.1 60.50 44.09 40 1.513 6422K 6034 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 232.2 12.21 8.00 41 0.298 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.8 total, 17.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.93 GB write, 687.94 MB/s write, 9.21 GB read, 530.76 MB/s read, 72.7 seconds Interval compaction: 11.93 GB write, 697.12 MB/s write, 9.21 GB read, 537.84 MB/s read, 72.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 18, interval: 35 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1166121 Average: 18.1787 StdDev: 206.03 Min: 1 Median: 1.6072 Max: 49058 Percentiles: P50: 1.61 P75: 2.14 P99: 311.72 P99.9: 1121.75 P99.99: 2003.47 ------------------------------------------------------ [ 0, 1 ] 163984 14.062% 14.062% ### ( 1, 2 ] 690146 59.183% 73.245% ############ ( 2, 3 ] 142032 12.180% 85.425% ## ( 3, 4 ] 54068 4.637% 90.062% # ( 4, 6 ] 45393 3.893% 93.954% # ( 6, 10 ] 9199 0.789% 94.743% ( 10, 15 ] 1751 0.150% 94.893% ( 15, 22 ] 234 0.020% 94.914% ( 22, 34 ] 32 0.003% 94.916% ( 34, 51 ] 10 0.001% 94.917% ( 51, 76 ] 7 0.001% 94.918% ( 76, 110 ] 2224 0.191% 95.108% ( 110, 170 ] 24698 2.118% 97.226% ( 170, 250 ] 17963 1.540% 98.767% ( 250, 380 ] 5729 0.491% 99.258% ( 380, 580 ] 4442 0.381% 99.639% ( 580, 870 ] 2370 0.203% 99.842% ( 870, 1300 ] 1151 0.099% 99.941% ( 1300, 1900 ] 534 0.046% 99.987% ( 1900, 2900 ] 371 0.032% 100.019% ( 2900, 4400 ] 291 0.025% 100.044% ( 4400, 6600 ] 88 0.008% 100.051% ( 6600, 9900 ] 43 0.004% 100.055% ( 9900, 14000 ] 11 0.001% 100.056% ( 14000, 22000 ] 19 0.002% 100.057% ( 22000, 33000 ] 12 0.001% 100.058% ( 33000, 50000 ] 9 0.001% 100.059% ** Level 1 read latency histogram (micros): Count: 1287 Average: 444.8982 StdDev: 1483.88 Min: 91 Median: 194.6070 Max: 20571 Percentiles: P50: 194.61 P75: 312.86 P99: 6743.00 P99.9: 20571.00 P99.99: 20571.00 ------------------------------------------------------ ( 76, 110 ] 42 3.263% 3.263% # ( 110, 170 ] 488 37.918% 41.181% ######## ( 170, 250 ] 369 28.671% 69.852% ###### ( 250, 380 ] 137 10.645% 80.497% ## ( 380, 580 ] 113 8.780% 89.277% ## ( 580, 870 ] 67 5.206% 94.483% # ( 870, 1300 ] 29 2.253% 96.737% ( 1300, 1900 ] 14 1.088% 97.824% ( 1900, 2900 ] 8 0.622% 98.446% ( 2900, 4400 ] 4 0.311% 98.757% ( 4400, 6600 ] 3 0.233% 98.990% ( 6600, 9900 ] 3 0.233% 99.223% ( 9900, 14000 ] 2 0.155% 99.378% ( 14000, 22000 ] 8 0.622% 100.000% ** Level 2 read latency histogram (micros): Count: 523380 Average: 8.8554 StdDev: 177.75 Min: 1 Median: 1.8202 Max: 53058 Percentiles: P50: 1.82 P75: 2.70 P99: 11.30 P99.9: 1267.58 P99.99: 2306.13 ------------------------------------------------------ [ 0, 1 ] 20233 3.866% 3.866% # ( 1, 2 ] 294405 56.251% 60.117% ########### ( 2, 3 ] 111486 21.301% 81.418% #### ( 3, 4 ] 40788 7.793% 89.211% ## ( 4, 6 ] 38106 7.281% 96.492% # ( 6, 10 ] 12409 2.371% 98.863% ( 10, 15 ] 2767 0.529% 99.391% ( 15, 22 ] 461 0.088% 99.479% ( 22, 34 ] 55 0.011% 99.490% ( 34, 51 ] 20 0.004% 99.494% ( 51, 76 ] 19 0.004% 99.497% ( 76, 110 ] 17 0.003% 99.501% ( 110, 170 ] 182 0.035% 99.535% ( 170, 250 ] 325 0.062% 99.597% ( 250, 380 ] 343 0.066% 99.663% ( 380, 580 ] 351 0.067% 99.730% ( 580, 870 ] 468 0.089% 99.819% ( 870, 1300 ] 456 0.087% 99.907% ( 1300, 1900 ] 353 0.067% 99.974% ( 1900, 2900 ] 206 0.039% 100.013% ( 2900, 4400 ] 105 0.020% 100.033% ( 4400, 6600 ] 36 0.007% 100.040% ( 6600, 9900 ] 6 0.001% 100.041% ( 9900, 14000 ] 4 0.001% 100.042% ( 14000, 22000 ] 6 0.001% 100.043% ( 22000, 33000 ] 4 0.001% 100.044% ( 50000, 75000 ] 2 0.000% 100.045% ** Level 3 read latency histogram (micros): Count: 627950 Average: 12.2756 StdDev: 338.77 Min: 1 Median: 1.9123 Max: 81838 Percentiles: P50: 1.91 P75: 2.89 P99: 9.69 P99.9: 350.96 P99.99: 691.72 ------------------------------------------------------ [ 0, 1 ] 16779 2.672% 2.672% # ( 1, 2 ] 325761 51.877% 54.549% ########## ( 2, 3 ] 144679 23.040% 77.589% ##### ( 3, 4 ] 62334 9.927% 87.515% ## ( 4, 6 ] 62312 9.923% 97.438% ## ( 6, 10 ] 10630 1.693% 99.131% ( 10, 15 ] 2486 0.396% 99.527% ( 15, 22 ] 296 0.047% 99.574% ( 22, 34 ] 39 0.006% 99.581% ( 34, 51 ] 57 0.009% 99.590% ( 51, 76 ] 61 0.010% 99.599% ( 76, 110 ] 81 0.013% 99.612% ( 110, 170 ] 820 0.131% 99.743% ( 170, 250 ] 730 0.116% 99.859% ( 250, 380 ] 331 0.053% 99.912% ( 380, 580 ] 366 0.058% 99.970% ( 580, 870 ] 325 0.052% 100.022% ( 870, 1300 ] 279 0.044% 100.066% ( 1300, 1900 ] 170 0.027% 100.093% ( 1900, 2900 ] 168 0.027% 100.120% ( 2900, 4400 ] 177 0.028% 100.148% ( 4400, 6600 ] 68 0.011% 100.159% ( 6600, 9900 ] 197 0.031% 100.190% ( 9900, 14000 ] 17 0.003% 100.193% ( 14000, 22000 ] 24 0.004% 100.197% ( 22000, 33000 ] 23 0.004% 100.201% ( 33000, 50000 ] 10 0.002% 100.202% ( 50000, 75000 ] 1 0.000% 100.202% ( 75000, 110000 ] 2 0.000% 100.203% ** Level 4 read latency histogram (micros): Count: 210847 Average: 48.2524 StdDev: 471.22 Min: 1 Median: 1.9289 Max: 61862 Percentiles: P50: 1.93 P75: 3.27 P99: 962.70 P99.9: 3642.76 P99.99: 5815.97 ------------------------------------------------------ [ 0, 1 ] 8344 3.957% 3.957% # ( 1, 2 ] 104515 49.569% 53.526% ########## ( 2, 3 ] 40563 19.238% 72.765% #### ( 3, 4 ] 17206 8.160% 80.925% ## ( 4, 6 ] 16658 7.901% 88.826% ## ( 6, 10 ] 4215 1.999% 90.825% ( 10, 15 ] 1189 0.564% 91.389% ( 15, 22 ] 137 0.065% 91.454% ( 22, 34 ] 21 0.010% 91.463% ( 34, 51 ] 8 0.004% 91.467% ( 51, 76 ] 6 0.003% 91.470% ( 76, 110 ] 537 0.255% 91.725% ( 110, 170 ] 6009 2.850% 94.575% # ( 170, 250 ] 4536 2.151% 96.726% ( 250, 380 ] 1785 0.847% 97.573% ( 380, 580 ] 1648 0.782% 98.354% ( 580, 870 ] 1166 0.553% 98.907% ( 870, 1300 ] 907 0.430% 99.337% ( 1300, 1900 ] 591 0.280% 99.618% ( 1900, 2900 ] 457 0.217% 99.834% ( 2900, 4400 ] 279 0.132% 99.967% ( 4400, 6600 ] 76 0.036% 100.003% ( 6600, 9900 ] 30 0.014% 100.017% ( 9900, 14000 ] 6 0.003% 100.020% ( 14000, 22000 ] 10 0.005% 100.025% ( 22000, 33000 ] 21 0.010% 100.035% ( 33000, 50000 ] 3 0.001% 100.036% ( 50000, 75000 ] 3 0.001% 100.037% ** Level 5 read latency histogram (micros): Count: 124988 Average: 374.9811 StdDev: 952.56 Min: 81 Median: 192.4389 Max: 61014 Percentiles: P50: 192.44 P75: 309.97 P99: 3785.33 P99.9: 8173.68 P99.99: 42917.71 ------------------------------------------------------ ( 76, 110 ] 4355 3.484% 3.484% # ( 110, 170 ] 48194 38.559% 42.043% ######## ( 170, 250 ] 35458 28.369% 70.412% ###### ( 250, 380 ] 12431 9.946% 80.358% ## ( 380, 580 ] 10151 8.122% 88.480% ## ( 580, 870 ] 5940 4.752% 93.232% # ( 870, 1300 ] 3341 2.673% 95.905% # ( 1300, 1900 ] 1705 1.364% 97.269% ( 1900, 2900 ] 1362 1.090% 98.359% ( 2900, 4400 ] 1359 1.087% 99.446% ( 4400, 6600 ] 527 0.422% 99.868% ( 6600, 9900 ] 86 0.069% 99.937% ( 9900, 14000 ] 18 0.014% 99.951% ( 14000, 22000 ] 15 0.012% 99.963% ( 22000, 33000 ] 24 0.019% 99.982% ( 33000, 50000 ] 18 0.014% 99.997% ( 50000, 75000 ] 6 0.005% 100.002% ** DB Stats ** Uptime(secs): 17.8 total, 6.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 166.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.618 H:M:S, 37.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 153.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.895 H:M:S, 45.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 245.069 micros/op 16315 ops/sec 60.127 seconds 980996 operations; 15.8 MB/s (240999 of 240999 found) Microseconds per read: Count: 980996 Average: 245.0704 StdDev: 672.53 Min: 2 Median: 193.4693 Max: 81885 Percentiles: P50: 193.47 P75: 239.60 P99: 929.37 P99.9: 9859.79 P99.99: 29761.15 ------------------------------------------------------ ( 1, 2 ] 6 0.001% 0.001% ( 2, 3 ] 37 0.004% 0.004% ( 3, 4 ] 92 0.009% 0.014% ( 4, 6 ] 91 0.009% 0.023% ( 6, 10 ] 411 0.042% 0.065% ( 10, 15 ] 6437 0.656% 0.721% ( 15, 22 ] 5736 0.585% 1.306% ( 22, 34 ] 7973 0.813% 2.119% ( 34, 51 ] 2479 0.253% 2.371% ( 51, 76 ] 288 0.029% 2.401% ( 76, 110 ] 4867 0.496% 2.897% ( 110, 170 ] 337318 34.385% 37.282% ####### ( 170, 250 ] 425281 43.352% 80.634% ######### ( 250, 380 ] 112810 11.500% 92.134% ## ( 380, 580 ] 50528 5.151% 97.284% # ( 580, 870 ] 16097 1.641% 98.925% ( 870, 1300 ] 5324 0.543% 99.468% ( 1300, 1900 ] 1715 0.175% 99.643% ( 1900, 2900 ] 1063 0.108% 99.751% ( 2900, 4400 ] 759 0.077% 99.828% ( 4400, 6600 ] 298 0.030% 99.859% ( 6600, 9900 ] 410 0.042% 99.901% ( 9900, 14000 ] 465 0.047% 99.948% ( 14000, 22000 ] 324 0.033% 99.981% ( 22000, 33000 ] 126 0.013% 99.994% ( 33000, 50000 ] 44 0.004% 99.998% ( 50000, 75000 ] 15 0.002% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 16089346 rocksdb.bloom.filter.full.positive COUNT : 1137158 rocksdb.bloom.filter.full.true.positive COUNT : 980601 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 395 rocksdb.memtable.miss COUNT : 980601 rocksdb.l0.hit COUNT : 40733 rocksdb.l1.hit COUNT : 13919 rocksdb.l2andup.hit COUNT : 925949 rocksdb.compaction.key.drop.new COUNT : 83437 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 3943893 rocksdb.number.keys.read COUNT : 980996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 4070097576 rocksdb.bytes.read COUNT : 980996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1528 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 44555147 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 14912460297 rocksdb.compact.write.bytes COUNT : 14824382954 rocksdb.flush.write.bytes COUNT : 4029619411 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 704 rocksdb.number.superversion_releases COUNT : 682 rocksdb.number.superversion_cleanups COUNT : 175 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 163 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 3996989440 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1430528 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 19483290828 rocksdb.non.last.level.read.count COUNT : 4561336 rocksdb.block.checksum.compute.count COUNT : 4760026 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 192.494875 P95 : 490.105759 P99 : 927.379796 P100 : 81884.000000 COUNT : 980996 SUM : 239652279 rocksdb.db.write.micros P50 : 1.555473 P95 : 5.238660 P99 : 15.079550 P100 : 826490.000000 COUNT : 3943893 SUM : 54835886 rocksdb.compaction.times.micros P50 : 1241176.470588 P95 : 5840000.000000 P99 : 37856306.000000 P100 : 37856306.000000 COUNT : 46 SUM : 105163168 rocksdb.compaction.times.cpu_micros P50 : 945000.000000 P95 : 5070000.000000 P99 : 15852762.000000 P100 : 15852762.000000 COUNT : 46 SUM : 66634355 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 884.333333 P95 : 7095.000000 P99 : 14328.000000 P100 : 14328.000000 COUNT : 57 SUM : 99753 rocksdb.compaction.outfile.sync.micros P50 : 2366.666667 P95 : 21200.000000 P99 : 32156.666667 P100 : 34945.000000 COUNT : 146 SUM : 747375 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 185.714286 P95 : 2681.250000 P99 : 4325.000000 P100 : 4965.000000 COUNT : 115 SUM : 64514 rocksdb.table.open.io.micros P50 : 8235.849057 P95 : 17559.183673 P99 : 27686.153846 P100 : 52008.000000 COUNT : 1528 SUM : 12967930 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.846639 P95 : 120.405274 P99 : 236.658201 P100 : 78143.000000 COUNT : 3610984 SUM : 70349172 rocksdb.read.block.get.micros P50 : 152.710909 P95 : 336.821863 P99 : 832.850243 P100 : 81844.000000 COUNT : 1147489 SUM : 209793640 rocksdb.write.raw.block.micros P50 : 0.546803 P95 : 1.530238 P99 : 3.511117 P100 : 72612.000000 COUNT : 4566419 SUM : 15109590 rocksdb.numfiles.in.singlecompaction P50 : 3.076923 P95 : 8.200000 P99 : 27.040000 P100 : 32.000000 COUNT : 58 SUM : 233 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.575990 P95 : 1237.009781 P99 : 2624.972620 P100 : 826317.000000 COUNT : 239356 SUM : 44580979 rocksdb.sst.read.micros P50 : 2.359458 P95 : 219.946429 P99 : 478.814615 P100 : 81838.000000 COUNT : 4561361 SUM : 266249775 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 980996 SUM : 980996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 3943893 SUM : 4070097576 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 223023.255814 P95 : 591750.000000 P99 : 1006200.000000 P100 : 1135621.000000 COUNT : 57 SUM : 15428727 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 164 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0