Static resource requests sometimes lead to job failure. #4
Description
Static resource requests sometimes lead to job failure. The static resource requests are also a source of inefficiency with respect to HPC resources. Include dynamic resource requests for some rules of each pipeline. e.g. alignment, trimming, etc. Some rules this won't be too impactful. Tests should be done for each rule to determine a function for optimal resource requests based on file size, etc. Start with time. Assess thread and and RAM requests at some point.