One of my dissertation papers is going to involve a GWAS. I have never actually run a GWAS before, and do not know how to estimate the computing resources I need for it. I asked someone on my committee who said "it's all guesswork" but I don't even know how to come up with a reasonable guess!
I need to put some estimate of how much cluster time I will need (XX cores for YY hours) in order to do a dissertation grant. I've tried Googling and searching literature for how to do an estimate of this, but I'm not finding much.
Details:
- GWAS, total n=350,000, 10-15% cases
- Already imputed by the time I get it, will have about 96 million variants
- Will be using Plink
- Cluster nodes have 24 cores, and jobs can use up to 4 gigs of RAM per core. If Plink can handle being spread across nodes, I can use up to 100 cores at once.
- Time is billed in core-hours, using 20 cores for one hour is equal to using one core for 20 hours
- We may want to do a few smaller GWAS where we restrict by age (eg. one of all cases and controls under 25, and one of all cases and controls who are 65+)
- Need to come up with an estimate of cluster time needed for each GWAS that we might run (XX cores for YY hours)
Can you please advise me on how to estimate something like this?