Questions tagged [data-download]
The process of downloading data from the internet.
44
questions
0
votes
0
answers
8
views
Exporting Panther functional classification of gene list
After inputting a list of gene and running an analysis in https://www.pantherdb.org/ (such as "functional classification"), I get a result table that is limited by an X number of entries ...
- 21
4
votes
2
answers
100
views
Where to download a file with major and minor alleles at every position?
I want a list of all variants, i.e. sites which are known to vary between human to human. For example, it should ideally cover all sites in here, but without samples.
I don't want a giant reference ...
- 513
0
votes
0
answers
30
views
Get BioProject code of a GEO dataset
In publications the GEO code is usually shared and not the BioProject/study code.
I want to get the BioProject/Study Accession code of a GEO dataset (to later download the data from ENA).
I know that ...
- 4,693
4
votes
1
answer
75
views
What is the NCBI's definition of an "atypical genome"?
Using the new NCBI Datasets platform, you can browse the collection of genomes associated with one or more taxa. For example, searching Pseudomonas aeruginosa returns 19,878 genomes as of 29 March ...
- 613
2
votes
0
answers
79
views
Problem with nextflow -resume and path.fromSRA
I have a problem with nextflow -resume
Here is my script :
...
- 31
1
vote
0
answers
30
views
Download Addgene database
Is anyone aware of a way to download all vector sequences from addgene at once? As a non-profit, I'd assume they shouldn't be opposed to making this data available, but it doesn't seem to be possible. ...
- 11
1
vote
4
answers
609
views
How to download ligands for PDB structure
I have some PDB IDs and for every structure, I need all its ligands, so I want to automate the process.
The ligands are different for every chain:
...
- 227
3
votes
1
answer
65
views
Downloading genes from NCBI in fasta format
I'm pretty new in bioinformatics.
I need to download FASTA sequences of several genes. The list of genes I have assembled consists of 140 genes, so I'd rather do this through via code than download ...
- 31
2
votes
2
answers
576
views
How to wget a gff from NCBI database?
Say I want to use wget to download a gff file for the X chromosome of release 5.57 of the Drosophila melanogaster genome. The NCBI page with the gff file for just this is here.
However, I do not see ...
- 152
3
votes
0
answers
34
views
Retrieve protein sequence from Mgnify given only accession code
I only have the accession codes of several proteins from the MGnify database (https://www.ebi.ac.uk/metagenomics/). I would like to retrieve the full amino acid sequence data from the database, but I ...
- 131
2
votes
1
answer
86
views
How to get coding sequences (CDS) of UniProt reference proteomes?
I downloaded the following reference proteomes:
https://ftp.ebi.ac.uk/pub/databases/reference_proteomes/QfO/
...
- 151
2
votes
1
answer
77
views
Taking too long to download metadata file (estimated size 30MB) from Covid-19 Data Portal
I am working on developing a tool to classify covid variants. So I am trying to download SARS-CoV-2 sequence data along with lineage annotation from Covid-19 Data Portal (I could not find a better ...
- 23
2
votes
2
answers
296
views
Replacing column 1 in file1 with matching ID's in file 2
I have downloaded two files:
File1.csv from:
https://depmap.org/portal/download/data_slicer/download?file_path=20220227%2F3c335b7d-c18e-4788-b2e6-512d71f0a339%2Fexport.csv&name=Metabolomics.csv
...
- 395
3
votes
2
answers
434
views
What happened to sra ftp server?
My whole (professional) life I am downloading sequences from SRA and ENA databases. Long time ago, I used prefetch from sra-tools, but later I switched to simply using wget from ftp servers of the two ...
- 5,517
1
vote
2
answers
44
views
Understanding exercise on file coverage with question on summary statistics
I'm doing an exercise that asks for two files:
Input 1: A target file (.bed format) contains multiple regions from
...
- 111
1
vote
1
answer
189
views
Where to find publicly available Sanger chromatography data?
I am looking for any public available databases where I can download Sanger chromatography data ideally in Ab1 or SCF file format. I need extremely large amounts of this, since I want to use it for ...
- 151
2
votes
1
answer
2k
views
How to download data from SRA in Linux systems via the command line?
My workflow for downloading data from SRA has been the following:
Access SRA Run Selector.
Enter the accession number for the project of interest.
Download "Accession List" for the "...
1
vote
1
answer
73
views
How do I download the mitochondrial haplogroup datasets for human genetics online?
I seem to have landed on the mitomap.org site, but I don't know what to make of it or what do with it / how to get the genomes onto my computer. It sounds like the genomes are stored in GenBank, but ...
- 133
0
votes
1
answer
2k
views
Download or create VCF from Human Genome Diversity Project (HGDP)
I can't seem to find HGDP data in VCF format.
Does anyone know where I can download it from?
Perhaps there a Snakemake pipeline for calling VCFs from this data?
- 470
1
vote
3
answers
4k
views
Download multiple fastq files using fastq-dump
I want to download the following fastq files at the same time in Salmon:
- SRR10611214
- SRR10611215
- SRR10611215
- SRR10611216
- SRR10611217
Is there a way ...
- 11
1
vote
0
answers
197
views
Trying to download a large number of files from ENA programmatically
I am downloading a large number of files from the ENA in Python using Multithreading. As an example, to be more concrete, I tried downloading 12 files simultaneously using 12 threads. I noticed that ...
4
votes
2
answers
735
views
Downloading all COI sequences from BOLD fails
I have metabarcoding sequence data (COI) from bulk animal samples (including arthropoda, nematoda, annelida, mollusca) and I want to BLAST all of these sequences. I used following command to do this: <...
- 133
2
votes
2
answers
290
views
How to download multiple proteomes at once?
I'm looking for a way to download multiple proteomes at once from one clade, as fasta. Probably from the NCBI, because it looks more user-friendly than Ensembl, but Ensembl is okay too. In the best ...
- 881
0
votes
0
answers
39
views
Blood analysis devices: how and where is the data saved
I've read that there are blood analysis devices that can automatically determine the data for each specified analyse. You can expect to get the results in less than a day.
Q: How and where do they ...
user6369
1
vote
1
answer
119
views
How can extract the list of genes name from the raw data in GEO?
The format of the raw data that upload in GEO is different, like TXT, CEL or other form. How can I extract the list of genes name from these formats? And then how can I normalize them with R?
I would ...
- 29
5
votes
4
answers
272
views
How do you query and explore ENCODE data?
I am looking for a modular way to query data from ENCODE.
For example, I would like to get CHiP-seq or similar tracks for a specific cell line. What's the proper way to do it?
Finally, is there an ...
- 1,427
3
votes
2
answers
259
views
How to link GDC ids to CCLE cell line names?
Hello bioinformaticians,
I've recently downloaded few RNAseq data files from Genomic Data Commons Data (GDC) portal. These files belong to Broad institutes CCLE project.
Now the problem is that GDC ...
- 665
6
votes
4
answers
1k
views
Convert SRA to FastA
I'm trying to get the FastA files for some accessions (like NC_001416.1). I did not managed to find an FTP server or direct link to these files (I want to get it from command line with ...
- 221
3
votes
1
answer
73
views
How to query the Human Microbiome Project (HMP) to find all subjects with both 16s and WGS workups?
I am looking for a query to run on the HMP database that will return all subjects who have had BOTH 16s and whole genomes sequence (WGS) workups. I am currently using this query...
...
- 265
0
votes
2
answers
236
views
GDC data portal cancer subtype
I need to use Gene Expression quantification data (using HTSeq-FPKM-UQ) for breast cancer data on the gdc portal (https://portal.gdc.cancer.gov/repository) to classify breast cancer subtypes (luminal ...
- 11
1
vote
1
answer
41
views
Where can I find the DNA sequence of the C. elegans rRNA cluster?
Where can I find the DNA sequence of the C. elegans rRNA cluster?
Ideally, I would be able to do it using the command-line.
I've tried using NCBI but the results are unsatisfactory. I am interested ...
- 2,459
1
vote
1
answer
434
views
How to download SNP data from specific regions, population and positions?
I am totally new in Bioinformatics and I would like to apply my knowledge in feature selection on the tag SNP problems.
To do that, I've read a lot of papers and books in order to understand the main ...
5
votes
2
answers
697
views
A reliable fetcher of short read using SRA/ENA accession
I am trying to build a workflow that gets data automatically from databases of sequencing reads (SRA - sequence read archive, ENA - european nucleotide archive). Till now I was pulling everything from ...
- 5,517
6
votes
1
answer
369
views
How to validate that BAMs have been downloaded correctly?
I currently have several hundred BAM files which were downloaded by someone else. These have remained untouched---before working with them, I would like to double-check that these BAMs have been fully ...
- 1,393
2
votes
1
answer
153
views
SNP data Download Help
I am new to the field of Bioinformatics. Single Nucleotide Polymorphism or SNP data are available on the the Internet to download.SNP related data are valuable for variety of reasons ranging from ...
- 121
3
votes
1
answer
266
views
How to download gene expression data from NCBI gene database
In the NCBI gene database, I can add the expression tracks (circled in picture blow) through 'Tracks' button, but How I can download the expression data directly, not just look the picture?
- 31
2
votes
1
answer
882
views
How to download the whole directory of an ensembl FTP page?
I am interested in downloading all the files at:
ftp://ftp.ensembl.org/pub/release-91/embl/bos_taurus/
I know how to download a single file from that page using wget (Unix) or download.file() (R) ...
- 2,459
3
votes
2
answers
5k
views
How to download the whole BLAST nt database into a specific folder?
I have successfully downloaded the whole nt BLAST database into the current folder using:
wget -b "ftp://ftp.ncbi.nlm.nih.gov/blast/db/nt.??.tar.gz"
However, I ...
- 2,459
2
votes
2
answers
2k
views
6
votes
1
answer
597
views
Download data from the Human Microbiome Project via ascp
I have asked this question in biostars, but I am trying here as well as people working with "omics" data might be able to help. I think my issue relates understanding how large data storage on online ...
- 61
6
votes
7
answers
14k
views
Download multiple SRA files
I want to download all SRA file from the following project. Is there a method to download all the SRA files at the same time?
- 223
4
votes
2
answers
599
views
How to dump genes from GenBank in GFF3 format?
This question has also been asked on BioStars
If I look at this record in GenBank I see about 6k genes:
https://www.ncbi.nlm.nih.gov/nuccore/CM000760?report=gbwithparts
I'd really like to be able to ...
- 602
17
votes
6
answers
4k
views
What's the best way to download data from the SRA? Is it really this slow?
I'm trying to download three WGS datasets from the SRA that are each between 60 and 100GB in size. So far I've tried:
Fetching the .sra files directly from NCBI's ftp site
Fetching the .sra files ...
- 171
6
votes
1
answer
119
views
Stable download URLs
One big problem that I'm regularly facing is that URLs for downloading Bioinformatics data (e.g., RefSeq releases or NCBI genome releases) disappear.
Does anyone have any good solution for this?
- 588