Questions tagged [file-formats]
File format are sets of defined rules to organise a specific type of data. Common file format in bioinformatics include FASTA, FASTQ, SAM, BAM, VCF.
2
votes
1answer
52 views
How to interpret UniProt allele patterns?
In creating a parser for the UniProt flat file uniprot_sprot.dat (directory) in the manual for the comments POLYMORPHISM there ...
1
vote
1answer
49 views
Filter VCF for “CAF=[0.9,0.1]”
Related to this other question
but in this case the CAF is defined as "An ordered, comma delimited list of allele frequencies...".
I tried using vcffilterjdk and the command suggested by Pierre
<...
2
votes
3answers
89 views
I have 23andme text files and would like to convert to SAM/BAM format
I would like to convert 23andme text file to NextGen to BAM file for Yfull.com to read. It is difficult to get answers on how to convert to SAM/BAM file for the 23andme text file to be converted to ...
2
votes
0answers
105 views
UniProt flat file. Interpreting format of SUBCELLULAR LOCATION. What does flag mean?
In creating a parser for the UniProt flat file uniprot_sprot.dat (directory) in the manual for the section SUBCELLULAR LOCATION ...
2
votes
4answers
126 views
Can a gff file be converted to a fasta file?
I downloaded an annotated genome file in gff format here. I would like to use it for proteomics. Though I need it in fasta format. Is there any tool that converts gff to annotated fasta? I see the ...
2
votes
1answer
51 views
What is the “primer masterfile” format?
I am working with an amplicon kit from Swift Bioscience and they provide the primer locations in what they call a "masterfile". The format is like this:
...
1
vote
3answers
113 views
How to convert data in gmt format to dataframe?
I downloaded c5: gene ontology gene sets file from http://software.broadinstitute.org/gsea/downloads.jsp
I opened the "c5.all.v6.2.symbols.gmt" file in csv format and It looks like below:
I want to ...
3
votes
3answers
227 views
How to convert Bed file to fasta file?
I have Bed file containing start and end of a sequence, and I need to convert it to fasta format, any recommendations?
2
votes
1answer
94 views
Plotting Ramachandran Plot from more than one PDB file
I want to plot a Ramachandran Plot for around 5000 PDB files in python that is saved in a folder in my system. I am searching for a way to make it without accessing each file by hard-coding each file ...
5
votes
1answer
74 views
Meaning of the FORMAT fields of the VCF file coming from GIAB project
After reading the GIAB paper in https://www.biorxiv.org/content/early/2018/05/25/281006 and its Figure 1, I am still having trouble understanding the data inside the GIAB VCF file for HG001 (...
2
votes
2answers
170 views
How to filter for “CAF=0.5747,0.4253”
In my gzipped VCF file I have many variants, and they report allele frequency such as:
...
3
votes
1answer
141 views
get gene lines from gtf file
I would like to retrieve gene lines from a GTF file for which I only have exons & transcripts lines (output from Cufflinks) and alternative splicing possible. I need gene lines for compatibility ...
-1
votes
2answers
228 views
Script to run everything in a loop for extracting tar.gz files into fastq and to bam with alignment?
Original tar.gz files look like below:
...
-2
votes
1answer
55 views
How to calculate call detection values in microarray datase if .cel file unavailable
I would like to do a differential gene expression analysis on a microarray data. From the literature, I understood, call detection (Present, Absent, Marginal) has to be done to minimize false ...
1
vote
0answers
45 views
Which data format for stranded coverage data
I need tools I am writing to output data in terms of score for each base in the genome. The format needs to be indexed for fast random access.
The obvious choices are bigWig and tabix-index bedgraph ...
6
votes
1answer
102 views
Run gffread in multi-thread mode
Is there any possibility to run gffread in multi-thread mode? The answer seems to be 'no' from the manual (or gffread -h), as no multi-thread option is mentioned.
...
2
votes
2answers
102 views
seqret error when trying to transform GFF3 and FASTA files into EMBL format
I am using the tool seqret from emboss to transform an annotation file in GFF3 format and a FASTA file into an EMBL file because Wormbase does not supply an EMBL file with annotation and sequence ...
5
votes
1answer
138 views
Can a data file in VCF format be converted into FASTA?
I'm considering purchasing the 'MyGenome' product by Veritas Genetics to analyze my genome for a project. I'd like the data to be in FASTA format, but Veritas only provides VCF data. Is it possible to ...
13
votes
1answer
419 views
Why would someone use a CRAM instead of a BAM?
I had this question from a graduate student yesterday, and I was stuck.
What should I say? Why use a CRAM instead of a BAM?
When is it a good idea to use a CRAM instead of a BAM?
When is it a bad ...
3
votes
1answer
72 views
What are the differences between BNGL (BioNetGen Language) and SBML (System Biology Markup Langague) formats?
Per request from meta comment.
I am self-learning about whole cell modeling, specifically An introduction to whole-cell modeling and Fundamentals of Systems Biology: From Synthetic Circuits to Whole-...
1
vote
1answer
46 views
seqret: Warning: bad /protein_id value
I am using the seqret tool from the Emboss suite to transform produce an EMBL annotation file from a GTF annotation file and the corresponding FASTA sequence:
...
3
votes
1answer
183 views
Why doesn't Biopython AlignIO.read() recognise the 'mauve' format?
On this Biopython tutorial, they describe how to import a multiple sequence alignment in the Mauve (XMFA: extensible multi fasta format). So I imported the AlignIO module:
...
6
votes
3answers
286 views
Infer missing UTR features in GFF3 file
I am working on a GFF file that is missing the 5'UTR and 3'UTR information. For example:
...
5
votes
3answers
211 views
How to indicate the END of a haplotype block in VCF?
In VCF I know how to indicate that two genotypes are in the same phase by using consecutive "0|1" and "1|0" genotype fields, for example. However, how do I deal with the case that the first two ...
2
votes
2answers
350 views
bcftools output vs. bgzip
I've got what seems like it should be a simple question, but I can't seem to figure it out from google. bcftools has 4 output options:
...
5
votes
1answer
259 views
What is this 5-column sequencing format from 2009?
There is high throughput sequencing data here, and I don't know what format it is in.
It was submitted in 2009, and the description says the following:
Library strategy: ncRNA-Seq
Library source:...
5
votes
1answer
96 views
What format is this? Pretty sure it's not a BED file
Time for guess the bioinformatics file format... :)
I found this '.bed' file on GEO (GSE84660), but it's clearly not a BED file. Anyone know what it might be? And what can view it? It's from a HiC ...
8
votes
1answer
341 views
How 9th column of a gff file varies from one gene prediction algorithm to another?
GFF3 files are in tabular format with 9 fields per line, separated by tabs. The first 8 fields share almost same data structure, but the 9th field varies a lot depending on feature type and gene ...
12
votes
2answers
141 views
Is there a standard k-mer count file format?
I am doing a research project involving calculating k-mer frequencies and I am wondering if there is any standard file format for storing k-mer counts.
4
votes
1answer
61 views
What does the “X_OS_IND” column mean?
I want to survival analysis using the subset of TCGA LUAD dataset, which identifier are located here.
...
6
votes
3answers
478 views
How can I read FCS files using open source libraries?
FCS is a patented data format used for storing flow cytometry data. The most recent version is FCS3.1. There is some documentation on the format, but there is no information on how to read these files....
7
votes
3answers
1k views
How to convert the .vcf (imputed) file with GT:GP format to GT:DS?
I have the genotyped data from impute2 output in .gen format (imputed to 1000G P3). The file has genotype posterior probabilities (GP:3 values per variant). I have converted .gen to .vcf using qctools ...
12
votes
3answers
1k views
How do you write a .gz fastq file with Biopython?
How do you write a .gz (or .bgz) fastq file using ...
8
votes
2answers
94 views
PDB format: remark number for free text
I would like to add a text to PDB files that I'm processing with my tool, rna-pdb-tools. Someone points that the way I'm using it right now it's not correct (https://github.com/mmagnus/rna-pdb-tools/...
4
votes
1answer
56 views
How to represent trans-spliced genes in GTF?
For example, see this gene (nad1) in ENA:
http://www.ebi.ac.uk/ena/data/view/ABI60879
If you look at the XML for that gene you see the following:
...
5
votes
1answer
82 views
Is the optional SAM NM field strictly computable from the MD and CIGAR?
From SAM Optional Fields Specification the NM field is
Edit distance to the reference, including ambiguous bases but excluding clipping
Assuming both the MD and CIGAR are present, is the edit ...
5
votes
1answer
178 views
Customizing bigWig file
I generate bigWig files using bamCoverage from deeptools, in part for my colleagues to visualize their mapped libraries in the IGV viewer.
A problem is that the ...
6
votes
1answer
296 views
How should the SAM MD tag match the CIGAR string?
I am trying to understand how the MD:Z tag is used. The following is from the SAM Optional Fields Specification, which gives an example but is not thorough.
The MD field aims to achieve SNP/indel ...
6
votes
2answers
319 views
Converter between PDB or mmCIF and MMTF
I'd like to test MMTF, a new format for storing biomolecular structures which is promoted by RCSB as a more compact alternative to mmCIF and PDB.
From MMTF FAQ:
How do I convert a PDBx/mmCIF ...
4
votes
1answer
114 views
What kind of “gff” format does bioawk parse?
I was wondering if I could use the gff parsing capability of bioawk to facilitate the parsing of gtf files, and I looked at the following help message:
...
10
votes
2answers
183 views
What are the de facto required fields in a SAM/BAM read group?
The SAM specification indicates that each read group must have a unique ID field, but does not mark any other field as required.
I have also discovered that htsjdk throws exceptions if the sample (...
11
votes
2answers
143 views
Do variant calls change when you call from CRAM?
We're considering switching our storage format from BAM to CRAM. We work with human cancer samples, which may have very low prevalence variants (i.e. not diploid frequency).
If we use lossy CRAM to ...
9
votes
4answers
180 views
Annotation format design
Bashing file formats is a favorite pastime in bioinformatics, and annotation file formats such as GFF and BED seem to get special attention. A lot of this frustration stems from community's shockingly ...
14
votes
3answers
2k views
BAM to BigWig without intermediary BedGraph
I have a pipeline for generating a BigWig file from a BAM file:
BAM -> BedGraph -> BigWig
Which uses bedtools genomecov ...
12
votes
5answers
227 views
Are there any databases of templates for common bioinformatic file formats?
I want some templates of different file formats that I can use to test my scripts and identify possible bugs in my code.
For example, consider nucleotide FASTA, a simple but often abused format, I ...
11
votes
1answer
1k views
What's the difference between VCF spec versions 4.1 and 4.2?
What are the key differences between VCF versions 4.1 and 4.2?
It looks like v4.3 contains a changelog (specs available here) but earlier specifications do not.
This biostar post points out one ...
14
votes
7answers
3k views
16
votes
3answers
871 views
Convert a BAM file from one reference to another?
I have a set of BAM files that are aligned using the NCBI GRCh37 human genome reference (with the chromosome names as NC_000001.10) but I want to analyze it using a BED file that has the UCSC hg19 ...
17
votes
4answers
15k views
What is the difference between FASTA, FASTQ, and SAM file formats?
I'd like to learn the differences between 3 common formats such as FASTA, FASTQ and SAM. How they are different? Are there any benefits of using one over another?
Based on Wikipedia pages, I can't ...
42
votes
8answers
2k views
What's the most efficient file format for the storage of DNA sequences?
I'd like to learn which format is most commonly used for storing the full human genome sequence (4 letters without quality score) and why.
I assume that storing it in plain-text format would be very ...
