Questions tagged [fastq]
FASTQ is a file format use to store short reads and their quality values
47
questions
6
votes
1answer
103 views
Convert BAM to properly paired FASTQ files
I thought I had figured this one out. But apparently not.
I need to convert a BAM file of paired-end alignments to two FASTQ files of paired reads to realign them, with a twist: I only want reads ...
3
votes
2answers
75 views
What do the FASTQ file names mean here?
I would like to run an analysis on Nanopore data. I'm trying to download sample data from https://github.com/nanopore-wgs-consortium/chm13. I would like to run minimap on the FASTQ files, resuling in ...
3
votes
1answer
137 views
Fast processing of fastq data
I am trying to write python script for customized filtering for fastq file (size >3 GB). My proposed script is as follows:
...
3
votes
0answers
27 views
Determine reference for reference-compressed SRA file
I have 241 SRA files that appear to be reference compressed. I didn't even know this was a thing until I tried to convert them to Fastq files without an internet connection. I got the "name not found ...
2
votes
2answers
135 views
Frequency of specific viral sequence in .BAM or .fastq
I was wondering if anyone had any experience 'counting' the frequency of a particular viral sequence in an individual's fastq sequence. So basically, counting the number of occurrences of a particular ...
1
vote
5answers
159 views
Testing for viral/bacterial infection FASTQ files
What's the best way to test if a pair of Illumina FASTQ files from blood DNA extraction contain any reads from viral/bacterial infection from DNA in human blood? Thanks in advance.
EDIT:
Looking at ...
1
vote
1answer
41 views
Batch alignment of inconsistently named Fastq files
I have numerous gzip-compressed paired-end Fastq files with ChIP-seq data that I would like to align with bowtie2. I confirmed that bowtie2 takes .gz files, ...
1
vote
0answers
39 views
“Bad substitution” error while trimming adapters [closed]
I have this script to trim adaptors from my fastq sequencing files
for PAIR in $(fastq | sed 's/_R.//g' | uniq)
I am gitting this error: bad substitution
Could ...
3
votes
2answers
93 views
Getting data from fastq by generator
I have a task in a training that I have to read and filter the 'good' reads of big fastq files.
I downsampled, got the code working, saving in a python dictionary. But turns out the original files ...
0
votes
1answer
62 views
Where to Download Cancer Raw Reads (fastq)?
Does anyone know where I can download cancer raw reads (fastq files), tumor and Germline for non-humans?
I wanted to make a study with human data but I don't have the control access to download raw ...
1
vote
1answer
88 views
Non-random access on a fastq file
There was a nice question on random access on a fastq file, however I have the opposite problem. I want to programatically access non-random fastq entries quickly (using C++).
Say I have several ...
9
votes
1answer
490 views
Why does this human bam file only have one copy of each chromosome?
As we know that in human DNA sequence, one copy of chromosome comes from mother's DNA and another copy comes from father's DNA so as to form two copies of each chromosome in human DNA. So, if we ...
6
votes
1answer
159 views
Multithread fastq processing with kseq.h in C++11?
Background
I am using the wonderful kseq.h as my fastq/fasta parser for a C++ project. My actual implementation uses something like this, where I am counting kmers ...
1
vote
1answer
72 views
Are there free cloud computing platforms for biology projects? [duplicate]
I want to implement the analysis found in the paper RNA-Seq of Tumor-Educated Platelets Enables Blood-Based Pan-Cancer, Multiclass, and Molecular Pathway Cancer Diagnostics The project id is 281708. ...
0
votes
0answers
15 views
Is there a tool that converts fastq to fast5? [duplicate]
We need lots of fast5 files. Anyway i can convert fastq to fast 5 or simulate fast5?
6
votes
5answers
236 views
Delete all 4 lines of a fastq read from a fastq file using read ID
I have the following error when running bowtie2:
Error: Read HWI-D00466:116:CC62WANXX:3:1102:7363:63646 1:N:0:GCACACG
has more read characters than quality values.
I now want to remove all 4 ...
4
votes
2answers
86 views
How to align output of grep --color=always? (To QC fasta/fastq files)
Grepping out short sequences from a fasta or fastq file is a really useful way to look at sequencing data. Using the option --color=always makes this even more ...
5
votes
3answers
814 views
Bash scripting FastQC for multiple fastq files in multiple directories
I am completely new to bioinformatics so I'm looking to learn how to do this.
I have multiple directories with fastq files: E.g; 10 Directories with each time series, each with Treatment and control ...
0
votes
1answer
93 views
Fastqc- Per Base Sequence Quality
I am trying to figure out how to interpret the "Per Base Sequence Quality"? What does Position in reads (bp) mean? Also in order to draw this box-plot graphics, more than one quality scores are needed ...
2
votes
2answers
63 views
filter out FASTQ reads which are shorter
I tried to filter out FASTQ reads which are shorter than 259 bp with
...
3
votes
2answers
1k views
2
votes
2answers
63 views
fuse fastq files with multiple records
I'd like to fuse ~50 pairs of corresponding fastq files on per sequence bases. I'd be happy for a solution as a Linux script, R script (if feasible with huge files), or any free software that runs ...
0
votes
0answers
16 views
How do I make tree file in qiime1?
I faced an unexpected problem.
My qiime1-script of metagenomics does not work well.
The script used to analyze 20 meta-genome samples or more at one time, but now it analyze only 16 samples at one ...
-1
votes
2answers
285 views
Script to run everything in a loop for extracting tar.gz files into fastq and to bam with alignment?
Original tar.gz files look like below:
...
8
votes
1answer
188 views
Counting repeated kmers sequences that match at least x % of reads sequence
Working on a fastQ file, I would like to get the occurrences of repeated sequences for all possible kmers of a given length that cover at least 90% of the read's length for the whole data set.
...
8
votes
1answer
231 views
How to get the count of each kmer past 255 using khmer
I have a Fastq file and I want to get the exact count of each possible kmer from this file.
On a previous post called How to use khmer to count k-mers? Daniel Standage proposed a custom script based ...
2
votes
1answer
56 views
efficient counting of dinucleotides/trinucleotides on fastq reads?
What's an efficient way of counting of dinucleotides/trinucleotide pattern on fastq.gz file reads?
I know there are tools like seqtk that will be very efficient at reading through the .fastq.gz files,...
5
votes
1answer
747 views
5' and 3' bias in Rna-seq data
I'm working with rna-seq samples. I see 5' bias and also 3' bias in the per-base sequence content plot. From this link I see that the bias at the start of the sequences appears to be the result of ...
3
votes
3answers
312 views
How to demultiplex pair-end fastq reads with barcode 2 in the identifier line?
I have multiplexed pair-end fastq reads with dual barcodes. The issue is that one barcode is present in the header and one is present at the beginning of the read. I need a method to demultiplex this ...
3
votes
1answer
80 views
Can the canu assembler output a fastq file of the final assembly just like HGAP4?
I have assembled some genome from Sequel PacBio data both with HGAP4 on the SMRT Link interface and using canu on the command line. The HGAP4 assembler outputs a fastq file of the final assembly such ...
7
votes
2answers
200 views
Canu assembly not making a single consensus?
I've downloaded reads from this BioProject. Using canu with default parameters (no correction), I've got 4 contigs, none of which really look like the reference plasmid here.
The command I used was:
...
4
votes
1answer
535 views
Estimating BAM file from compressed fastq file size
Is there a way to estimate the size of a BAM file will have after mapping with BWA?
The input file are two mates fastq files, compressed with gzip, each one about 70G.
4
votes
2answers
165 views
Is there a way to quickly verify the presence of some SNPs in Fastq files?
Is there a tool that can scan fastq files without assembling them for a custom list of user defined snps?
7
votes
1answer
213 views
Split FASTQ and matching BAM into matching chunks
I am running a slow downstream analysis on a large set of nanopore reads (approx 3 million), and would like to split them into smaller chunks, run the analysis in massively parallel, and then ...
11
votes
2answers
829 views
How to convert fastq to fast5
fast5 is a variant of HDF5 the native format in which raw data from Oxford Nanopore MinION are provided. You can easily extract ...
6
votes
2answers
331 views
How can I edit a specific FASTQ read in place, given the read ID?
Given a read ID, I want to edit a single basecall (e.g. the 12th base) for just that read from within a large FASTQ file containing millions of reads.
example, i want to change the 12th base ('C') in ...
8
votes
1answer
524 views
FASTQC overrepresented sequences after trimming
I have a set of RNA-seq samples from different experiments (Single and Paired End, depending on the experiment). I ran FASTQC in all the samples and found overrepresented adapter sequences:
I removed ...
7
votes
3answers
463 views
Extract nanopore read ID & start times from fastq file
I have a fastq file from minION (albacore) that contains information on the read ID and the start time of the read. I want to extract these two bits of information into a single csv file.
I've been ...
6
votes
2answers
446 views
How to safely and efficiently convert subset of bam to fastq?
Question
How can I extract reads from a bam file (produced by bwa-mem) to fastq given a ...
10
votes
7answers
5k views
Fast way to count number of reads and number of bases in a fastq file?
I am looking for a tool, preferably written in C or C++, that can quickly and efficiently count the number of reads and the number of bases in a compressed fastq file. I am currently doing this using <...
9
votes
2answers
995 views
How do you generate read-length vs read-quality plot for long-read sequencing data (e.g., MinION)?
How do you generate read-length vs read-quality plot (heat map with histograms in the margin) for long-read sequencing data from the Oxford Nanopore Technologies (ONT) MinION? The MinKNOW software ...
6
votes
1answer
325 views
How to maximize fastq parsing with FastqGeneralIterator (Bio.SeqIO.QualityIO)
I'm contributing to a python-based project that uses Biopython to analyze fastq files. It currently uses SeqIO.parse, which ...
16
votes
12answers
1k views
Random access on a FASTQ file
I would like to select a random record from a large set of n unaligned sequencing reads in log(n) time complexity (big O ...
16
votes
10answers
2k views
What is the fastest way to calculate the number of unknown nucleotides in FASTA / FASTQ files?
I used to work with publicly available genomic references, where basic statistics are usually available and if they are not, you have to compute them only once so there is no reason to worry about ...
13
votes
3answers
667 views
How can I improve the yield of MinION sequencing runs?
This is a frequently-asked question within the nanopore community. Oxford Nanopore currently claims that they are able to generate run yields of 10-15 gigabases (e.g. see here and here), and yet it's ...
7
votes
1answer
285 views
The effects of incomplete bisulfite conversion upon mapping efficiency
This question has also been posted on Biostars
I have sequenced numerous multiplexed pools of BS amplicon-seq libraries derived from human samples on a MiSeq over the past few weeks. I have been ...
19
votes
4answers
18k views
What is the difference between FASTA, FASTQ, and SAM file formats?
I'd like to learn the differences between 3 common formats such as FASTA, FASTQ and SAM. How they are different? Are there any benefits of using one over another?
Based on Wikipedia pages, I can't ...
