Questions tagged [benchmarking]
Benchmarking problems relate to problems where efficiency is key, beyond just solving a problem itself. What's the fastest or most efficient way to solve a problem?
12
questions
1
vote
0
answers
50
views
Benchmarking for variant identification using RNA-seq data
I am in need to benchmark the variant identification pipeline which uses RNA seq data alone without any matched-normal. I would like to know the reference dataset (and the pipeline on which the ...
- 11
1
vote
1
answer
78
views
Refactoring a script mapping ID to sequence
I wrote simple Python script which has an excessive run time, notably when using large data sets. For example a data set of 1 000 000 sequences.
I am seeking assistance refactoring the code and would ...
- 47
1
vote
2
answers
55
views
Improving list speed: glycosylation example
I discussed a question with @gaspanic Python/Biopython - Replace amino acid residue on MSA with "z" from a list of unaligned positions
. The issue emerged was speeding up lists in Python. ...
M__♦
- 11.2k
1
vote
1
answer
59
views
Challenging benchmarks for supervised learning on sparse scRNA-seq data
One challenging aspect of modeling scRNA-seq data is data sparsity, that is, scRNA-seq measurements typically suffer from large fractions of observed zeros (i.e. dropouts), where a given gene in a ...
- 123
3
votes
2
answers
84
views
Gold standard benchmark
This page is claimed to contain a gold standard benchmark for viral genome assembly.
https://github.com/cbg-ethz/5-virus-mix
The claim is here:
https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5411778/
...
- 359
8
votes
9
answers
22k
views
Remove/delete sequences by ID from multifasta
I have a fasta file like this:
>Id1
ATCCTT
>Id2
ATTTTCCC
>Id3
TTTCCCCAAAA
>Id4
CCCTTTAAA
I want to delete sequences that have the following IDs.
<...
- 375
2
votes
1
answer
102
views
efficient counting of dinucleotides/trinucleotides on fastq reads?
What's an efficient way of counting of dinucleotides/trinucleotide pattern on fastq.gz file reads?
I know there are tools like seqtk that will be very efficient at reading through the .fastq.gz files,...
- 2,294
21
votes
8
answers
9k
views
What is the fastest way to get the reverse complement of a DNA sequence in python?
I am writing a python script that requires a reverse complement function to be called on DNA strings of length 1 through around length 30. Line profiling programs indicate that my functions spend a ...
- 3,141
12
votes
8
answers
15k
views
Fast way to count number of reads and number of bases in a fastq file?
I am looking for a tool, preferably written in C or C++, that can quickly and efficiently count the number of reads and the number of bases in a compressed fastq file. I am currently doing this using <...
- 9,442
20
votes
12
answers
2k
views
Random access on a FASTQ file
I would like to select a random record from a large set of n unaligned sequencing reads in log(n) time complexity (big O ...
- 2,206
13
votes
4
answers
767
views
How do I efficiently subset a very large line-based file?
This has come up repeatedly recently: I have a very large text file (in the order of several GiB) and I need to perform line-based subsetting for around 10,000 lines. There exist solutions for ...
- 4,825
21
votes
10
answers
6k
views
What is the fastest way to calculate the number of unknown nucleotides in FASTA / FASTQ files?
I used to work with publicly available genomic references, where basic statistics are usually available and if they are not, you have to compute them only once so there is no reason to worry about ...
- 5,497