Questions tagged [bash]

Use this tag to refer to the questions related to the Linux and Unix shell abbreviated as bash (Bourne Again SHell). It has notable programmatic strengths over C shell (csh) and touch C shell (tcsh)

Filter by
Sorted by
Tagged with
6
votes
3answers
2k views

What is a quick way to find the reverse complement in bash

I have a DNA sequence of which I would like to quickly find the reverse complement. Is there a quick way of doing this on the bash command line using only GNU tools?
5
votes
3answers
3k views

Bash scripting FastQC for multiple fastq files in multiple directories

I am completely new to bioinformatics so I'm looking to learn how to do this. I have multiple directories with fastq files: E.g; 10 Directories with each time series, each with Treatment and control ...
4
votes
1answer
503 views

Calculating average coverage for .bam files (sequence data)

(Full discolosure that this is my first time working with sequence data, and with the bash scripting.) I need to calculate the average coverage for any .bam file. After some searching I wrote the ...
4
votes
2answers
205 views

How to align output of grep --color=always? (To QC fasta/fastq files)

Grepping out short sequences from a fasta or fastq file is a really useful way to look at sequencing data. Using the option --color=always makes this even more ...
4
votes
2answers
2k views

Sort vcf by contig and position within contig

Due to tabix constraints, I need to sort a vcf so that contigs and then positions within contigs occur in numerical order in the vcf. I don't know if the following will sort positions within contigs, ...
4
votes
1answer
750 views

BAM to gene expression matrix (UMI counts per gene per cell),10X

I am trying to reproduce some results of a scRNASeq experiment. However I am new to the server-side aspect of such analyses and am very confused at the moment. The data provided by the authors of the ...
4
votes
1answer
271 views

Error given while trying to index a BAM file with Samtools Index - NO COOR?

I am currently working on my own Metagenomic pipeline, utilizing Bowtie 2 to map. Bowtie 2 outputs a SAM file, which I convert to a .BAM and sort it using Samtools. When I try to utilize Samtools to ...
3
votes
3answers
87 views

How to get the product of a CDS

I need the name of the protein in /product="protein_name" using bash commands. Beware, there is a lot of whitespace between lines. ...
3
votes
1answer
875 views

Running htseq-count over BAM files

I am trying to derive an expression matrix from BAM files using htseq-count on the server. These are bulk RNASeq BAM's by the way. I have read the ...
2
votes
2answers
91 views

How to get rows with similar values in two different columns using command line?

I have following example data from a large file. ...
2
votes
3answers
148 views

Replace lowercase characters with -

I have an output from vcfutils.pl vcf2fq with specified minimal depth, and it means that nucleotides with not enough depth are lowercase. I would like to change them to gaps. I could do it in higher ...
2
votes
2answers
365 views

how to remove range from fasta header

Could you please suggest me how I can remove range from fasta header:like these number from below sequences which has some colons indicating the range of the genome :147010-147657 :149201-149845 <...
2
votes
5answers
75 views

How to measure the total size of a fastq file in base pairs?

Or Kbps/Gbps. It feels like it should be conceptually very simple, but I can't seem to figure out the right combination of keywords to find it via my search engine. Help would be appreciated! I have ...
2
votes
2answers
52 views

Moving file based on their names

I have a list of vcf files; I also have a list of names in a txt file like LP6005409-DNA_F01 LP2000325-DNA_A01 LP6005409-DNA_E02 LP6005500-DNA_C03 What I have in ...
2
votes
2answers
259 views

Error with BWA Mem input having multiple fastq files using cat and process substitution

Running BWA Mem on a number of paired end fastq files using process substitution on the inputs results in this error: ...
2
votes
1answer
59 views

Pattern mining from a genomic sequence

I need to find the following pattern from a genomic sequence ...
2
votes
1answer
149 views

How to edit the headers of multiple fasta files from multiple folders?

My directories are organized as follows: one main directory, in which I have multiple directories that end with a number ranging from 314 to 727, followed by .3 . For example, 'mgm4761314.3'. Within ...
2
votes
2answers
222 views

Filter reads belonging to unique sequences with threshold

I have CLL samples as fastq files and I want to remove those reads which have a unique sequence with less than 10 read counts each. I tried this by following way using awk to make it faster: ...
2
votes
0answers
85 views

Cannot blast against specific NCBI databases

I am having issues with some prokaryote reference genome databases (exact names : ref_prok_rep_genomes.*), that I downloaded from the NCBI website : https://ftp.ncbi.nlm.nih.gov/blast/db/. Files in ...
1
vote
4answers
667 views

Edit FASTA header using sed

I need to rename the following headers from a FASTA file. Something like: ...
1
vote
2answers
1k views

How to merge .fastq.qz files into a single .fastq.gz with their same id without losing any content in parallel

I have a large number of .fastq.gz files of different lane and reads. I have to merge them each reads group files into single .fastq.gz files. **eg: 1st type NA24694_GCCAAT_L001_R1_001.fastq.gz ...
1
vote
2answers
117 views

How can I run a command for multiple files?

I have a bunch of .vcf files in a folder and I want to run command below on all of them but doing that one by one manually is really painful. I am seeking for a way ...
1
vote
2answers
81 views

How to extract values from second file on the basis common first column?

File1: ENST00000000233 ARF5 ENST00000000412 M6PR ENST00000001008 FKBP4 ENST00000001146 CYP26B1 ENST00000002501 DBNDD1 ENST00000002596 HS3ST1 File 2: ...
1
vote
2answers
89 views

Trying to create a .bam file without the need for a .sam file

I'm trying to use the code specified in this link to create a .bam file without the need for a .sam file. Here is the code I'm using: ...
1
vote
2answers
74 views

Using preprocessing/alignment functions on the server

I am new to bash and the processes behind cluster computing in general and need some help with understanding some basics. After looking all over the internet and this forum (+ askUbuntu) I found ...
1
vote
2answers
41 views

Trying to divide number in fourth TSV column by a certain number according to its corresponding identifier in the first column

I was wondering if anyone could help with my little issue in manipulating tsv files in order to calculate estimated coverage across many tsv files. I have tsv files that look something like this: <...
1
vote
2answers
100 views

MiXCR: only create a single export file for all clonotypes

I am using following command from MiXCR to both align, assemble and export my input files: ...
1
vote
2answers
104 views

How to run Jupyter script on Slurm HPC

Now jupyter installed on the server and I am using below code to plot the rarefaction plot but I am still getting some error. could you please suggest how I can get rid of it? ...
1
vote
1answer
53 views

Split fasta file based on groups in header information and output as separate files

I have a fasta file containing the sequence of a gene across different species. In total there are around 900 samples and 12 species. (Each sequences is over multiple lines and longer than 100bp.) My ...
1
vote
1answer
21 views

Running tophat dockerfile in background

I need to use tophat2 to align some sequences, and I wish to use the docker container. These are large sequences so it will take a long time, plus I'm working on a university server so the chances of ...
1
vote
1answer
59 views

Multi-line efetch digging

I'm using efetch to dig out a middle "envelope" protein within a viral genome specifically within fasta format. The code below works but may not be robust for an entire database. Thus I want to ...
1
vote
2answers
36 views

Mapping statistics from bam file using bbtools and sambamba

Below are the statistics for RNA-seq mapped and unmapped paired-end reads to rice genome using reformat.sh from bbtools on bam files. It gives 77% mapped and 5% unmapped, what about the remaining 18% ...
1
vote
1answer
31 views

How to subset genes and its nested features from a GFF file using a gene list

I would like to subset a GFF file (gene and nested features) from a gene list. The GFF file looks like this ...
1
vote
1answer
195 views

remove sequences from fasta file matching a string in the header

I have a file with 16S sequences. some headers contain species information. For my purposes I would like to exclude a number of species from the file, therefore I would like to do a pattern matching ...
1
vote
1answer
43 views

Fastq-dump script download X spots or all

Im trying to write a script where an optional input of -X flag can be used, or if that info is not available download all reads. my script as follow: ...
1
vote
2answers
313 views

processing fastq files using cellranger on linux

I am trying to perform a cellranger count on fastq files generated from a 10x genomics single cell RNA Seq run. Just to provide some background, I ssh’d into the AWS using our AWS IP with MobaXTerm ...
1
vote
1answer
408 views

Extract certain fields using from GenBank file using Bash script

I need to extract certain lines from a GenBank file on Linux. Input file: ...
0
votes
2answers
112 views

Changing this code in a way to work for my files

I have a bash script which extracts some information from a .vcf file but one .vcf file at each time. How I can change this script in a way to work on a bunch of .vcf files and the output is a .txt ...
0
votes
2answers
43 views

Using variables with fasterq-dump?

I am trying to download multiple fastq files from the SRA NCBI database which, conveniently enough, have their IDs in a range. Building a simple loop doesn't seem to do the trick, as bash appears to ...
0
votes
2answers
81 views

How I can run this code on my files?

I am annotating some .txt files by Annovar software by this code nnovar]$ module load annovar/2016Feb01 [cyan01 annovar]$ table_annovar.pl But I really got ...
0
votes
2answers
285 views

How to loop multiple function in shell script?

I need to extract sequences one after another consecutively from a large fasta files (multiple fasta files) and each extracted files to be saved in new fasta file (I mean the first sequence extracted ...
0
votes
1answer
176 views

How to combine multiple files into one file?

I have multiple files (n=86000) with one column each and I want to combine them all into one file with 86000 columns. I tried the following command ...
0
votes
1answer
372 views

How to extract all pair end fastq.gz files from multiple subdirectory to a single folder

I have all file names for each paired-end fastq pair as shown below. Could you please suggest how I can extract all fastq.gz files in a single folder? sample name: ...
0
votes
2answers
108 views

Looping over several files in bash

I have a bash script: I am wondering how I can change this script to loop over a bunch of .vcf files and give output .txt with the name of corresponding .vcf I tried changes done in similar script ...
0
votes
1answer
42 views

repophlan script to download bacterial genome

I am trying to donwload the microbial genome using the repophlan_get_microbes.py (https://github.com/SegataLab/repophlan) but now it is running more than 10 days and still not finished on slurm HPC. ...
0
votes
1answer
96 views

How to edit the headers of multiple fasta files from multiple folders? (recursively)

This is an expansion of my previous question, How to edit the headers of multiple fasta files from multiple folders? My directories are organized as follows: one main directory, in which I have ...
0
votes
1answer
32 views

How to run 'join' command for multiple files (of 2 types) in a folder

I have two types of files for a gene in a folder File 1: FOS.tf.txt ABL2 ACTN4 ADGRE5 ADIPOR2 ADRB2 ERCC4 EZR FAS FMO4 File 2: FOS.tt.txt ...
0
votes
1answer
31 views

How to use analysis output in my pipeline

I am running an analysis and I want to edit the output that I received from that analysis. However I cannot define the output name in my pipeline, because after running the analysis it is asking me to ...
0
votes
1answer
23 views

Table error when combining counts columns

I have these files that I want to make table of (https://github.com/learnseq/RNAseqfiles01.git), the table that I want (since all the files have the same ID column),, I want merge the ID column with ...
0
votes
0answers
25 views

Issues with AutoDock Vina

I am trying to use AutoDock Vina to do docking however I am getting this error. I would really appreciate any help as I have not been able to resolve this error despite trying numerous times.