1
$\begingroup$

This question was also asked on Biostars

I am running CibersortX in high-resolution mode (which yields estimates of gene values per sample).

After that, I want to perform DE between two conditions on the resulting gene estimates.

  • What statistical test would one need to apply to perform DE after high-resolution mode de-convolution?

  • If I use the output of DE for ranking purposes only (in pre-ranked GSEA), does it make sense to use a simple t-test?

The data is in TPM (CibersortX received TPMs as its input). I transform to log2 scale before t-test. There are only 7 samples available (4 control, 3 treatment)

Here are some genes which get the smallest p-value after t-test (but do not pass FDR)

ETFBKMT 0.08727244  0.2549699   0.1277664   0.000000    0.597810    0.4984627   0.4672444
AFF3    3.28551359  2.9969676   2.8793547   3.013827    2.483018    2.5070328   2.3119873
PDLIM1  4.26118568  4.0109785   3.9223976   3.856899    3.388990    3.5155023   3.2931998
MYOF    6.17754486  5.9286025   5.7452668   5.845756    5.276884    5.3981318   5.1251924
LINC02210 3.22922278    3.1785117   3.5162067   3.307364    2.736807    2.9091521   2.8052582
CD274   5.20308488  5.0063801   4.8715090   4.922224    4.440247    4.6192961   4.5082217

And these are the values before log

ETFBKMT 1.062360    1.193311    1.092601    1.000000    1.513417    1.412707    1.382466
AFF3    9.750753    7.983202    7.358209    8.077041    5.590659    5.684498    4.965666
PDLIM1  19.175412   16.122220   15.162099   14.489126   10.475814   11.435934   9.802840
MYOF    72.381287   60.909803   53.641094   57.510614   38.770421   42.169610   34.900902
LINC02210 9.377626  9.053727    11.441519   9.899558    6.665934    7.511766    6.989834
CD274   36.837031   32.141830   29.273209   30.320557   21.709387   24.578008   22.756735

And that is the a distribution of the expression values (after deconvolution) before log2, in one of the samples

 Min.   :    1.00   
 1st Qu.:    5.01 
 Median :   18.03
 Mean   :   89.08 
 3rd Qu.:   47.82 
 Max.   :34406.87  
$\endgroup$
0

1 Answer 1

0
$\begingroup$

To specifically answer the question - a T-test is a parametric test which requires a normal distribution. So it's not a good idea in context to this data. However, the non-parametric equivalent of the T-test is the Wilcoxon and thats absolutely perfect and described below together with the entire rationale for parametrics versus non-parametrics. Basically, I agree with your approach, except I would simply shift to non-parametric statistics.


I noted the response on Biostars from the link recommends DSeq2 and EdgeR. Both tests along with the additional test described below, along with the T-test, are used to identify whether each gene in the analysis is significantly up-, or down-regulated and can then be ranked. The underlying issue is the validity of the tests associated P-values.

Both DSeq2 and EdgeR have been notably criticised by Li et al 2022, in a paper entitled

Li et al 2022 Exaggerated false positives by popular differential expression methods when analyzing human population samples" Genome Biology: 79

Li et al (2022) needs to be read carefully before making a choice. Li et al 2022 is recommending using a non-parametric test, via Wilcoxon, which is implemented in the method NOIseq from the R-Cran Bioc library (described below). Genome Biology has a current impact factor of 18 (exceptional). I was told that one member of the DSeq2 team produced a later paper advocating non-parametrics methods.

The underlying issue is the dependency on a parametric distribution for both DSeq2 and EdgeR. Basically, the central issue is the validity of parametric statistics (assumed distribution) versus non-parametrics statics (no assumptions about the distribution).

In parametric statistics outside DE, i.e. in general, when these are used numerous tests are performed to assess the fit of the data set to the parametric distribution assumed. For example, for ANOVA it's the Fmax test. For a T-test there's a number of tests for the normal distribution. If the data set fails the test, a multitude of transformations are possible usually aimed at normalising the variance.

From this perspective the concern is no comparative tests were devised for DSeq2 or EdgeR given the age of the papers DSeq2 is from 2014 Love et al (2014). If there's no test how could the data use alternative transformations to fit the assumptions? Again this is unusual given the age of papers because such as tests would be expected.

Non-parameteric DEG

The non-parametric method mentioned, NOISeq, is from the R/ Bioc package by Tarazona et al 2015, Nucleic Acids:43. This was the approach use by Li et al 2015 and compared against both DSeq2 and EdgeR. There are more recent examples, again I believe one of the DSeq2 team produced a non-parametric DEG as well.

The GitHub page for Li et al 2022, is https://github.com/xihuimeijing/DEGs_Analysis_FDR


I understand the criticism recently stated about Wilcoxon (non-parametrics in general) is their reduced power (response on Biostars). What happens is you get fewer significant 'hits' that are under or over-expressed genes. This is the basic trade-off between parametrics vs. non-parametrics. The key issue is if you've trapped your key results within a non-parametric test, that is a very solid result. If the equivalent results are trapped using EdgeR or DSeq2 there is always going to be question mark whether it's a false positive.

When to use EdgeR/DSeq2: if you are doing alternative statistical tests on the expression data which are directly comparable with under- and over-expression (e.g. ML and DL analysis) thats okay because we know Edge/DSeq2 gives false positives. When I've done this there's a 'centre ground' which can give conflicting result, its the central quartile type area, i.e. 25 - 75% region (to be honest it can be a bit outside that).

If you are singly dependent on EdgeR, DSeq2 or NOISeq it is better to be conservative in my opinion, i.e. fewer hits which you are more certain about.

Final point The final issue is simply how close to the DSeq2 and EdgeR data sets is the data you are working with, i.e. same species? What I would caution is these distributions have been applied broadly across species. The extent of the false positive rate must vary in my opinion.

$\endgroup$

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.