A novel metric reveals previously unrecognized distortion in dimensionality reduction of scRNA-Seq data
Preprint posted on 2 July 2019 https://www.biorxiv.org/content/10.1101/689851v1
Your scRNA-seq analysis pipeline may be warping your data, due to dimensionality reduction.Selected by Suraj Kannan
What I like about this study:
I would like to highlight two aspects of this study. Firstly, the topic is simply critical to anyone who has ever analyzed scRNA-seq data (which is becoming increasingly ubiquitous in cellular biology). Dimensionality reduction is the first step in almost every algorithm and analysis pipeline, and a fundamental assumption is that this step preserves important (biologically-relevant) information from the original high-dimensional data. If in fact this step distorts the data, as the authors convincingly argue, biological conclusions from scRNA-seq data would need to be scrutinized. Secondly, this paper is exceptionally well-written. I appreciate that the authors use analogies and toy cases that are both illustrative and clear, even to those without a mathematics or statistical background.
scRNA-seq data is inherently high dimensional, with increasingly sensitive methods capable of detecting thousands of genes per cell. Higher dimensional data, while providing potentially more information, is more difficult to analyze – many algorithms fail to scale up to higher dimensions, for example [1, 2]. A large number of methods exist to transform high dimensional data to low dimensional data while preserving key aspects of the structure (see below for a toy example on several methods) . These methods, including the frequently used t-SNE and UMAP algorithms, underlie nearly all scRNA-seq analysis pipelines, including commonly used algorithms for clustering and trajectory analysis . A fundamental assumption is that dimensionality reduction preserves important structure in the high dimensional data or, at the very worst, does not skew the structure significantly.
The authors challenge this assumption using several illustrative cases. As a toy geometrical example, the authors first generated hyperspheres (generalizations of spheres to higher dimensions). In a clever approach, the authors generated lower dimensional hyperspheres in higher dimensions. For example, they could construct a 3-dimensional hypersphere in 5 dimensions by taking a vector of 3 numbers (the 3-dimensional hypersphere) and adding on 2 zeros at the end to make it 5-dimensional. It is trivial to reduce the dimensions of this sphere to 3 or 4 dimensions, e.g. transform the point [1 1 1 0 0] → [1 1 1 0] (4-dimension) or [1 1 1 0 0] → [1 1 1] (3 dimensions). Thus, the authors expected that standard dimensionality reduction techniques should readily succeed in transforming these hyperspheres to lower dimensions, or at the very least preserve local neighbors between different points. Instead, the authors found that even in this simple toy case, all of the methods introduced huge distortions, such that most points had hugely different neighboring points in low dimensions as compared to high dimensions. Increasing the number of points sampled did not improve the mapping but in fact made it worse.
The authors then used their approach to analyze dimensionality reduction of real scRNA-seq data. Consistently, they found huge distortions in data even when reducing to relatively high dimensions. This is particularly problematic as most pipelines reduce data to 2 or 3 dimensions (as these are easily visualized). Indeed, the authors tested several commonly used pipelines for clustering and trajectory generation and found that they are affected by dimensionality reduction.
This manuscript affects any research group using scRNA-seq techniques. As an example, in developmental biology a common approach is to reconstruct developmental trajectories of various lineages to study how cells differentiate and specify. If dimensionality reduction inherently skews the data, then the results of these analyses are questionable.
There is no question that these results are disturbing, and motivate the need to develop improved scRNA-seq pipelines (either by developing better dimensionality reduction methods or eliminating their need). In the meantime, however, I do wonder if current techniques are good enough for now, particularly for clustering. While local neighborhoods may be distorted, tSNE and UMAP plots do places cells with similar gene expression close to one another – this can be readily seen by plotting marker genes, for example. Particularly for smaller studies or studies where differences between cell types is clearly defined, tSNE and UMAP may suffice despite the distortions they may introduce. Likewise, while clearly dimensionality reduction does affect cell-to-cell distances, current trajectory reconstruction methods do at least partially correlate with other biological parameters (for example, developmental age). While we should be cautious about interpretation, I suspect that computational methods combined with biological intuition can at least be passable until better methods are developed.
 Stegle O, Teichmann SA, Marioni JC. Computational and analytical challenges in single-cell transcriptomics. Nat Rev Genet (2015), 16(3):133-45.
 Friedman JH. On Bias, Variance, 0/1 – Loss, and the Curse-of-Dimensionality. Data Mining and Knowledge Discovery (1997), 1:55-77.
 Manifold Learning, scikit documentation. Link: https://scikit-learn.org/stable/modules/manifold.html
Posted on: 16 August 2019
doi: https://doi.org/10.1242/prelights.13389Read preprint
Also in the bioinformatics category:
Insm1 regulates the development of mTECs and immune tolerance
Phosphoproteomics of cellular mechanosensing reveals NFATC4 as a regulator of myofibroblast activity
Sex-determining 3D regulatory hubs revealed by genome spatial auto-correlation analysis
Also in the genomics category:
Dissecting aneuploidy phenotypes by constructing Sc2.0 chromosome VII and SCRaMbLEing synthetic disomic yeast
Disrupting cellular memory to overcome drug resistance
Comparative developmental genomics of sex-biased gene expression in early embryogenesis across mammals
preListsbioinformatics category:in the
Alumni picks – preLights 5th Birthday
This preList contains preprints that were picked and highlighted by preLights Alumni - an initiative that was set up to mark preLights 5th birthday. More entries will follow throughout February and March 2023.
|List by||Sergio Menchero et al.|
The advances in fibroblast biology preList explores the recent discoveries and preprints of the fibroblast world. Get ready to immerse yourself with this list created for fibroblasts aficionados and lovers, and beyond. Here, my goal is to include preprints of fibroblast biology, heterogeneity, fate, extracellular matrix, behavior, topography, single-cell atlases, spatial transcriptomics, and their matrix!
|List by||Osvaldo Contreras|
Single Cell Biology 2020
A list of preprints mentioned at the Wellcome Genome Campus Single Cell Biology 2020 meeting.
|List by||Alex Eve|
Antimicrobials: Discovery, clinical use, and development of resistance
Preprints that describe the discovery of new antimicrobials and any improvements made regarding their clinical use. Includes preprints that detail the factors affecting antimicrobial selection and the development of antimicrobial resistance.
|List by||Zhang-He Goh|
Also in the genomics category:
Semmelweis Symposium 2022: 40th anniversary of international medical education at Semmelweis University
This preList contains preprints discussed during the 'Semmelweis Symposium 2022' (7-9 November), organised around the 40th anniversary of international medical education at Semmelweis University covering a wide range of topics.
|List by||Nándor Lipták|
20th “Genetics Workshops in Hungary”, Szeged (25th, September)
In this annual conference, Hungarian geneticists, biochemists and biotechnologists presented their works. Link: http://group.szbk.u-szeged.hu/minikonf/archive/prg2021.pdf
|List by||Nándor Lipták|
EMBL Conference: From functional genomics to systems biology
Preprints presented at the virtual EMBL conference "from functional genomics and systems biology", 16-19 November 2020
|List by||Jesus Victorino|
Preprints recently presented at the virtual Allied Genetics Conference, April 22-26, 2020. #TAGC20
|List by||Maiko Kitaoka et al.|
A compilation of cutting-edge research that uses the zebrafish as a model system to elucidate novel immunological mechanisms in health and disease.
|List by||Shikha Nayar|