--- title: "Exploring scRNA-seq data from 5 cancer cell lines with scBubbletree" author: "Simo Kitanovski (simo.kitanovski@uni-due.de)" output: BiocStyle::html_document vignette: > %\VignetteIndexEntry{User Manual: scBubbletree} %\VignetteEngine{knitr::rmarkdown} %\VignetteEncoding{UTF-8} --- ```{r setup, include = FALSE, warning = FALSE} knitr::opts_chunk$set(comment = FALSE, warning = FALSE, message = FALSE) ``` # Background Over the last decade, the size of scRNA-seq datasets has exploded to millions of cells sequenced in a single study. This allows us profile the transcriptomes of various cell types across tissues. The rapid growth of scRNA-seq data has also created an unique set of challenges, for instance, there is a pressing need for scalable approaches for scRNA-seq data visualization. This vignette introduces `r Biocpkg("scBubbletree")`, a transparent workflow for quantitative exploration of single cell RNA-seq data. In short, the algorithm of `r Biocpkg("scBubbletree")` performs clustering to identify clusters ("bubbles") of transcriptionally similar cells, and then visualizes these clusters as leafs in a hierarchical dendrogram ("bubbletree") which describes their relationships. The workflow comprises four steps: 1. determining the clustering resolution, 2. clustering, 3. hierarchical cluster grouping and 4. visualization. We explain each step in the following using scRNA-seq dataset of five cancer cell lines. To run this vignette we need to load a few packages: ```{r} library(scBubbletree) library(ggplot2) library(ggtree) library(patchwork) ``` # Data[^1] Here we will analyze a scRNA-seq data[^1] containing a mixture of 3,918 cells from five human lung adenocarcinoma cell lines (HCC827, H1975, A549, H838 and H2228). The dataset is available here[^2]. The library has been prepared with 10x Chromium platform and sequenced with Illumina NextSeq 500 platform. Raw data has been processed with Cellranger. The tool demuxlet has been used to predict the identity of each cell based on known genetic differences between the different cell lines. # Data processing Data processing was performed with the R-package `r CRANpkg("Seurat")`. Gene expressions were normalized with the function `r CRANpkg("SCTransform")` using default parameters, and principal component analysis (PCA) was performed with function *RunPCA* based on the 5,000 most variable genes in the dataset identified with the function *FindVariableFeatures*. In the data we saw that the first 15 principal components capture most of the variance in the data, and the proportion of variance explained by each subsequent principal component was negligible. Thus, we used the single cell projections (embeddings) in 15-dimensional feature space, $A^{3,918\times 15}$. ```{r} # # This script can be used to generate data("d_ccl", package = "scBubbletree") # # # create directory # dir.create(path = "case_study/") # # # download the data from: # https://github.com/LuyiTian/sc_mixology/raw/master/data/ # sincell_with_class_5cl.RData # # # load the data # load(file = "case_study/sincell_with_class_5cl.RData") # # # we are only interested in the 10x data object 'sce_sc_10x_5cl_qc' # d <- sce_sc_10x_5cl_qc # # # remove the remaining objects (cleanup) # rm(sc_Celseq2_5cl_p1, sc_Celseq2_5cl_p2, sc_Celseq2_5cl_p3, sce_sc_10x_5cl_qc) # # # get the meta data for each cell # meta <- colData(d)[,c("cell_line_demuxlet","non_mt_percent","total_features")] # # # create Seurat object from the raw counts and append the meta data to it # d <- Seurat::CreateSeuratObject(counts = d@assays$data$counts, # project = '') # # # check if all cells are matched between d and meta # # table(rownames(d@meta.data) == meta@rownames) # d@meta.data <- cbind(d@meta.data, meta@listData) # # # cell type predictions are provided as part of the meta data # table(d@meta.data$cell_line) # # # select 5,000 most variable genes # d <- Seurat::FindVariableFeatures(object = d, # selection.method = "vst", # nfeatures = 5000) # # # Preprocessing with Seurat: SCT transformation + PCA # d <- SCTransform(object = d, # variable.features.n = 5000) # d <- RunPCA(object = d, # npcs = 50, # features = VariableFeatures(object = d)) # # # perform UMAP + t-SNE # d <- RunUMAP(d, dims = 1:15) # d <- RunTSNE(d, dims = 1:15) # # # save the preprocessed data # save(d, file = "case_study/d.RData") # # # save the PCA matrix 'A', meta data 'm' and # # marker genes matrix 'e' # d <- get(load(file ="case_study/d.RData")) # A <- d@reductions$pca@cell.embeddings[, 1:15] # m <- d@meta.data # e <- t(as.matrix(d@assays$SCT@data[ # rownames(d@assays$SCT@data) %in% # c("ALDH1A1", # "PIP4K2C", # "SLPI", # "CT45A2", # "CD74"), ])) # # d_ccl <- list(A = A, m = m, e = e) # save(d_ccl, file = "data/d_ccl.RData") ``` Load the processed PCA matrix and the meta data ```{r} # Load the data data("d_ccl", package = "scBubbletree") ``` ```{r} # Extract the 15-dimensional PCA matrix A # A has n=cells as rows, f=15 features as columns (e.g. from PCA) A <- d_ccl$A dim(A) ``` ```{r} # Extract the meta-data. For each cell this data contains some # additional information. Inspect this data now! m <- d_ccl$m colnames(m) ``` ```{r} # Extract the normalized expressions of five marker genes. Rows # are cells. e <- d_ccl$e colnames(e) ``` # scBubbletree workflow We will analyze this data with `r Biocpkg("scBubbletree")`. As main input `r Biocpkg("scBubbletree")` uses matrix $A^{n\times f}$ which represents a low-dimensional projection of the original scRNA-seq data, with $n$ rows as cells and $f$ columns as low-dimension features. Here we use $A^{3,918\times 15}$ as input. **Important remark about $A$**: the `r Biocpkg("scBubbletree")` workflow works directly with the numeric matrix $A^{n\times f}$ and is agnostic to the initial data processing protocol. This enables seamless integration of `r Biocpkg("scBubbletree")` with computational pipelines using objects generated by the R-packages `r CRANpkg("Seurat")` and `r Biocpkg("SingleCellExperiment")`. The users simply have to extract $A$ from the corresponding `r CRANpkg("Seurat")` or `r Biocpkg("SingleCellExperiment")` objects. The `r Biocpkg("scBubbletree")` workflow performs the following steps: 1. determine the clustering resolution (resolution $r$ or clusters $k$) 2. graph-based community detection (e.g. with Louvain) or k-means clustering 3. hierarchical organization of clusters (bubbles) 4. visualization ## Determine the clustering resolution (**step 1**) How many clusters (cell types) are there are in the data? Before we apply clustering, we must first find appropriate value for the resolution parameter $k$ (if we intend to use k-means) or $r$ (if we intend to use graph based community detection approaches such as Louvain). In the next we will first perform Louvain clustering and then k-means clustering. ## Determining the resolution parameter $r$ for Louvain clustering How many clusters (cell types) are there are in the data? For Louvain clustering we need to select a clustering resolution $r$. Higher resolutions lead to more communities ($k'$) and lower resolutions lead to fewer communities. To find a reasonable value of $r$ we can study the literature or databases such as the human protein atlas database (HPA). We can also use the function `get_r` for data-driven inference of $r$ based on the Gap statistic. Lets use the function `get_r` for data-driven estimation of $r$ based on the Gap statistic and WCSS. As input we need to provide the matrix $A$ and a vector of $r$s to inspect. See the help function `?get_r` to learn more about the remaining input parameters. The output of `get_r` is the Gap statistic and WCSS estimate for each $r$ (or the number of communities $k'$ detected at resolution $r$). Lets run `get_r` now [this might take a minute]: ```{r} b_r <- get_r(B_gap = 5, rs = 10^seq(from = -4, to = 0.5, by = 0.5), x = A, n_start = 10, iter_max = 50, algorithm = "original", knn_k = 50, cores = 1) ``` The Gap curve has noticeable knee (elbow) at $r \approx 0.003$ (dashed gray line). Means (points) and 95% confidence intervals are shown for the Gap statistic at each $r$ using `B_gap`=5 MCMC simulations. ```{r, fig.width=4, fig.height=3} ggplot(data = b_r$gap_stats_summary)+ geom_line(aes(x = r, y = gap_mean))+ geom_point(aes(x = r, y = gap_mean), size = 1)+ geom_errorbar(aes(x = r, y = gap_mean, ymin = L95, ymax = H95), width = 0.1)+ ylab(label = "Gap")+ xlab(label = "r")+ geom_vline(xintercept = 0.003, col = "gray", linetype = "dashed")+ scale_x_log10()+ annotation_logticks(base = 10, sides = "b") ``` The resolutions $r$ are difficult to interpret. Lets map $r$ to the number of detected communities $k'$ (analogous to clusters $k$ in k-means clustering), and show the Gap curve as a function of $k'$. ```{r, fig.width=4, fig.height=3} ggplot(data = b_r$gap_stats_summary)+ geom_line(aes(x = k, y = gap_mean))+ geom_point(aes(x = k, y = gap_mean), size = 1)+ geom_errorbar(aes(x = k, y = gap_mean, ymin = L95, ymax = H95), width = 0.1)+ geom_vline(xintercept = 5, col = "gray", linetype = "dashed")+ ylab(label = "Gap")+ xlab(label = "k'") ``` A range of resolutions yield $k'$=5 number of communities, i.e. among the tested $r$s, we saw $k'$=5 communities for $r$ = 0.003, 0.01, 0.03 and 0.1. We can e.g. use $r$=0.1 for our clustering. ```{r, fig.width=4, fig.height=3, fig.align='center'} ggplot(data = b_r$gap_stats_summary)+ geom_point(aes(x = r, y = k), size = 1)+ xlab(label = "r")+ ylab(label = "k'")+ scale_x_log10()+ annotation_logticks(base = 10, sides = "b")+ theme_bw() ``` Table with $r$s that match to $k'$=5: ```{r} knitr::kable(x = b_r$gap_stats_summary[b_r$gap_stats_summary$k == 5, ], digits = 4, row.names = FALSE) ``` ## Determining the number of clusters $k$ for k-means clustering [**alternative**] If we want to use k-means for clustering, then we need to find a reasonable value of $k$, e.g. by applying once again a data-driven search for $k$ using `get_k`. Here `get_k` will inspect the Gap and WCSS at $k$ = 1, 2, ..., 10. ```{r} b_k <- get_k(B_gap = 5, ks = 1:10, x = A, n_start = 50, iter_max = 200, kmeans_algorithm = "MacQueen", cores = 1) ``` Notice the similar Gap curve with noticeable knee (elbow) at $k = 5$ (dashed gray line). Means (points) and 95% confidence intervals are shown for the Gap statistic at each $k$ using `B_gap`=5 MCMC simulations. ```{r, fig.width=4, fig.height=3} ggplot(data = b_k$gap_stats_summary)+ geom_line(aes(x = k, y = gap_mean))+ geom_point(aes(x = k, y = gap_mean), size = 1)+ geom_errorbar(aes(x = k, y = gap_mean, ymin = L95, ymax = H95), width = 0.1)+ ylab(label = "Gap")+ geom_vline(xintercept = 5, col = "gray", linetype = "dashed") ``` # Clustering (**step 2**) and hierarchical grouping (**step 3**) of bubbles ## Clustering with Louvain Now that we found out that $r=0.1$ ($k'=5$) is a reasonable choice based on the data, we will perform Louvain clustering with $r=0.1$ and $A$ as inputs. For this we will use the function `get_bubbletree_graph`. After the clustering is complete we will organize the bubbles by hierarchical clustering. For this we perform $B$ bootstrap iterations. In iteration $b$ the algorithm draws a random subset of $N_{\text{eff}}$ (default $N_{\text{eff}}=200$) cells with replacement from each cluster and compute the average inter-cluster Euclidean distances. This data is used to populate the distance matrix ($D^{k'\times k'}_{b}$), which is provided as input for hierarchical clustering with average linkage to generate a hierarchical clustering dendrogram $H_b$. The collection of distance matrices that are computed during $B$ iterations are used to compute a consensus (average) distance matrix ($\hat{D}^{k' \times k'}$) and from this a corresponding consensus hierarchical dendrogram (bubbletree; $\hat{H}$) is constructed. The collection of dendrograms are used to quantify the robustness of the bubbletree topology, i.e. to count the number of times each branch in the bubbletree is found among the topologies of the bootstrap dendrograms. Branches can have has variable degrees of support ranging between 0 (no support) and $B$ (complete support). Distances between bubbles (inter- bubble relationships) are described quantitatively in the bubbletree as sums of branch lengths. Steps 2. (clustering) and 3. (hierarchical grouping) are performed now: ```{r} l <- get_bubbletree_graph(x = A, r = 0.1, algorithm = "original", n_start = 20, iter_max = 100, knn_k = 50, cores = 1, B = 300, N_eff = 200, round_digits = 1, show_simple_count = FALSE) # See the help `?get_bubbletree_graph` to learn about the input parameters. ``` ... and plot the bubbletree ```{r, fig.width=4, fig.height=3, fig.align='center'} l$tree ``` Lets describe the bubbletree: **bubbles**: The bubbletree has `k'=5` bubbles (clusters) shown as leaves. The absolute and relative cell frequencies in each bubble and the bubble IDs are shown as labels. Bubble radii scale linearly with absolute cell count in each bubble, i.e. large bubbles have many cells and small bubbles contain few cells. Bubble 0 is the largest one in the dendrogram and contains 1,253 cells ($\approx$ 32% of all cells in the dataset). Bubble 4 is the smallest one and contains only 437 cells ($\approx$ 11% of all cells in the dataset). We can access the bubble data shown in the bubbletree ```{r} knitr::kable(l$tree_meta, digits = 2, row.names = FALSE) ``` **topology**: inter-bubble distances are represented by sums of branch lengths in the dendrogram. Branches of the bubbletree are annotated with their bootstrap support values (red branch labels). The branch support value tells us how many times a given branch from the bubbletree was found among the $B$ bootstrap dendrograms. We ran `get_bubbletree_graph` with $B=300$. All but one branch have complete (300 out of 300) support, and one branch has lower support of 270 (90%). This tells us that the branch between bubbles (3, 4) and 0 is not as robust. ## Clustering with k-means (**[alternative]**) To perform clustering with the k-means method we can use the function `get_bubbletree_kmeans`. ```{r} k <- get_bubbletree_kmeans(x = A, k = 5, cores = 1, B = 300, N_eff = 200, round_digits = 1, show_simple_count = FALSE, kmeans_algorithm = "MacQueen") ``` ## Comparison of bubbletree based on Louvain and k-means clustering The two dendrograms are shown side-by-side. ```{r, fig.width=6, fig.height=3, fig.align='center'} l$tree|k$tree ``` ## Visual comparison of two bubbletrees To compare a pair of bubbletrees generated based on the same data but with different inputs we can use the function `compare_bubbletrees`. The function generates two bubbletrees and a heatmap, where the tiles of the heatmap are color coded according to the jaccard distances ($J_D$s) between the pairs of bubbles from the two bubbletrees, and the tile labels show the numbers of cells in common between the bubbles. **Reminder of the Jaccard index ($J$) and the Jaccard distance ($J_{D}$)**: For clusters $A$ and $B$ we compute the Jaccard index $J(A,B)=\dfrac{|A \cap B|}{|A \cup B|}$ and distance $J_{D}(A,B) = 1-J(A,B)$. If $A$ and $B$ contain the same set of cells $J_{D}(A,B)$=0, and if they have no cells in common $J_{D}(A,B)$=1. The heatmap hints at nearly identical clusterings between the bubbletrees. Only 3 cells (red tiles with label = 1) are classified differently by the two bubbletrees. ```{r, fig.width=7, fig.height=7} cp <- compare_bubbletrees(btd_1 = l, btd_2 = k, ratio_heatmap = 0.6, tile_bw = F, tile_text_size = 3) cp$comparison ``` # Visualization (**step 4**) To extract biologically useful information from the bubbletree (and also for 2D UMAP or t-SNE plots) we need to adorn it with biologically relevant cell features. This includes both **numeric** and **categorical** cell features. Numeric cell features: * gene expression * % of mitochondrial transcripts * number of UMIs, genes detected * ... Categorical cell features: * cell type label (e.g. B-cells, T-cells, moncytes, ...) * cell cycle phase (e.g. S, M, G1, ...) * sample name (e.g. S1, S2, S3, ...) * treatment group (e.g. cancer vs. control cell) * multiplet status (e.g. singlet, doublet or multiplet) * ... In the next two paragraph we will explain how to 'attach' numeric and categorical features to the bubbletree using `r Biocpkg("scBubbletree")`. ## Attaching categorical features Categorical cell features can be 'attached' to the bubbletree using the function `get_cat_tiles`. Here we will show the relative frequency of cell type labels across the bubbles (parameter `integrate_vertical=TRUE`). Interpretation of the figure below: * we see high degree of co-occurrence between cell lines and bubbles, i.e. each bubble is made up of cells from a distinct cell line * for instance, 99.8% of cells that have feature HCC827 are found in bubble 3 * columns in the tile plot integrate to 100% ```{r, fig.width=7, fig.height=4, fig.align='center'} w1 <- get_cat_tiles(btd = l, f = m$cell_line_demuxlet, integrate_vertical = TRUE, round_digits = 1, x_axis_name = 'Cell line', rotate_x_axis_labels = TRUE, tile_text_size = 2.75) (l$tree|w1$plot)+ patchwork::plot_layout(widths = c(1, 1)) ``` We can also show the inter-bubble cell type composition, i.e. the relative frequencies of different cell types in a specific bubble (with parameter `integrate_vertical=FALSE`). Interpretation of the figure below: * the bubbles appear to be "pure" $\rightarrow$ made up of cells from distinct cell lines * the cell line composition of bubble 2 is: 0.1% H838, 99.6% H2228, 0.1% A549, 0.1% H1975 and 0% HCC827 cells * rows integrate to 100% (here the numbers in the heatmap tiles are rounded to the nearest tenth, hence they integrate approximately to 100%) ```{r, fig.width=7, fig.height=4, fig.align='center'} w2 <- get_cat_tiles(btd = l, f = m$cell_line_demuxlet, integrate_vertical = FALSE, round_digits = 1, x_axis_name = 'Cell line', rotate_x_axis_labels = TRUE, tile_text_size = 2.75) (l$tree|w2$plot)+patchwork::plot_layout(widths = c(1, 1)) ``` `r Biocpkg("scBubbletree")` uses R-package `r Biocpkg("ggtree")` to visualize the bubbletree, and `r CRANpkg("ggplot2")` to visualize annotations. Furthermore, R-package `r CRANpkg("patchwork")` is used to combine plots. ```{r, fig.width=9, fig.height=4, fig.align='center'} (l$tree|w1$plot|w2$plot)+ patchwork::plot_layout(widths = c(1, 2, 2))+ patchwork::plot_annotation(tag_levels = "A") ``` ## Gini impurity index To quantify the purity of a cluster (or bubble) $i$ with $n_i$ number of cells, each of which carries one of $L$ possible labels (e.g. cell lines), we can compute the Gini impurity index: $\textit{GI}_i=\sum_{j=1}^{L} \pi_{ij}(1-\pi_{ij})$, with $\pi_{ij}$ as the relative frequency of label $j$ in cluster $i$. In homogeneous (`pure`) clusters most cells carry a distinct label. Hence, the $\pi$'s are close to either 1 or 0, and *GI* takes on a small value close to zero. In `impure` clusters cells carry a mixture of different labels. In this case most $\pi$ are far from either 1 or 0, and *GI* diverges from 0 and approaches 1. If the relative frequencies of the different labels in cluster $i$ are equal to the (background) relative frequencies of the labels in the sample, then cluster $i$ is completely `impure`. To compute the overall Gini impurity of a bubbletree, which represents a clustering solution with $k$ bubbles, we estimated the weighted Gini impurity (*WGI*) by computing the weighted (by the cluster size) average of the $\textit{WGI}=\sum_{i=1}^{k} \textit{GI}_i \dfrac{n_i}{n}$, with $n_i$ as the number of cells in cluster $i$ and $n=\sum_i n_i$. The Gini impurity results are shown below: ```{r} # gini get_gini(labels = m$cell_line_demuxlet, clusters = l$cluster)$gi ``` All cluster-specific *GI*s are close to 0 and hence also *WGI* is close to 0. This indicates nearly perfect mapping of cell lines to bubbles. This analysis performed for different values of $r$ with function `get_gini_r`, which takes as main input the output of `get_k` or `get_r` ```{r} gini_boot <- get_gini_k(labels = m$cell_line_demuxlet, obj = b_r) ``` From the figure we can conclude that WGI drops to 0 at `k=5`, and all labels are nearly perfectly split across the bubbles with each bubble containing cells exclusively from one cell type. ```{r, fig.width=4, fig.height=3, fig.align='center'} g1 <- ggplot(data = gini_boot$wgi_summary)+ geom_point(aes(x = k, y = wgi), size = 1)+ ylab(label = "WGI")+ ylim(c(0, 1)) g1 ``` ## Attaching numeric features We can also "attach" numeric cell features to the bubbletree. We will "attach" the expression of five marker genes, i.e. one marker gene for each of the five cancer cell lines. We can visualize numeric features in *two* ways. First, we can show numeric feature aggregates (e.g. "mean", "median", "sum", "pct nonzero" or "pct zero") in the different bubbles with `get_num_tiles` ```{r, fig.width=8, fig.height=4, fig.align='center'} w3 <- get_num_tiles(btd = l, fs = e, summary_function = "mean", x_axis_name = 'Gene expression', rotate_x_axis_labels = TRUE, round_digits = 1, tile_text_size = 2.75) (l$tree|w3$plot)+patchwork::plot_layout(widths = c(1, 1)) ``` Second, we can visualize the distributions of the numeric cell features in each bubble as violins with `get_num_violins` ```{r, fig.width=10, fig.height=4, fig.align='center'} w4 <- get_num_violins(btd = l, fs = e, x_axis_name = 'Gene expression', rotate_x_axis_labels = TRUE) (l$tree|w3$plot|w4$plot)+ patchwork::plot_layout(widths = c(1.5, 2, 2.5))+ patchwork::plot_annotation(tag_levels = 'A') ``` ## Quality control with `r Biocpkg("scBubbletree")` What is the percent of UMIs coming from mitochondrial genes in each bubble? ```{r, fig.width=9, fig.height=4, fig.align='center'} w_mt_dist <- get_num_violins(btd = l, fs = 1-m$non_mt_percent, x_axis_name = 'MT [%]', rotate_x_axis_labels = TRUE) w_umi_dist <- get_num_violins(btd = l, fs = m$nCount_RNA/1000, x_axis_name = 'RNA count (in thousands)', rotate_x_axis_labels = TRUE) w_gene_dist <- get_num_violins(btd = l, fs = m$nFeature_RNA, x_axis_name = 'Gene count', rotate_x_axis_labels = TRUE) (l$tree|w_mt_dist$plot|w_umi_dist$plot|w_gene_dist$plot)+ patchwork::plot_layout(widths = c(1, 1, 1, 1))+ patchwork::plot_annotation(tag_levels = 'A') ``` # scBubbletree can incorporate results from other clustering approaches Numerous approaches exist for clustering of scRNA-seq data, and `r Biocpkg("scBubbletree")` implements the function `get_bubbletree_dummy` to allow users to incorporate results from various clustering approaches together with our workflow. With this function we skip the clustering portion of the workflow and proceed with computing distances between the clusters and generation of the bubbletree. Lets try `get_bubbletree_dummy`. First, will perform k-medoids clustering with R-package `r CRANpkg("cluster")` and then generate the bubbletree: ```{r, fig.width=6, fig.height=4, fig.align='center'} pam_k5 <- cluster::pam(x = A, k = 5, metric = "euclidean") dummy_k5_pam <- get_bubbletree_dummy(x = A, cs = pam_k5$clustering, B = 200, N_eff = 200, cores = 2, round_digits = 1) dummy_k5_pam$tree| get_cat_tiles(btd = dummy_k5_pam, f = m$cell_line_demuxlet, integrate_vertical = TRUE, round_digits = 1, tile_text_size = 2.75, x_axis_name = 'Cell line', rotate_x_axis_labels = TRUE)$plot ``` # Summary `r Biocpkg("scBubbletree")` promotes simple and transparent visual exploration of scRNA-seq. It is **not a black-box approach** and the user is encouraged to explore the data with different values of $k$ and $r$ or custom clustering solutions. Attaching of cell features to the bubbletree is necessary for biological interpretation of the individual bubbles and their relationships which are described by the bubbletree. [^1]: https://doi.org/10.1038/s41592-019-0425-8 [^2]: https://github.com/LuyiTian/sc_mixology/blob/master/data/ sincell_with_class_5cl.RData [^3]: https://doi.org/10.1101/2023.03.09.531263 # Session Info ```{r} sessionInfo() ```