- Open Access
Integrative analysis of histopathological images and chromatin accessibility data for estrogen receptor-positive breast cancer
BMC Medical Genomics volume 13, Article number: 195 (2020)
Existing studies have demonstrated that the integrative analysis of histopathological images and genomic data can be used to better understand the onset and progression of many diseases, as well as identify new diagnostic and prognostic biomarkers. However, since the development of pathological phenotypes are influenced by a variety of complex biological processes, complete understanding of the underlying gene regulatory mechanisms for the cell and tissue morphology is still a challenge. In this study, we explored the relationship between the chromatin accessibility changes and the epithelial tissue proportion in histopathological images of estrogen receptor (ER) positive breast cancer.
An established whole slide image processing pipeline based on deep learning was used to perform global segmentation of epithelial and stromal tissues. We then used canonical correlation analysis to detect the epithelial tissue proportion-associated regulatory regions. By integrating ATAC-seq data with matched RNA-seq data, we found the potential target genes that associated with these regulatory regions. Then we used these genes to perform the following pathway and survival analysis.
Using canonical correlation analysis, we detected 436 potential regulatory regions that exhibited significant correlation between quantitative chromatin accessibility changes and the epithelial tissue proportion in tumors from 54 patients (FDR < 0.05). We then found that these 436 regulatory regions were associated with 74 potential target genes. After functional enrichment analysis, we observed that these potential target genes were enriched in cancer-associated pathways. We further demonstrated that using the gene expression signals and the epithelial tissue proportion extracted from this integration framework could stratify patient prognoses more accurately, outperforming predictions based on only omics or image features.
This integrative analysis is a useful strategy for identifying potential regulatory regions in the human genome that are associated with tumor tissue quantification. This study will enable efficient prioritization of genomic regulatory regions identified by ATAC-seq data for further studies to validate their causal regulatory function. Ultimately, identifying epithelial tissue proportion-associated regulatory regions will further our understanding of the underlying molecular mechanisms of disease and inform the development of potential therapeutic targets.
Cancer heterogeneity results in tumors that exhibit distinct clinical features, therapeutic responses and patient outcomes. Understanding the factors involved in the onset and progression of cancers is pivotal for diagnosis and treatment. One of the main factors that contributes to the development of cancer is genetic changes [1,2,3]. However, the developmental process from genetic alterations to cancer phenotypes is complex and many mechanisms are still unknown. One way to uncover these mechanisms is through the integration of biomedical images with omics data [4,5,6].
Histopathology images are generally considered the gold standard for cancer diagnosis and grading in the clinic since they provide the distribution patterns of different tissues and cell types in the tumor microenvironment . Previous studies have shown that spatial features, such as epithelial and stromal tissue proportion, derived from a single whole-slide tissue image represent rich histopathological information that can be quantified and used in statistical and biological analysis [8,9,10]. The identification and quantification of epithelial and stromal tissues on histopathological images can uncover spatial features of tumor phenotypes. These image-based features can be further integrated with genetic data to investigate the molecular regulatory mechanisms behind cancer phenotypes using statistical analysis methods.
The systematic integration of histopathological studies and omics profiles is expected to provide further understanding of tumor molecular biology and potentially more accurate stratification of patient prognoses. Recent reports have highlighted the significance of the contribution of stromal gene expression and morphological structure as powerful prognostic determinants for a number of tumor types [11,12,13]. However, gene expression signatures are affected by many factors, including the tumor environment, while gene regulatory landscapes are more stable among cells . The regulatory landscape of a gene is specified by the overlying chromatin conformation, which may be more suitable for studying the potential effect of genomic changes at the bio-image level. To date, gene regulatory landscapes in tumors have largely been inferred through indirect means and little is known regarding the regulatory links between cancer gene expression and image features. During the past decade, the assay of chromatin accessibility has evolved into a powerful method to explore the regulatory landscape of primary human cancers [15,16,17]. The accessible genomic areas of chromatin are enriched with transcriptional regulatory elements which are crucial to gene expression, cell proliferation and tumor development. Several groups have reported that certain regulatory elements switch from inactive to active states (or vice versa) during the progression of diseases [18, 19]. This kind of global chromatin accessibility change can be detected and quantified by the assay for transposase-accessible chromatin using sequencing (ATAC-seq) . Also, chromatin accessibility as a surrogate for regulatory element activity is arguably a continuous signal. In bulk sequencing, more reads aligning to a specific location of a chromosome would indicate more cells in the population have open chromatin at that particular site. We further inferred that such detectable chromatin accessibility differences, in turn, can induce changes in morphological features of tumor tissues that are quantified as spatial characteristics.
To study the association between chromatin accessibility changes and tumor phenotypes, images of tumor sections and ATAC-seq data from matched tumor samples are needed. The Cancer Genome Atlas (TCGA) contains histopathology images along with clinical outcomes and has recently generated high-quality ATAC-seq data in tumor samples from 54 estrogen-receptor (ER)-positive breast cancer (BRCA) patients. These large-scale experimental datasets make comprehensive integrative and correlative analyses feasible.
Most breast cancers are carcinomas that arise from the epithelial components of the lobules and ducts in mammary glands. Studies focused on developing tissue classification and segmentation algorithms have referred to tumors as epithelial tissues in image processing tasks [21, 22]. Following this terminology, we previously proposed a deep-learning-based image processing framework to estimate the epithelial tissue proportion on histopathological images for breast cancers. These image analysis results were used to analyze the relationship between epithelial tissue proportion and gene expression data . Numerous genes were observed that were associated with the epithelial tissue proportion based on our pipeline. However, this analysis was not able to determine whether expression of these genes might be causal or might have resulted from changes in epithelial tissue proportion due to the complexity of the gene co-expression networks. To identify causal genes, additional analysis incorporating other omics information is required.
In this study, our aim was to identify key genomic regulatory regions that were associated with histological characteristics and thus, potentially impact clinical outcome. Such regions would be important for investigating the etiology of the associated disease and for identifying potential therapeutic targets.
In this work, we systematically explored the relationship between chromatin accessibility changes and epithelial tissue proportion. First, we used our new computational pipeline to quantify the epithelial tissue proportion from each sample. By performing correlation analysis, we observed that the change in chromatin accessibility of some specific open regions were strongly correlated with the change in epithelial tissue proportion across all samples. Then we implemented a strategy of linking DNA regulatory elements to their target genes based on the correlation of ATAC-seq and gene expression data. Downstream pathway analysis demonstrated that those target genes enriched in breast cancer-specific biological processes were associated with well-known oncogenes. Furthermore, we showed that the identified target genes could effectively predict overall survival of BRCA patients. In summary, the integration of the multi-omics data and histopathological images can provide new insights to explore the drivers and the molecular mechanism of ER-positive breast cancer.
Overall strategy and image processing for the integrative analysis
The overall strategy of our integrative analysis comprises three stages as shown in Fig. 1. First, a convolutional neural network (CNN)-based model was used to identify the epithelial and stromal tissues from one whole-slide image for each patient. The epithelial tissue proportion was calculated based on the identified epithelial and stromal tissue area from the hemotoxin and eosin (H&E) stained slide. Second, to screen for the potential regulatory regions that share consistent correlation patterns with tumor development, we calculated the Spearman correlation coefficient between the epithelial tissue proportion and the quantitative chromatin accessibility for each detected open chromatin region in the ATAC-seq data across all 54 samples. Then, focusing on the significantly associated epithelial tissue proportion-open chromatin regions, we linked them to their potential target genes based on the Spearman correlation of ATAC-seq accessibility and gene expression values across all samples. Lastly, we conducted functional enrichment and pathway analysis to evaluate whether these potential target genes were enriched in BRCA-related pathways and well-known oncogenes. The target genes of epithelial tissue proportion-correlated regulatory regions were used to predict patient survival by performing a machine learning prognosis prediction method.
We have previously developed an image processing pipeline that was used to classify and quantify epithelial tissue areas on histopathological images for all of the ER-positive breast cancer cases in TCGA. The image processing pipeline consists of three steps: 1) identification of a region of interest (ROI) on a whole-slide image; 2) patch-level segmentation of epithelial and stromal tissues in the ROI using a CNN model; 3) creation of a global tissue segmentation map by merging patch-level results followed by estimation of epithelial tissue proportions. For all 773 ER-positive patients, the previous image analysis results showed that these cases were enriched with stromal tissues, with a mean epithelial tissue proportion lower than 0.3 . Here, we specifically focused on the epithelial tissue proportion of the ER-positive cases with paired ATAC-seq and image data (n = 54) to identify the associated open chromatin regions. The epithelial tissue proportion data of the 54 TCGA ER-positive breast cancer cases is provided in Additional file 2: Table S1. The distribution of epithelial tissue proportions for the 54 ER-positive breast cancer cases used in this study compared to all 773 cases in TCGA is shown in Fig. 2. Epithelial tissue proportions which were larger than or equal to 0.5 were classified as epithelial-high, while proportions smaller than 0.5 were classified as epithelial-low (Additional file 1: Fig. S1). We observed that 87% (47/54) of the cases used in this study had low epithelial tissue proportions (values smaller than 0.5) compared to 89% (691/773) of all ER-positive cases in TCGA. Therefore, the distribution of epithelial tissues in the 54 cases used in this study appears to be representative of the entire TCGA ER-positive group.
Correlation analysis reveals the open chromatin regions related to epithelial spatial characteristics
For each detected open chromatin region, we asked whether this potential regulatory region might have contributed to tumor development in ER-positive breast cancer patients. To begin to address this question, we implemented canonical correlation analysis between the quantitative chromatin accessibility measure and the epithelial tissue proportion across all 54 patients.
The Spearman correlation coefficient, r, was used to evaluate whether the potential regulatory regions were significantly correlated with the epithelial tissue proportion. A total of 215,920 open chromatin regions were analyzed. Multiple testing correction (FDR < 0.05) is used to account for false positives. This analysis showed that 436 regulatory regions were significantly correlated with the epithelial tissue proportion, 111 of which were positively correlated and the other 325 were negatively correlated. The ATAC-seq peak signal data of 54 TCGA ER-positive BRCA cases is provided in Additional file 2: Table S2 and a complete list of these regulatory regions can be found in Additional file 2: Table S3. In addition, the peak ID, the start and end positions of the peak, and the p-value and the FDR of the correlation analysis, can be viewed on our RShiny website (https://yunlongliulab.shinyapps.io/omics-image/).
Examples of the correlation between chromatin accessibility and spatial quantification of epithelial tissues are presented in Fig. 3. For the peaks BRCA_203834 and BRCA_100454, the correlation analysis detected a significant positive correlation between the quantitative chromatin accessibility and the epithelial tissue proportion (Fig. 3a-b). A positive correlation indicates that larger epithelial tissue areas appear to have more accessible open chromatin regions. This finding suggests that the regulatory elements in such regions could potentially enhance tumor tissue development. On the contrary, a clear negative correlation between the quantitative chromatin accessibility and the epithelial tissue proportion was observed for peaks BRCA_165489 and BRCA_120633 (Fig. 3c-d). A negative correlation suggests that accessible chromatin regions that are associated with smaller epithelial tissue areas in the tumor might be repressed by regulatory elements in these regions. Taken together, these results demonstrate that this correlation analysis can identify epithelial tissue proportion-associated regulatory regions from ATAC-seq data, which could potentially implicate regulatory elements responsible for cancer development.
Linking DNA regulatory elements to target genes
We next asked whether the epithelial tissue proportion-associated regulatory regions identified by the correlation analysis could be related to elements of the breast cancer pathway. To address this question, we first identified candidate target genes for the regulatory regions that significantly correlated with the epithelial tissue proportion (see Methods). For putative promoter regions, the closest gene to each region was considered as the target gene. However, because enhancer regions can be far away from their target genes, we used the predicted distal peak-to-gene links obtained from TCGA .
In total, 77 regulatory regions were in promoter regions, which we considered as potential promoter regulatory elements, while another 21 regulatory regions were detected by distal peak-to-gene links (< 500 kbp), which we considered potential enhancer regulatory elements. Many of these peak-to-gene links occurred in clusters that were predicted to be linked to the same gene, resulting in a total of 74 target genes that were selected for further downstream analysis. A complete list of these peak-to-gene links and target genes can be found in Additional file 2: Table S4. Since the distal peak-to-gene links were based on the correlation of ATAC-seq accessibility and gene expression across all samples (see Methods), the target genes can be further divided into two groups according to whether the expression data were positively or negatively correlated with the epithelial tissue proportion. Among the 74 target genes, 22 of them were positively correlated with the epithelial tissue proportion while the other 52 genes were negatively correlated. Some important breast cancer and tumor oncogenes, such as PARI, CCNE2 and RAD54B, were detected to have positive correlations with epithelial tissue proportion in our study. Previous studies have demonstrated that PARI overexpression was correlated with aggressive tumor cell proliferation and poor prognosis in breast cancer , high expression of CCNE2 in breast cancer is strongly predictive of shorter distant metastasis-free survival following endocrine therapy  and RAD54B potentiates tumor growth and predicts poor prognosis of breast cancer patients .
For these 74 target genes, we performed pathway and function enrichment analysis using Ingenuity Pathway Analysis (IPA). We further observed that these genes were enriched in breast cancer-related pathways and functions, especially genes that were positively correlated with epithelial tissue proportion (Fig. 4). For instance, the breast cancer-crucial pathways, Estrogen-mediated S-phase Entry and Breast Cancer Regulation by Stathmin1, were significant findings from our integrative analysis. In addition, some tissue development and disorder associated functions were specifically enriched, such as Connective Tissue Disorders and Developmental Disorder. Altogether, these results underscore the ability to utilize our integrative analysis of image and chromatin accessibility data to identify genes that play a role in breast cancer development.
Integrative analysis enhances the prognostic prediction power
We next asked whether the integrative analysis could better predict patient prognosis. To address this question, we first examined the performance of patient stratification when using image features or the target genes alone. For the survival analysis, we used additional ER-positive breast cancer cases with paired histopathological images, gene expression data and survival data available from the TCGA-BRCA cohort. Cases with missing expression data or histopathological images were excluded, leaving a selected set of 663 samples. Target gene expression data and clinical information of these 663 TCGA ER-positive breast cancer cases can be found inAdditional file 2: Table S5. Univariate analysis showed that the epithelial tissue proportion was significantly related to prognosis (Fig. 5a), as were 37.8% (28/74) of the target genes (p-value < 0.05). The log-rank test results of all survival-related variables are listed in Additional file 2: Table S6. These results showed that many individual target genes derived from the integrative analysis stratified patients with distinct prognosis. For example, cases with high expression of BCL3 had significantly worse overall survival than those with low BCL3 expression (p = 0.004, Fig. 5b). Previous studies have proven BCL3 as an independent prognostic factor . Based on this finding, we performed a multivariate survival analysis using all of the significant univariate features to further investigate whether the integrative analysis would provide better prognostic prediction. As shown in Figs. 5c & d, the integrated multi-modal feature achieved superior stratification performance compared to using the image- or omics-features alone (pgenes + image = 7.23e-06, pgenes = 4.37e-05, pimage = 8.74e-04, psingle gene = 0.004). It is noteworthy that the patients with relatively low epithelial tissue proportions showed longer survival (Fig. 5a), which likely reflects the fact that most breast cancers are epithelial tissues and a lower epithelial tissue proportion corresponds to a smaller area of cancer cells. Taken together, these results suggest that the prognostic model based on the target genes and epithelial tissue proportions identified using our integrative framework can be used to effectively guide the risk stratification of ER-positive breast cancer.
The integration of biomedical images with different kinds of omics data has the potential to identify new biomarkers and improve mechanistic understanding of diseases. Nevertheless, screening for the true image feature-associated genomic regulatory regions remains a challenging problem. In this study, we introduced an integrative analysis framework, based on ATAC-seq data and matched histopathological whole-slide images, for detecting gene regulatory regions that correlated with the proportion of epithelial tissue in ER-positive breast cancer.
The major conclusion of this study is that by integrating histopathological images with ATAC-seq data, we can efficiently evaluate associations between chromatin accessibility changes and the epithelial tissue proportion. This conclusion is based on the following evidence: First, we detected epithelial tissue proportion-associated open chromatin regions using canonical correlation analysis. Second, we provided evidence that the target genes of these detected regulatory regions tended to be enriched for breast cancer-related pathways. Interestingly, we found that 40.5% (30/74) of the target genes identified in this study were also identified in our previous work, which directly analyzed the relationship between the epithelial tissue proportion and gene expression data . Importantly, 25 of these 30 genes have been described as breast cancer-associated genes in the literature. For example, independent breast cancer studies have shown that AKT1 suppresses migration and metastasis [28,29,30] and BCL3 inhibits apoptosis and tumor progression . The enrichment results from our integrative study further support the evidence of how these identified genes contribute to the epithelial tissue proportion. Although some genes, such as DHX34 and RELB, have not yet been shown to be directly related to breast cancer, it’s possible that they could lead to the discovery of new breast cancer related genes or biomarkers. Finally, we found that the integration of identified genes with the epithelial tissue proportion can better stratify patient prognosis compared to either alone. Collectively, these findings demonstrate that the integrative analysis approach presented here can be used to identify potential epithelial tissue proportion-associated regulatory regions, and thereby further our understanding of the molecular mechanisms of complex diseases.
While the integrated analysis approach used in this study revealed a relationship between image morphological and genomic features, there are limitations to this study. First because obtaining matched ATAC-seq and image datasets is challenging, only 54 ER-positive breast cancer samples were used in the correlation analysis. As a result, pairwise correlations between specific chromatin accessibility changes and the image-based epithelial tissue proportion could not be validated in other datasets, which could introduce dataset-specific bias such that the detected open chromatin regions may not represent all regulatory regions in this tumor type. A second limitation is that only the epithelial tissue proportion was used as an image feature in this study. The tumor microenvironment is a complex system and histopathological images demonstrate a complicated distribution of different tissues and cell types. Other histopathological image features have proven to be important for the diagnosis and prognosis of breast cancer, such as the textural features of epithelial tissue [32, 33] and the spatial relationship between tumor cells and tumor-infiltrating lymphocytes [34, 35]. Extracting such features requires a more elaborate image processing system which could identify not only tissues but also different cells. Despite these limitations, our findings should apply more generally to other ER-positive breast cancer cases because of the relatively stringent correlation coefficient (r > 0.5) and the multiple testing correction (FDR < 0.5) that were used to minimize false positive findings. Furthermore, the distribution of the epithelial tissues in the 54 cases used in this study were consistent with those in the entire TCGA ER-positive breast cancer cohort, which further supports the generalizability of our findings.
Our future studies will extend this framework to incorporate additional representative image features to further investigate the intrinsic relationship between genotypes and clinical phenotypes. Future comparative ATAC-seq experiments with normal samples are needed to verify our findings. Additionally, to further understand the genetic basis of this disease, future studies could integrate our algorithm with rare variant or eQTL analysis.
Our analysis demonstrates the ability to integrate chromatin accessibility signals and histological images for exploring the drivers and molecular mechanisms of ER-positive breast cancer. This integrated analysis will enable efficient prioritization of gene regulatory regions identified by correlation studies for further studies to validate their causal regulatory function. Ultimately, identifying regulatory regions and their target genes will further our understanding of the underlying molecular mechanisms of breast cancer. Furthermore, the entire pipeline can be easily applied to different diseases.
Chromatin accessibility data, gene expression data, H&E-stained whole-slide histopathology images and matched clinical information were obtained from TCGA and can be downloaded from the link provided in the Data Availability section. Both the ATAC-seq and mRNA expression data were obtained from frozen tissue sections in proximity to the sections that were used to generate the H&E-stained tissue slides . The 74 BRCA samples with quantitative chromatin accessibility data were obtained from TCGA ATAC-seq cohort. Among these, 58 samples were categorized as ER-positive, based on the clinical annotation data. Matched histopathological images and gene expression data for 1000 breast cancer cases were obtained from TCGA BRCA cohort. Among these, 663 samples were categorized as ER-positive and were chosen for the survival analysis. Four samples from the ATAC-seq cohort with missing image data were excluded. The remaining 54 ER-positive breast cancer samples were chosen for correlation analysis. Demographic and clinical characteristics of the selected cases used in this study are listed in Table 1.
The TCGA BRCA cohort provides two types of H&E stained whole-slide images: tissue slides and diagnostic slides. Tissue slides are sections from frozen tumor specimens that are typically used to determine whether the tumor borders are clean. Diagnostic slides are formalin-fixed paraffin-embedded (FFPE) sections, which typically have better preservation of cell morphology; however, these sections frequently show areas with tissue damage. Only tissue slides were used for the histopathological images in this study. Histopathological images were downloaded in the native image format as Aperio SVS files. Each image was acquired at a 40X objective lens using Aperio Scanscope, with each pixel corresponding to a 0.24 × 0.24 square micron area.
Algorithm for tissue quantification on tissue slides
We used our previously described whole-slide image-processing framework  to calculate the epithelial tissue proportion from histopathological images. This framework first employed a convolutional neural network (CNN) segmentation model to classify the epithelial and stromal tissues. The CNN model was trained on an independent image cohort and validated on TCGA tissue slides. Then based on the tissue segmentation results derived from CNN model, we calculated the epithelial tissue proportion as:
where Proportionepi represents the epithelial tissue proportion and Areaepi and Areastro represent the epithelial and stromal tissue area identified by the CNN model, respectively.
Omics-image correlation analysis
Associations between chromatin accessibility changes and the epithelial tissue proportion were determined using canonical correlation analysis. Specifically, for each detected open chromatin region, chromatin accessibility was quantified using the normalized count from that specific region for each case. The Spearman correlation coefficients r between each quantitative chromatin accessibility and epithelial tissue proportion were calculated across all ER-positive BRCA cases. Given the correlation coefficient r and the sample size, the P-value for the correlation coefficient was calculated using the exact permutation distributions for the two-tailed test. The FDR was calculated following the Benjamini–Hochberg procedure . Finally, open chromatin regions were considered significantly correlated with epithelial tissue proportions when FDR < 0.05.
Linking DNA regulatory elements to genes
To associate regulatory regions with the genes they are predicted to regulate, we adopted the same procedure as TCGA . Specifically, a promoter region was defined to lie within 1000 to 100 bp upstream of transcription start site (TSS). The promoter peak-to-gene mapping information was derived from peak summits located within the promoter region of a gene.
The distal peak-to-gene link was based on the correlation of ATAC-seq accessibility and gene expression across all samples. All peaks whose summit were located within 500 kbp from a gene’s TSS were considered. A conservative FDR cutoff of 0.01 was used to avoid false positives. Putative enhancer peaks were further filtered if (i) the correlation with gene expression was strongly driven by DNA copy number amplification, or (ii) links involved an ATAC-seq peak that overlapped the promoter of any gene.
Canonical pathway and function enrichment analysis
Ingenuity Pathways Analysis (IPA, Qiagen) was used to explore possible signaling pathways and functions for genes whose regulatory region was correlated with epithelial tissue proportion. IPA core analyses was conducted for each identified gene using experimentally observed knowledge in the Ingenuity Knowledge Base. Pathway analysis was conducted using Canonical Pathways and function analysis was derived from Diseases & Functions.
Machine-learning methods for prognostic prediction
For the univariate survival analysis, we used the median value of each feature to stratify cases into low-risk and high-risk groups. The Kaplan-Meier method and log-rank test were used to fit the survival data and test for survival difference between the two groups.
For the multivariate survival analysis, a previously described method utilizing a k-means clustering algorithm  was implemented to aggregate the patients into low-risk and high-risk groups, before testing if these 2 subgroups had distinct survival outcomes using the log-rank test.
Availability of data and materials
Promoter peak location information was obtained from the file (https://atacseq.xenahubs.net/download/brca/brca_peak_Log2Counts_dedup_promoter).
Enhancer peak location information was obtained from the file (https://atacseq.xenahubs.net/download/brca/brca_peak_Log2Counts_dedup_hQlinkage).
Assay for transposase-accessible chromatin using sequencing
The Cancer Genome Atlas
Convolutional neural network
Transcription start site
Hemotoxin and eosin
Prat A, Perou CM. Mammary development meets cancer genomics. Nat Med. 2009;15(8):842–4.
Hanahan D, Weinberg Robert A. Hallmarks of cancer: the next generation. Cell. 2011;144(5):646–74.
Yu CY, Xiang S, Huang Z, Johnson TS, Zhan X, Han Z, Abu Zaid M, Huang K. Gene co-expression network and copy number variation analyses identify transcription factors associated with multiple myeloma progression. Front Genet. 2019;10:468.
Yuan Y, Failmezger H, Rueda OM, Ali HR, Gräf S, Chin S-F, Schwarz RF, Curtis C, Dunning MJ, Bardwell H, et al. Quantitative image analysis of cellular heterogeneity in breast tumors complements genomic profiling. Sci Transl Med. 2012;4(157):157ra143.
Wang C, Su H, Yang L, Huang K. Integrative analysis for lung adenocarcinoma predicts morphological features associated with genetic variations. Pac Symp Biocomput. 2017;22:82–93.
Popovici V, Budinská E, Čápková L, Schwarz D, Dušek L, Feit J, Jaggi R. Joint analysis of histopathology image features and gene expression in breast cancer. BMC Bioinformatics. 2016;17(1):209.
Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J, Madabhushi A. Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imaging. 2016;35(1):119–30.
McIntire PJ, Irshaid L, Liu Y, Chen Z, Menken F, Nowak E, Shin SJ, Ginter PS. Hot spot and whole-tumor enumeration of CD8+ tumor-infiltrating lymphocytes utilizing digital image analysis is prognostic in triple-negative breast cancer. Clin Breast Cancer. 2018;18(6):451–458.e451.
Wang S, Chen A, Yang L, Cai L, Xie Y, Fujimoto J, Gazdar A, Xiao G. Comprehensive analysis of lung cancer pathology images to discover tumor shape and boundary features that predict survival outcome. Sci Rep. 2018;8(1):10393.
Kramer CJH, Vangangelt KMH, van Pelt GW, Dekker TJA, Tollenaar RAEM, Mesker WE. The prognostic value of tumour-stroma ratio in primary breast cancer with special attention to triple-negative tumours: a review. Breast Cancer Res Treat. 2019;173(1):55–64.
Calon A, Lonardo E, Berenguer-Llergo A, Espinet E, Hernando-Momblona X, Iglesias M, Sevillano M, Palomo-Ponce S, Tauriello DVF, Byrom D, et al. Stromal gene expression defines poor-prognosis subtypes in colorectal cancer. Nat Genet. 2015;47(4):320–9.
Finak G, Bertos N, Pepin F, Sadekova S, Souleimanova M, Zhao H, Chen H, Omeroglu G, Meterissian S, Omeroglu A, et al. Stromal gene expression predicts clinical outcome in breast cancer. Nat Med. 2008;14(5):518–27.
Isella C, Terrasi A, Bellomo SE, Petti C, Galatola G, Muratore A, Mellano A, Senetta R, Cassenti A, Sonetto C, et al. Stromal contribution to the colorectal cancer transcriptome. Nat Genet. 2015;47(4):312–9.
Satpathy AT, Granja JM, Yost KE, Qi Y, Meschi F, McDermott GP, Olsen BN, Mumbach MR, Pierce SE, Corces MR, et al. Massively parallel single-cell chromatin landscapes of human immune cell development and intratumoral T cell exhaustion. Nat Biotechnol. 2019;37(8):925–36.
Dunham I, Kundaje A, Aldred SF, Collins PJ, Davis CA, Doyle F, Epstein CB, Frietze S, Harrow J, Kaul R, et al. An integrated encyclopedia of DNA elements in the human genome. Nature. 2012;489(7414):57–74.
Corces MR, Granja JM, Shams S, Louie BH, Seoane JA, Zhou W, Silva TC, Groeneveld C, Wong CK, Cho SW, et al. The chromatin accessibility landscape of primary human cancers. Science. 2018;362(6413):eaav1898.
Pajoro A, Madrigal P, Muiño JM, Matus JT, Jin J, Mecchia MA, Debernardi JM, Palatnik JF, Balazadeh S, Arif M, et al. Dynamics of chromatin accessibility and gene regulation by MADS-domain transcription factors in flower development. Genome Biol. 2014;15(3):R41.
Denny SK, Yang D, Chuang C-H, Brady JJ, Lim JS, Grüner BM, Chiou S-H, Schep AN, Baral J, Hamard C, et al. Nfib promotes metastasis through a widespread increase in chromatin accessibility. Cell. 2016;166(2):328–42.
Scott-Browne JP, López-Moyado IF, Trifari S, Wong V, Chavez L, Rao A, Pereira RM. Dynamic changes in chromatin accessibility occur in CD8+ T cells responding to viral infection. Immunity. 2016;45(6):1327–40.
Buenrostro JD, Wu B, Chang HY, Greenleaf WJ. ATAC-seq: a method for assaying chromatin accessibility genome-wide. Curr Protoc Mol Biol. 2015;109:21.29.21–9.
Xu J, Luo X, Wang G, Gilmore H, Madabhushi A. A deep convolutional neural network for segmenting and classifying epithelial and stromal regions in histopathological images. Neurocomputing. 2016;191:214–23.
Al-Milaji Z, Ersoy I, Hafiane A, Palaniappan K, Bunyak F. Integrating segmentation with deep learning for enhanced classification of epithelial and stromal tissues in H&E images. Pattern Recogn Lett. 2019;119:214–21.
Lu Z, Zhan X, Wu Y, Cheng J, Shao W, Ni D, Han Z, Zhang J, Feng Q, Huang K. A deep learning approach for tissue spatial quantification and genomic correlations of histopathological images. bioRxiv. 2020. https://doi.org/10.1101/2020.03.10.985887.
Pitroda SP, Bao R, Andrade J, Weichselbaum RR, Connell PP. Low recombination proficiency score (RPS) predicts heightened sensitivity to DNA-damaging chemotherapy in breast Cancer. Clin Cancer Res. 2017;23(15):4493–500.
Caldon CE, Sergio CM, Kang J, Muthukaruppan A, Boersma MN, Stone A, Barraclough J, Lee CS, Black MA, Miller LD, et al. Cyclin E2 overexpression is associated with endocrine resistance but not insensitivity to CDK2 inhibition in human breast cancer cells. Mol Cancer Ther. 2012;11(7):1488.
Zhang Z, Li X, Han Y, Ji T, Huang X, Gao Q, Ma D. RAD54B potentiates tumor growth and predicts poor prognosis of patients with luminal a breast cancer. Biomed Pharmacother. 2019;118:109341.
Zhao H, Wang W, Zhao Q, Hu G, Deng K, Liu Y. BCL3 exerts an oncogenic function by regulating STAT3 in human cervical cancer. Onco Targets Ther. 2016;9:6619–29.
Dillon RL, Marcotte R, Hennessy BT, Woodgett JR, Mills GB, Muller WJ. Akt1 and Akt2 play distinct roles in the initiation and metastatic phases of mammary tumor progression. Cancer Res. 2009;69(12):5057.
Hutchinson JN, Jin J, Cardiff RD, Woodgett JR, Muller WJ. Activation of Akt-1 (PKB-α) can accelerate ErbB-2-mediated mammary tumorigenesis but suppresses tumor invasion. Cancer Res. 2004;64(9):3171.
Manning BD, Toker A. AKT/PKB signaling: navigating the network. Cell. 2017;169(3):381–405.
Choi HJ, Lee JM, Kim H, Nam HJ, Shin H-JR, Kim D, Ko E, Noh D-Y, Kim KI, Kim JH, et al. Bcl3-dependent stabilization of CtBP1 is crucial for the inhibition of apoptosis and tumor progression in breast cancer. Biochem Biophys Res Commun. 2010;400(3):396–402.
Beck AH, Sangoi AR, Leung S, Marinelli RJ, Nielsen TO, van de Vijver MJ, West RB, van de Rijn M, Koller D. Systematic analysis of breast cancer morphology uncovers stromal features associated with survival. Sci Transl Med. 2011;3(108):108ra113 (1946–6242 (Electronic)).
Downey CL, Simpkins SA, White J, Holliday DL, Jones JL, Jordan LB, Kulka J, Pollock S, Rajan SS, Thygesen HH, et al. The prognostic significance of tumour–stroma ratio in oestrogen receptor-positive breast cancer. Br J Cancer. 2014;110(7):1744–7.
Heindl A, Sestak I, Naidoo K, Cuzick J, Dowsett M, Yuan Y. Relevance of spatial heterogeneity of immune infiltration for predicting risk of recurrence after endocrine therapy of ER+ breast cancer. J Natl Cancer Inst. 2018;110(2):166–75. https://doi.org/10.1093/jnci/djx1137.
Saltz J, Gupta R, Hou L, Kurc T, Singh P, Nguyen V, Samaras D, Shroyer KR, Zhao T, Batiste R, et al. Spatial organization and molecular correlation of tumor-infiltrating lymphocytes using deep learning on pathology images. Cell Rep. 2018;23(1):181–193.e187.
Cooper LA, Demicco EG, Saltz JH, Powell RT, Rao A, Lazar AJ. PanCancer insights from the cancer genome atlas: the pathologist’s perspective. J Pathol. 2018;244(5):512–24.
Benjamini Y, Hochberg Y. Controlling the false discovery rate - a practical and powerful approach to multiple testing. J R Stat Soc Ser B. 1995;57:289–300.
Shao W, Wang T, Huang Z, Cheng J, Han Z, Zhang D, Huang K. Diagnosis-guided multi-modal feature selection for prognosis prediction of lung squamous cell carcinoma. In: Medical Image Computing and Computer Assisted Intervention – MICCAI 2019. Cham: Springer International Publishing; 2019. p. 113–21.
The authors thank Dr. Andy B. Chen for his help on R shiny development.
About this supplement
This article has been published as part of BMC Medical Genomics Volume 13 Supplement 11 2020: Data-driven analytics in biomedical genomics. The full contents of the supplement are available at https://bmcmedgenomics.biomedcentral.com/articles/supplements/volume-13-supplement-11.
This study is in part supported by the Indiana University Grand Challenge Precision Health Initiative.
Publication costs are funded by Indiana University Grand Challenge Precision Health Initiative.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
. Representative H&E stained histopathology tissue image of TCGA breast cancer cases. A) Original H&E stained histopathology image and paired tissue segmentation result of a high-epithelium case. B) Original H&E stained histopathology image and paired tissue segmentation result of a low-epithelium case. The tissue segmentation results were derived from our previous work, with the red, green and black regions corresponding to epithelial and stromal tissue and background in the original image, respectively.
. The epithelial tissue proportion data of 54 TCGA ER-positive BRCA cases. Supplemental Table 2. The ATAC-seq peak signal data of 54 TCGA ER-positive BRCA cases. Supplemental Table 3. Significant epithelial tissue proportion-associated peaks and their target genes. Supplemental Table 4. Promoter and distal enhancer peak-to-gene links and their target genes. Supplemental Table 5. Expression data of the identified genes and clinical information for 663 TCGA ER-positive BRCA cases. Supplemental Table 6. Results of the univariate survival analysis.
About this article
Cite this article
Xu, ., Lu, Z., Shao, W. et al. Integrative analysis of histopathological images and chromatin accessibility data for estrogen receptor-positive breast cancer. BMC Med Genomics 13, 195 (2020). https://doi.org/10.1186/s12920-020-00828-4
- Chromatin accessibility data
- Histopathological images
- Integrative analysis
- Computational biology