Journal

Methods

Papers (4)

Integrating multi-omics data by learning modality invariant representations for improved prediction of overall survival of cancer

Breast and ovarian cancers are the second and the fifth leading causes of cancer death among women. Predicting the overall survival of breast and ovarian cancer patients can facilitate the therapeutics evaluation and treatment decision making. Multi-scale multi-omics data such as gene expression, DNA methylation, miRNA expression, and copy number variations can provide insights on personalized survival. However, how to effectively integrate multi-omics data remains a challenging task. In this paper, we develop multi-omics integration methods to improve the prediction of overall survival for breast cancer and ovarian cancer patients. Because multi-omics data for the same patient jointly impact the survival of cancer patients, features from different -omics modality are related and can be modeled by either association or causal relationship (e.g., pathways). By extracting these relationships among modalities, we can get rid of the irrelevant information from high-throughput multi-omics data. However, it is infeasible to use the Brute Force method to capture all possible multi-omics interactions. Thus, we use deep neural networks with novel divergence-based consensus regularization to capture multi-omics interactions implicitly by extracting modality-invariant representations. In comparing the concatenation-based integration networks with our new divergence-based consensus networks, the breast cancer overall survival C-index is improved from 0.655±0.062 to 0.671±0.046 when combing DNA methylation and miRNA expression, and from 0.627±0.062 to 0.667±0.073 when combing miRNA expression and copy number variations. In summary, our novel deep consensus neural network has successfully improved the prediction of overall survival for breast cancer and ovarian cancer patients by implicitly learning the multi-omics interactions.

Deep learning-based multimodal image analysis for cervical cancer detection

Cervical cancer is the fourth most common cancer in women, and its precise detection plays a critical role in disease treatment and prognosis prediction. Fluorodeoxyglucose positron emission tomography and computed tomography, i.e., FDG-PET/CT and PET/CT, have established roles with superior sensitivity and specificity in most cancer imaging applications. However, a typical FDG-PET/CT analysis involves the time-consuming process of interpreting hundreds of images, and the intense image screening work has greatly hindered clinicians. We propose a computer-aided deep learning-based framework to detect cervical cancer using multimodal medical images to increase the efficiency of clinical diagnosis. This framework has three components: image registration, multimodal image fusion, and lesion object detection. Compared to traditional approaches, our adaptive image fusion method fuses multimodal medical images. We discuss the performance of deep learning in each modality, and we conduct extensive experiments to compare the performance of different image fusion methods with some state-of-the-art (SOTA) object-detection deep learning-based methods in images with different modalities. Compared with PET, which has the highest recognition accuracy in single-modality images, the recognition accuracy of our proposed method on multiple object detection models is improved by an average of 6.06%. And compared with the best results of other multimodal fusion methods, our results have an average improvement of 8.9%.

Publisher

Elsevier BV

ISSN

1046-2023