LIFTED: Multimodal Clinical Trial Outcome Prediction via Large Language Models and Mixture-of-Experts

Abstract

Clinical trials are pivotal yet costly processes, often spanning multiple years and requiring substantial expenses, motivating predictive models to identify likely-to-fail drugs early and save resources.Recent approaches leverage deep learning to integrate multimodal data for clinical outcome prediction; however, they rely heavily on manually designed modalityspecific encoders, limiting their adaptability to new modalities and ability to effectively share information across modalities.To address these challenges, we propose a multimodal mixtureof-experts (LIFTED) framework.Specifically, LIFTED transforms modality-specific data into natural language descriptions, encoded via unified, noise-resilient encoders.A sparse Mixture-of-Experts mechanism then identifies shared patterns across modalities, extracting consistent representations.Finally, another mixture-of-experts module dynamically integrates these modality representations, emphasizing critical information.Experiments show that LIFTED significantly outperforms baseline methods in predicting clinical trial outcomes across all phases, highlighting the effectiveness of our proposed approach.Step I Modality preprocessing Step II LIFTED model training and predictionSelect

Ähnliche Arbeiten