My proposed endeavor is to build AI based multi modal medical image and EHR processing tools for large scale analysis of patient data acquired in clinical settings to carefully validate the AI based healthcare data processing tools for practical use in clinics and hospitals. This project not only pushes the boundaries of AI in healthcare by integrating cutting-edge techniques in multimodal data analysis, but also fosters collaboration among computer scientists, clinicians, and biomedical engineers, ensuring that these innovations are grounded in real-world clinical needs and are robustly validated for practical deployment.