Towards Clinical World Models: Modeling Unaligned Multimodal Medical Data via Generative Steering

Description of the granted funding

Modern healthcare produces much data such as medical images, electronic records, and physiological signals, but these data are often incomplete or not aligned, limiting how artificial intelligence (AI) can use them. This project develops a new approach called test-time steered generative modeling, which lets AI learn from such imperfect data and adapt during use. The key idea is a paradigm shift: instead of training medical AI as a narrow input-to-output (X?Y) mapping, we model the joint distribution of multimodal data (X,Y) that can be steered for flexible inference. Hopefully this can be one step toward clinical world models. The research combines self-learning AI, generative modeling, and clinical data from lung cancer, heart imaging, and hospital records, carried out at ELLIS Institute Finland and Aalto University. The results will lead to more reliable, data-efficient AI tools that help doctors analyse complex medical data and support trustworthy clinical world models.
Show more

Starting year

2026

End year

2030

Granted funding

Jiancheng Yang Orcid -palvelun logo
597 721 €

Funder

Research Council of Finland

Funding instrument

Academy projects

Decision maker

Scientific Council for Natural Sciences and Engineering
09.06.2026

Other information

Funding decision number

376209

Fields of science

Computer and information sciences

Research fields

Laskennallinen data-analyysi

Identified topics

bioinformatics