{"id":1830,"date":"2025-11-13T12:40:23","date_gmt":"2025-11-13T12:40:23","guid":{"rendered":"https:\/\/medicalcps.dfki.de\/?page_id=1830"},"modified":"2026-03-20T08:52:10","modified_gmt":"2026-03-20T08:52:10","slug":"foundation","status":"publish","type":"page","link":"https:\/\/medicalcps.dfki.de\/?page_id=1830","title":{"rendered":"Foundation"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\"><strong>Medical Foundation Models: From Vision to Multimodal and Trustworthy AI<\/strong><\/h2>\n\n\n\n<p>Funding period 2024-2027<br>Contact: <a href=\"mailto:Ho_Minh_Duy.Nguyen@dfki.de\" data-type=\"page\" data-id=\"16\">Duy Nguyen<\/a><\/p>\n\n\n\n<p>Our research develops <strong>large-scale foundation models<\/strong> for medical imaging and multi-modal reasoning. These models are designed to work in <strong>collaboration with human experts<\/strong>, enhancing reliability, interpretability, and generalization across medical domains.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"279\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/12\/foundation_goal-1024x279.png\" alt=\"\" class=\"wp-image-1923\" srcset=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/12\/foundation_goal-1024x279.png 1024w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/12\/foundation_goal-300x82.png 300w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/12\/foundation_goal-768x209.png 768w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/12\/foundation_goal-1536x419.png 1536w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/12\/foundation_goal-2048x559.png 2048w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/12\/foundation_goal-500x136.png 500w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Research Results<\/h2>\n\n\n\n<p>Our group develops large medical foundation models that integrate vision, language, and structured reasoning to advance understanding across medical imaging and clinical data. We focus on:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Single- to Multi-Modal Learning<\/strong>: evolving from vision-only models to unified models that understand and generate medical knowledge across text, image, and clinical data.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Transparent and Structured Reasoning<\/strong>: enabling models to explain their predictions through interpretable, step-by-step reasoning processes.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Human\u2013AI Collaboration<\/strong>: designing systems that learn from clinician feedback and align with expert judgment.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Continual Self-Improvement:<\/strong> incorporating human feedback and new data to refine model understanding and reliability over time, working with low-resource data settings.<\/li>\n<\/ul>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Partners<\/h2>\n\n\n\n<p>We collaborate with leading institutions and hospital partners to advance trustworthy and generalizable AI for healthcare.<\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"168\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image.png\" alt=\"\" class=\"wp-image-1879\" style=\"width:166px;height:auto\"\/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"255\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-1024x255.png\" alt=\"\" class=\"wp-image-1880\" srcset=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-1024x255.png 1024w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-300x75.png 300w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-768x191.png 768w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-500x124.png 500w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1.png 1531w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"640\" height=\"360\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-2.png\" alt=\"\" class=\"wp-image-1881\" style=\"width:159px;height:auto\" srcset=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-2.png 640w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-2-300x169.png 300w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-2-500x281.png 500w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/figure>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"171\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-4-1024x171.png\" alt=\"\" class=\"wp-image-1884\" srcset=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-4-1024x171.png 1024w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-4-300x50.png 300w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-4-768x128.png 768w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-4-1536x257.png 1536w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-4-500x83.png 500w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-4.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"635\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-1024x635.jpeg\" alt=\"\" class=\"wp-image-1886\" title=\"NUS_logo_full-horizontal.jpg\" srcset=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-1024x635.jpeg 1024w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-300x186.jpeg 300w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-768x476.jpeg 768w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1-484x300.jpeg 484w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-1.jpeg 1390w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"271\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-6-1024x271.png\" alt=\"\" class=\"wp-image-1887\" title=\"Logo_CECS.png\" srcset=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-6-1024x271.png 1024w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-6-300x79.png 300w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-6-768x203.png 768w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-6-1536x407.png 1536w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-6-500x132.png 500w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-6.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n<\/div>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"126\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-7.png\" alt=\"\" class=\"wp-image-1888\" style=\"width:348px;height:auto\" srcset=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-7.png 1024w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-7-300x37.png 300w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-7-768x95.png 768w, https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/image-7-500x62.png 500w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n<div style=\"height:35px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"573\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2026\/03\/Carl_von_Ossietzky_Universitat_Oldenburg_logo.svg\" alt=\"\" class=\"wp-image-1948\" style=\"aspect-ratio:1.6892819649765771;width:173px;height:auto\"\/><\/figure>\n<\/div><\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\"><\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2026\/03\/UMO-Logo.svg\" alt=\"\" class=\"wp-image-1947\" style=\"aspect-ratio:1.227428883341611;width:150px;height:auto\"\/><\/figure>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Selected Publications<\/h2>\n\n\n\n<p>Sonntag, Daniel, Michael Barz, Thiago Gouvea: &#8220;<strong><a href=\"https:\/\/www.dfki.de\/web\/forschung\/projekte-publikationen\/publikation\/15026\">A look under the hood of the Interactive Deep Learning Enterprise (No-IDLE)<\/a><\/strong>.&#8221; DFKI Technical Report, 2024.<\/p>\n\n\n\n<p>MH Nguyen, Duy, Hoang Nguyen, Nghiem Diep, Tan Ngoc Pham, Tri Cao, Binh Nguyen, Paul Swoboda et al. &#8220;<strong><a href=\"https:\/\/www.dfki.de\/web\/forschung\/projekte-publikationen\/publikation\/14309\">Lvm-med: Learning large-scale self-supervised vision models for medical imaging via second-order graph matching<\/a><\/strong>.&#8221; Advances in Neural Information Processing Systems (<strong>NeurIPS<\/strong>) 2023.<\/p>\n\n\n\n<p>Nguyen, Duy Minh Ho, Nghiem Tuong Diep, Trung Quoc Nguyen, Hoang-Bao Le, Tai Nguyen, Anh-Tien Nguyen, TrungTin Nguyen et al. &#8220;<a href=\"https:\/\/www.dfki.de\/web\/forschung\/projekte-publikationen\/publikation\/16544\"><strong>Exgra-med: Extended context graph alignment for medical vision-language models<\/strong>.<\/a>&#8221; In The Thirty-ninth Annual Conference on Neural Information Processing Systems (<strong>NeurIPS<\/strong>) 2025.<\/p>\n\n\n\n<p>Nguyen, Anh-Tien, Duy Minh Ho Nguyen, Nghiem Tuong Diep, Trung Quoc Nguyen, Nhat Ho, Jacqueline Michelle Metsch, Miriam Cindy Maurer, Daniel Sonntag, Hanibal Bohnenberger, and Anne-Christin Hauschild. &#8220;<strong><a href=\"https:\/\/www.dfki.de\/web\/forschung\/projekte-publikationen\/publikation\/16546\">MGPATH: Vision-Language Model with Multi-Granular Prompt Learning for Few-Shot WSI Classification<\/a><\/strong>.&#8221; Transactions on Machine Learning Research (<strong>TMLR<\/strong>), 2025.<\/p>\n\n\n\n<p>Huy M. Le,&nbsp; Dat Tien Nguyen,&nbsp; Ngan T. T. Vo ,&nbsp; Tuan D. Q. Nguyen,&nbsp; Nguyen Le Binh,&nbsp; Duy MH Nguyen,&nbsp; Daniel Sonntag,&nbsp; Lizi Liao ,&nbsp; Binh T. Nguyen, \u201c<strong><a href=\"https:\/\/www.dfki.de\/web\/forschung\/projekte-publikationen\/publikation\/16547\">Reinforce Trustworthiness in Multimodal Emotional Support System<\/a><\/strong>.\u201d Proceedings of the <strong>AAAI<\/strong> Conference on Artificial Intelligence (<strong>Oral<\/strong>), 2026.<\/p>\n\n\n\n<p>Le-Duc, Khai*, Duy MH Nguyen*, Phuong TH Trinh, Tien-Phat Nguyen, Nghiem T. Diep, An Ngo, Tung Vu et al. &#8220;<strong>S-Chain: Structured Visual Chain-of-Thought For Medicine<\/strong>.&#8221; arXiv preprint arXiv:2510.22728 (2025).<\/p>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Funding<\/h2>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\">\n<div class=\"wp-block-group is-layout-grid wp-container-core-group-is-layout-9649a0d9 wp-block-group-is-layout-grid\">\n<figure class=\"wp-block-image size-large wp-container-content-69bc4bdf\"><img loading=\"lazy\" decoding=\"async\" width=\"300\" height=\"207\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/European_Commission.svg\" alt=\"\" class=\"wp-image-1876\"\/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"278\" height=\"143\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/BMFTR_Logo.svg\" alt=\"\" class=\"wp-image-1877\"\/><\/figure>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\">\n<figure class=\"wp-block-image size-large wp-container-content-69bc4bdf\"><img loading=\"lazy\" decoding=\"async\" width=\"202\" height=\"36\" src=\"https:\/\/medicalcps.dfki.de\/wp-content\/uploads\/2025\/11\/MWK_Wappen.svg\" alt=\"\" class=\"wp-image-1845\"\/><\/figure>\n<\/div>\n<\/div>\n<\/div><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div><\/div>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Medical Foundation Models: From Vision to Multimodal and Trustworthy AI Funding period 2024-2027Contact: Duy Nguyen Our research develops large-scale foundation models for medical imaging and multi-modal reasoning. These models are designed to work in collaboration with human experts, enhancing reliability, &hellip; <a href=\"https:\/\/medicalcps.dfki.de\/?page_id=1830\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":4,"featured_media":1972,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"inline_featured_image":false,"footnotes":""},"class_list":["post-1830","page","type-page","status-publish","has-post-thumbnail","hentry"],"_links":{"self":[{"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=\/wp\/v2\/pages\/1830","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1830"}],"version-history":[{"count":29,"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=\/wp\/v2\/pages\/1830\/revisions"}],"predecessor-version":[{"id":1974,"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=\/wp\/v2\/pages\/1830\/revisions\/1974"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=\/wp\/v2\/media\/1972"}],"wp:attachment":[{"href":"https:\/\/medicalcps.dfki.de\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1830"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}