
Voxist
Voxist
1 Projects, page 1 of 1
Open Access Mandate for Publications and Research data assignment_turned_in Project2025 - 2029Partners:FUNDACION DE LA COMUNITAT VALENCIANA UNIDAD ELLIS ALICANTE, UV, DEIMOS ENGINEERING AND SYSTEMS SLU, UvA, University of Tübingen +23 partnersFUNDACION DE LA COMUNITAT VALENCIANA UNIDAD ELLIS ALICANTE,UV,DEIMOS ENGINEERING AND SYSTEMS SLU,UvA,University of Tübingen,FZJ,CSC,Departament de Territori i Sostenibilitat - Generalitat de Catalunya,ROBOTWIN SRO,UNIMORE,JSI,VALEO ISC,Voxist,LOBA,TU/e,LMU,CISPA - HELMHOLTZ-ZENTRUM FUR INFORMATIONSSICHERHEIT GGMBH,BSC,ELLIS Institute Tübingen gGmbH,University of Trento,CVC,ČVUT,OPENCHIP,CERTH,VRT,AALTO,KUL,CinecaFunder: European Commission Project Code: 101214398Overall Budget: 24,998,000 EURFunder Contribution: 24,998,000 EURFor improving the capabilities of general-purpose AI models and for extending their applicability to domains where the temporal dimension – among several others – is of importance, we will target the development of the next generation of Multimodal Space-Time Foundation Models (MSTFMs). These will combine spatio-temporal understanding, which is important even for modalities such as the visual one that have already been introduced in large generative models, with the effective management of new time-relevant modalities that are yet to be supported in foundation models, such as industrial time series data, remote sensing data and health-related measurements. Real and synthetic data, to mitigate data scarcity, will be leveraged for training general-purpose MSTFMs and for further adapting them for specific downstream tasks. Real data used for training will include data directly provided by members of the consortium as well as data from relevant European Data Spaces, while complementary synthetic data will be generated by exploiting existing generative AI capabilities as well as new ones developed in the project. European HPC infrastructure is directly included in the consortium to ensure the availability of the necessary computing resources.
more_vert