MMLARP MMLARP
Active collaboration 2024–2025

Multimodal / Multiview Learning applied to real problems
(MMLARP, Stic-AMSud)

Collaborative research between PUCPR, UFPR, UFPE, Université de Rouen and Universidad de los Andes, with an emphasis on pattern recognition, machine learning and computer vision.

View meetings Learn more

Multimodal / Multiview Learning
applied to real problems


    Abstract: This STIC-AmSud project builds on the idea that humans perceive the world in a multimodal way, motivating the development of multimodal AI systems. Beyond simple fusion, key challenges include selecting modalities, defining their representations, modeling their interactions, and designing learning strategies that account for multiple modalities. The project aims to advance these aspects by developing novel multimodal and multiview predictive models, focusing on representation learning, model architectures, and strategies for modality selection and fusion considering intermodal relationships. It also investigates improved training strategies for multimodal systems. The expected outcomes include publications in leading journals and conferences, as well as contributions to human resource training and technological innovation. Potential applications include emotion analysis for mental health, medical image analysis, document retrieval, and driver assistance systems. The project also strengthens long-standing collaboration among research teams from France, Brazil, and Chile initiated under STIC-AmSud 2014.
  • Pattern Recognition and Computer Vision
  • Multimodal and Multiview Machine Learning
  • Internacional Cooperation and Training in Machine Learning

missions

Kick-off meeting»

Follow the records and materials of each research mission.

Mission 1
2024

Mission 1 (Rouen)

Goal alignment, task split, and experimental pipeline definition.
Mission 2
2024

Mission 2 (Recife)

Preliminary results, protocol adjustments, and metric definition.
Mission 3
2025

Mission 3 (Rouen)

Dataset integration and cross‑modality comparisons.
Mission 4
2025

Mission 4 (Chile)

Summary of progress, publication planning, and next steps.

gallery

Highlights and visual records of the project.

Institutions

Partner universities and research centers.

Researchers

Project coordination and team members.

Prof. Alceu de Souza Britto Jr (Coordinator, PUCPR/Brazil)

Prof. Laurent Heutte (French Coordinator, Université de Rouen/France)

Prof. George D. C. Cavalcanti (Associate Coordinator, UFPE/Brazil)

Prof. Luiz Eduardo S. Oliveira (Associate Coordinador, UFPR/Brazil)

Prof. Simon Bernand (Université de Rouen/France)

Prof. Stéphane Nicolas (Université de Rouen/France)

Prof. Jean Paul Barddal (PUCPR/Brazil)

Prof. André Gustavo Hochuli (PUCPR/Brazil)

Prof. Jose M. Saavedra (Chilean Coordinator, Universidad de los Andes/Chile)

Carlos Magno (PhD student, PUCPR/Brazil)

Caio S. Dias (PhD student, PUCPR/Brazil)

Luciana Menon (PhD student, PUCPR/Brazil)

Daniel Vriessman (PhD student, PUCPR/Brazil)

Cristiano Garcia (PhD student, PUCPR/Brazil)

Everton Baro (PhD student, UFPR/Brazil)

Leandro Ensina (PhD student, UFPR/Brazil)

Francimaria R. S. Nascimento (PhD student, UFPE/Brazil)

Keila Santos (PhD student, UFPE/Brazil)

Livia Alexandre (PhD student, UFPE/Brazil)

Lucas Amorim (PhD student, UFPE/Brazil)

Cynthia Moreira Maia (PhD student, UFPE/Brazil)

Joseph Assaker (PhD student, Université de Rouen/France)

Coordinators

France, Brazil and Chile.

  • Coordination (France): Prof. Laurent Heutte ([email protected]), Laboratoire d'Informatique, du Traitement de l'Information et des Systèmes (LITIS, UR, France). Visit LITIS Lab
  • Coordination (Brazil): Prof. Alceu de S. Britto Jr. ([email protected]), Postgraduate Program in Computer Science (PPGIa, PUCPR, Brazil). Visit PPGIa
  • Coordination (Chile): Prof. Jose M. Saavedra ([email protected]), Faculty of Engineering and Applied Sciences (Universidad de Los Andes, Chile). Visit UAndes
    • © 2024–2025 MMLARP. All rights reserved.