Multi-source Domain Adaptation via Weighted Joint Distributions Optimal Transport
- Others:
- Università degli Studi di Ferrara = University of Ferrara (UniFE)
- Observatoire de la Côte d'Azur (OCA) ; Institut national des sciences de l'Univers (INSU - CNRS)-Centre National de la Recherche Scientifique (CNRS)
- Joseph Louis LAGRANGE (LAGRANGE) ; Université Nice Sophia Antipolis (1965 - 2019) (UNS) ; COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Institut national des sciences de l'Univers (INSU - CNRS)-Observatoire de la Côte d'Azur ; COMUE Université Côte d'Azur (2015-2019) (COMUE UCA)-Université Côte d'Azur (UCA)-Université Côte d'Azur (UCA)-Centre National de la Recherche Scientifique (CNRS)
- Université Côte d'Azur (UCA)
- Laboratoire d'Informatique, de Traitement de l'Information et des Systèmes (LITIS) ; Université Le Havre Normandie (ULH) ; Normandie Université (NU)-Normandie Université (NU)-Université de Rouen Normandie (UNIROUEN) ; Normandie Université (NU)-Institut national des sciences appliquées Rouen Normandie (INSA Rouen Normandie) ; Institut National des Sciences Appliquées (INSA)-Normandie Université (NU)-Institut National des Sciences Appliquées (INSA)
- Criteo AI Lab ; Criteo [Paris]
- Université de Rouen Normandie (UNIROUEN) ; Normandie Université (NU)
- University College of London [London] (UCL)
- Instituto Italiano di Tecnologia (IIT) ; Ministero dell'Istruzione-Ministero dell'Economia e Finanze
- ANR-19-P3IA-0002,3IA@cote d'azur,3IA Côte d'Azur(2019)
Description
The problem of domain adaptation on an unlabeled target dataset using knowledge from multiple labelled source datasets is becoming increasingly important. A key challenge is to design an approach that overcomes the covariate and target shift both among the sources, and between the source and target domains. In this paper, we address this problem from a new perspective: instead of looking for a latent representation invariant between source and target domains, we exploit the diversity of source distributions by tuning their weights to the target task at hand. Our method, named Weighted Joint Distribution Optimal Transport (WJDOT), aims at finding simultaneously an Optimal Transport-based alignment between the source and target distributions and a re-weighting of the sources distributions. We discuss the theoretical aspects of the method and propose a conceptually simple algorithm. Numerical experiments indicate that the proposed method achieves state-of-the-art performance on simulated and real-life datasets.
Additional details
- URL
- https://hal.archives-ouvertes.fr/hal-02877779
- URN
- urn:oai:HAL:hal-02877779v1
- Origin repository
- UNICA