Deakin University
Browse

File(s) under embargo

Style Augmentation and Domain-Aware Parametric Contrastive Learning for Domain Generalization

conference contribution
posted on 2023-10-26, 04:38 authored by M Li, J Zhang, W Zhang, L Gong, Zili ZhangZili Zhang
The distribution shift between training data and test data degrades the performance of deep neural networks (DNNs), and domain generalization (DG) alleviates this problem by extracting domain-invariant features explicitly or implicitly. With limited source domains for training, existing approaches often generate samples of new domains. However, most of these approaches confront the issue of losing class-discriminative information. To this end, we propose a novel domain generalization framework containing style augmentation and Domain-aware Parametric Contrastive Learning (DPCL). Specifically, features are first decomposed into high-frequency and low-frequency components, which contain shape and style information, respectively. Since the shape cues contain class information, the high-frequency components remain unchanged. Then Exact Feature Distribution Mixing (EFDMix) is used for diversifying the low-frequency components, which fully uses each order statistic of the features. Finally, both components are re-merged to generate new features. Additionally, DPCL is proposed, based on supervised contrastive learning, to enhance domain invariance by ignoring negative samples from different domains and introducing a set of parameterized class-learnable centers. The effectiveness of the proposed style augmentation method and DPCL is confirmed by experiments. On the PACS dataset, our method improves the state-of-art average accuracy by 1.74% using ResNet-50 backbone and even achieves excellent performance in the single-source DG task.

History

Volume

14120

Pagination

211-224

Location

Guangzhou, China

Start date

2023-08-16

End date

2023-08-18

ISSN

0302-9743

eISSN

1611-3349

ISBN-13

9783031402913

Language

eng

Publication classification

E1.1 Full written paper - refereed

Editor/Contributor(s)

Jin Z, Jiang Y, Buchmann R, Bi Y, Ghiran A, Ma W

Title of proceedings

KSEM 2023 : Knowledge Science, Engineering and Management 16th International Conference, KSEM 2023 Guangzhou, China, August 16–18, 2023 Proceedings, Part IV

Event

Knowledge Science, Engineering and Management. Conference (2023 : 16th : Guangzhou, China)

Publisher

Springer

Place of publication

Berlin, Germany

Series

Lecture Notes in Artificial Intelligence

Usage metrics

    Research Publications

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC