Deakin University
Browse

File(s) under permanent embargo

A Random Access based Approach to Communication-Efficient Distributed SGD

conference contribution
posted on 2023-02-21, 03:42 authored by Jinho ChoiJinho Choi
In this paper, we study communication-efficient distributed stochastic gradient descent (SGD) with data sets of users distributed over a certain area and communicating through wireless channels. Since the time for one iteration in the proposed approach is independent of the number of users, it is well-suited to distributed SGD with a large number of users or devices. Furthermore, since the proposed approach is based on random access in machine-type communication (MTC), it can be easily employed for training models with a large number of devices in various Internet-of-Things (IoT) applications where MTC is used for their connectivity. For fading channel, we show that noncoherent combining can be used. As a result, no channel state information (CSI) estimation is required.

History

Volume

2022-May

Pagination

4486-4491

Location

SOUTH KOREA, Seoul

Start date

2022-05-16

End date

2022-05-20

ISSN

1550-3607

ISBN-13

9781538683477

Language

English

Title of proceedings

IEEE International Conference on Communications

Event

IEEE International Conference on Communications (ICC)

Publisher

IEEE

Series

IEEE International Conference on Communications

Usage metrics

    Research Publications

    Categories

    No categories selected

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC