File(s) under permanent embargo
How to democratise and protect AI: fair and differentially private decentralised deep learning
journal contributionposted on 2020-01-01, 00:00 authored by Lingjuan Lyu, Yitong Li, Karthik Nandakumar, Daniel Ma
This paper firstly considers the research problem of fairness in collaborative deep learning, while ensuring privacy. We study the weaknesses in current server-based deep learning frameworks, and solve the single-point-of-failure problem by using Blockchain to realise decentralisation. To address fairness and privacy, we propose a novel reputation system through digital tokens and local credibility to ensure fairness, in combination with differential privacy to guarantee privacy. In particular, we build a fair and differentially private decentralised deep learning framework called FDPDDL, which enables parties to derive more accurate local models in a fair and private manner by using our developed two-stage scheme: during the initialisation stage, artificial samples generated by Differentially Private Generative Adversarial Network (DPGAN) are used to mutually benchmark the local credibility of each party and generate initial tokens; during the update stage, Differentially Private SGD (DPSGD) is used to facilitate collaborative privacy-preserving deep learning, and local credibility and tokens of each party are updated according to the quality and quantity of individually released gradients. Experimental results on benchmark datasets under three realistic settings demonstrate that FDPDDL achieves high fairness, yields comparable accuracy to the centralised and distributed frameworks, and delivers better accuracy than the standalone framework.
JournalIEEE transactions on dependable and secure computing
Pagination1 - 14
Publication classificationC1 Refereed article in a scholarly journal
CredibilityDecentralised deep learningFairnessPrivacyScience & TechnologyTechnologyComputer Science, Hardware & ArchitectureComputer Science, Information SystemsComputer Science, Software EngineeringComputer ScienceDeep learningServersData modelsCollaborationComputational modelingData privacyComputer SoftwareData FormatDistributed Computing