DeceFL: A Principled Decentralized Federated Learning Framework

Last update: May 31, 2022

Related tags

Deep Learning DeceFL

Overview

DeceFL: A Principled Decentralized Federated Learning Framework

This repository comprises codes that reproduce experiments in Ye, et al (2021), which has been submitted to Nature Machine Intelligence.

Project Organization

Experiments:

Comparative studies of DeceFL and FedAvg, SL on dataset A2, provided in DatasetA2/.
Time-vary experiments for DeceFL using dataset A2
- Time-varying graphs with edge changes, provided in DatasetA2/
- Time-varying graphs with node changes, provided in NodeVarying/
Comparative study of DeceFL and FedAvg, SL on CWRU dataset, provided in CWRU/.
An consensus example is generated by scripts in ConsensusExample/.

Go to each folder for README.md for every experiment.

Dependencies

Hardware: GPU that supports Pytorch

OS: Linux, Windows 10

Python packages:

torch == 1.9.0
numpy == 1.21.0
sklearn == 0.24.2
pandas == 1.3.1
tqdm == 4.46.0
matplotlib == 3.4.2

More to be filled ...

Reference

[1] Ye Yuan, et al. DeceFL: A Principled Decentralized Federated Learning Framework. Submitted to Nature Machine Intelligence, 2021.

Owner

Huazhong Artificial Intelligence Lab (HAIL)

Huazhong Artificial Intelligence Lab (HAIL)

GitHub Repository

Repository of best practices for deep learning in Julia, inspired by fastai

FastAI Docs: Stable | Dev FastAI.jl is inspired by fastai, and is a repository of best practices for deep learning in Julia. Its goal is to easily ena

532 Jan 02, 2023

A curated list of neural rendering resources.

Awesome-of-Neural-Rendering A curated list of neural rendering and related resources. Please feel free to pull requests or open an issue to add papers

43 Dec 09, 2022

Python Library for Signal/Image Data Analysis with Transport Methods

PyTransKit Python Transport Based Signal Processing Toolkit Website and documentation: https://pytranskit.readthedocs.io/ Installation The library cou

24 Dec 23, 2022

This repo is the official implementation of "L2ight: Enabling On-Chip Learning for Optical Neural Networks via Efficient in-situ Subspace Optimization".

L2ight is a closed-loop ONN on-chip learning framework to enable scalable ONN mapping and efficient in-situ learning. L2ight adopts a three-stage learning flow that first calibrates the complicated p

9 Jul 14, 2022

Fashion Recommender System With Python

Fashion-Recommender-System Thr growing e-commerce industry presents us with a la

2 Feb 02, 2022

RobustART: Benchmarking Robustness on Architecture Design and Training Techniques

The first comprehensive Robustness investigation benchmark on large-scale dataset ImageNet regarding ARchitecture design and Training techniques towards diverse noises.

132 Dec 23, 2022

Code repo for EMNLP21 paper "Zero-Shot Information Extraction as a Unified Text-to-Triple Translation"

Zero-Shot Information Extraction as a Unified Text-to-Triple Translation Source code repo for paper Zero-Shot Information Extraction as a Unified Text

88 Dec 31, 2022

3D detection and tracking viewer (visualization) for kitti & waymo dataset

3D detection and tracking viewer (visualization) for kitti & waymo dataset

222 Jan 08, 2023

Source code for paper: Knowledge Inheritance for Pre-trained Language Models

Knowledge-Inheritance Source code paper: Knowledge Inheritance for Pre-trained Language Models (preprint). The trained model parameters (in Fairseq fo

31 Nov 19, 2022

Implementation for our ICCV 2021 paper: Dual-Camera Super-Resolution with Aligned Attention Modules

DCSR: Dual Camera Super-Resolution Implementation for our ICCV 2021 oral paper: Dual-Camera Super-Resolution with Aligned Attention Modules paper | pr

110 Dec 20, 2022

Compare neural networks by their feature similarity

PyTorch Model Compare A tiny package to compare two neural networks in PyTorch. There are many ways to compare two neural networks, but one robust and

181 Jan 04, 2023

Multi Task RL Baselines

MTRL Multi Task RL Algorithms Contents Introduction Setup Usage Documentation Contributing to MTRL Community Acknowledgements Introduction M

171 Jan 09, 2023

Deep Q-learning for playing chrome dino game

[PYTORCH] Deep Q-learning for playing Chrome Dino

68 Dec 05, 2022

Code accompanying paper: Meta-Learning to Improve Pre-Training

Meta-Learning to Improve Pre-Training This folder contains code to run experiments in the paper Meta-Learning to Improve Pre-Training, NeurIPS 2021. P

28 Dec 31, 2022

EfficientMPC - Efficient Model Predictive Control Implementation

efficientMPC Efficient Model Predictive Control Implementation The original algo

8 Dec 04, 2022

Pytorch implemenation of Stochastic Multi-Label Image-to-image Translation (SMIT)

SMIT: Stochastic Multi-Label Image-to-image Translation This repository provides a PyTorch implementation of SMIT. SMIT can stochastically translate a

37 Mar 01, 2022

Try out deep learning models online on Google Colab

Try out deep learning models online on Google Colab

1.5k Dec 27, 2022

Select, weight and analyze complex sample data

Sample Analytics In large-scale surveys, often complex random mechanisms are used to select samples. Estimates derived from such samples must reflect

37 Dec 15, 2022

Facestar dataset. High quality audio-visual recordings of human conversational speech.

Facestar Dataset Description Existing audio-visual datasets for human speech are either captured in a clean, controlled environment but contain only a

87 Dec 21, 2022

Hand tracking demo for DIY Smart Glasses with a remote computer doing the work

CameraStream This is a demonstration that streams the image from smartglasses to a pc, does the hand recognition on the remote pc and streams the proc

20 Oct 13, 2022