Coder Social home page Coder Social logo

lee-gihun / fedntd Goto Github PK

View Code? Open in Web Editor NEW
72.0 2.0 14.0 373 KB

(NeurIPS 2022) Official Implementation of "Preservation of the Global Knowledge by Not-True Distillation in Federated Learning"

License: MIT License

Python 100.00%
artificial-intelligence computer-vision continual-learning deep-learning deep-neural-networks distributed-learning fedavg federated-learning knowledge-distillation machine-learning

fedntd's Issues

About the experiment setting

Hi, amazing work! However, have you ever test the setting when the number of clients is 10. I found that the NTD didn't show better performance when compared with Fedavg when the clients are ten.

How the results in Table 1 were obtained?

Thanks for your great work and great code!

I reproduce the experiments on MNIST under NIID Partition Strategy : Sharding with FedAvg and Fedprox. I modify the dataset name to mnist in both fedavg.json and fedprox.json, and the local_epochs is modified to 3. I got the [Server Stat] Acc = 86 at round 67 for FedAvg and got [Server Stat] Acc = 90 at round 67 for Fedprox, which is obviously higher than their reported in Tab.1 of your paper.

So my question is how the results in Table 1 were obtained? Were the results obtained by averaging the performance of each round instead of selecting the best acc in a certain round?

In fact, I am new to federated learning and not very familiar with the methods of performance calculation. I appreciate your guidance.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.