Jakub Konečný
40 Papers
258 Citations
Jakub Konečný is an academic researcher from Google. The author has contributed to research in topics: Computer science & Convex function. The author has an hindex of 22, co-authored 35 publications. Previous affiliations of Jakub Konečný include Comenius University in Bratislava & University of Edinburgh.
Chat about Author
Papers
•Posted Content
Federated Learning: Strategies for Improving Communication Efficiency
Jakub Konečný,H. Brendan McMahan,Felix X. Yu,Peter Richtárik,Ananda Theertha Suresh,Dave Bacon +5 more
TL;DR: Two ways to reduce the uplink communication costs are proposed: structured updates, where the user directly learns an update from a restricted space parametrized using a smaller number of variables, e.g. either low-rank or a random mask; and sketched updates, which learn a full model update and then compress it using a combination of quantization, random rotations, and subsampling.
•Posted Content
Federated Optimization: Distributed Machine Learning for On-Device Intelligence
TL;DR: A new and increasingly relevant setting for distributed optimization in machine learning, where the data defining the optimization are unevenly distributed over an extremely large number of nodes, is introduced, to train a high-quality centralized model.
•Posted Content
Towards Federated Learning at Scale: System Design
Keith Bonawitz,Hubert Eichner,Wolfgang Grieskamp,Dzmitry Huba,Alex Ingerman,Vladimir Ivanov,Chloe Kiddon,Jakub Konečný,Stefano Mazzocchi,H. Brendan McMahan,Timon Van Overveldt,David Petrou,Daniel Ramage,Jason Roselander +13 more
TL;DR: In this paper, a scalable production system for federated learning in the domain of mobile devices, based on TensorFlow, is presented. Butler et al. describe the resulting high-level design, sketch some of the challenges and their solutions, and touch upon the open problems and future directions.
Towards Federated Learning at Scale: System Design
Keith Bonawitz,Hubert Eichner,Wolfgang Grieskamp,Dzmitry Huba,Alex Ingerman,Vladimir Ivanov,Chloe Kiddon,Jakub Konečný,Stefano Mazzocchi,H. Brendan McMahan,Timon Van Overveldt,David Petrou,Daniel Ramage,Jason Roselander +13 more
- 15 Apr 2019
TL;DR: A scalable production system for Federated Learning in the domain of mobile devices, based on TensorFlow is built, describing the resulting high-level design, and sketch some of the challenges and their solutions.
•Posted Content
Advances and Open Problems in Federated Learning
Peter Kairouz,H. Brendan McMahan,Brendan Avent,Aurélien Bellet,Mehdi Bennis,Arjun Nitin Bhagoji,Kallista Bonawitz,Zachary Charles,Graham Cormode,Rachel Cummings,Rafael G. L. D'Oliveira,Hubert Eichner,Salim El Rouayheb,David Evans,Josh Gardner,Zachary Garrett,Adrià Gascón,Badih Ghazi,Phillip B. Gibbons,Marco Gruteser,Zaid Harchaoui,Chaoyang He,Lie He,Zhouyuan Huo,Ben Hutchinson,Justin Hsu,Martin Jaggi,Tara Javidi,Gauri Joshi,Mikhail Khodak,Jakub Konečný,Aleksandra Korolova,Farinaz Koushanfar,Sanmi Koyejo,Tancrède Lepoint,Yang Liu,Prateek Mittal,Mehryar Mohri,Richard Nock,Ayfer Ozgur,Rasmus Pagh,Mariana Raykova,Hang Qi,Daniel Ramage,Ramesh Raskar,Dawn Song,Weikang Song,Sebastian U. Stich,Ziteng Sun,Ananda Theertha Suresh,Florian Tramèr,Praneeth Vepakomma,Jianyu Wang,Li Xiong,Zheng Xu,Qiang Yang,Felix X. Yu,Han Yu,Sen Zhao +58 more
TL;DR: Motivated by the explosive growth in FL research, this paper discusses recent advances and presents an extensive collection of open problems and challenges.
1.2K