Journal Article10.1016/J.FUTURE.2021.07.010
Self-aware distributed deep learning framework for heterogeneous IoT edge devices
Yi Jin,Jiawei Cai,Jiawei Xu,Yuxiang Huan,Yuxiang Huan,Yan Yulong,Bin Huang,Yongliang Guo,Li-Rong Zheng,Zhuo Zou +9 more
23
TL;DR: In this article, a self-aware distributed deep learning (DDL) framework for IoT applications is proposed, which is applicable to heterogeneous edge devices aiming to improve adaptivity and amortize the training cost.
read more
About: This article is published in Future Generation Computer Systems. The article was published on 01 Dec 2021. The article focuses on the topics: Edge device & Scalability.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Emerging technologies and design aspects of next generation cyber physical system with a smart city application perspective
Ayaskanta Mishra,Amitkumar Vidyakant Jha,Bhargav Appasani,Arun Kumar Ray,Deepak Gupta,Abu Nasar Ghazali +5 more
TL;DR: This paper comprehensively discusses the different emerging technologies such as Internet of Things, Machine to Machine communication, Machine Learning, Artificial Intelligence, Big-Data, etc for the Next Generation Cyber Physical System (NG-CPS).
43
Communication-efficient distributed AI strategies for the IoT edge
TL;DR: In this article , the authors provide an architecture for enabling AI in fully edge-based scenarios and provide strategies to tackle the communication inefficiencies that arise from the distributed nature of fully edgebased scenarios.
43
MultiCNN-FilterLSTM: Resource-efficient sensor-based human activity recognition in IoT applications
TL;DR: In this article , a deep learning-based human activity recognition (HAR) model, called MultiCNN-FilterLSTM, was proposed, which combines a multi-head convolutional neural network (CNN) with a long-short-term memory (LR) through a residual connection.
37
Edge-Based Collaborative Training System for Artificial Intelligence-of-Things
Yi Jin,Bin Huang,Yulong Yan,Yuxiang Huan,Jiawei Xu,Shan Cang Li,Prosanta Gope,Li Da Xu,Zhuo Zou,Lirong Zheng +9 more
TL;DR: Experimental results demonstrate that the proposed design can collaboratively perform training tasks with optimized efficiency and provide dependable collaborations for system fault detection and cluster extension.
17
References
Deep Residual Learning for Image Recognition
Kaiming He,Xiangyu Zhang,Shaoqing Ren,Jian Sun +3 more
- 27 Jun 2016
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
•Posted Content
TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems
Martín Abadi,Ashish Agarwal,Paul Barham,Eugene Brevdo,Zhifeng Chen,Craig Citro,Greg S. Corrado,Andy Davis,Jeffrey Dean,Matthieu Devin,Sanjay Ghemawat,Ian Goodfellow,Andrew Harp,Geoffrey Irving,Michael Isard,Yangqing Jia,Rafal Jozefowicz,Lukasz Kaiser,Manjunath Kudlur,Josh Levenberg,Dan Mané,Rajat Monga,Sherry Moore,Derek G. Murray,Chris Olah,Mike Schuster,Jonathon Shlens,Benoit Steiner,Ilya Sutskever,Kunal Talwar,Paul A. Tucker,Vincent Vanhoucke,Vijay K. Vasudevan,Fernanda B. Viégas,Oriol Vinyals,Pete Warden,Martin Wattenberg,Martin Wicke,Yuan Yu,Xiaoqiang Zheng +39 more
TL;DR: The TensorFlow interface and an implementation of that interface that is built at Google are described, which has been used for conducting research and for deploying machine learning systems into production across more than a dozen areas of computer science and other fields.
Federated Optimization in Heterogeneous Networks
Tian Li,Anit Kumar Sahu,Manzil Zaheer,Maziar Sanjabi,Ameet Talwalkar,Virginia Smith +5 more
- 15 Mar 2020
TL;DR: This work introduces a framework, FedProx, to tackle heterogeneity in federated networks, and provides convergence guarantees for this framework when learning over data from non-identical distributions (statistical heterogeneity), and while adhering to device-level systems constraints by allowing each participating device to perform a variable amount of work.
•Journal Article
Docker: lightweight Linux containers for consistent development and deployment
TL;DR: Docker promises the ability to package applications and their dependencies into lightweight containers that move easily between different distros, start up quickly and are isolated from each other.
3.4K
Privacy-Preserving Deep Learning
Reza Shokri,Vitaly Shmatikov +1 more
- 12 Oct 2015
TL;DR: This paper presents a practical system that enables multiple parties to jointly learn an accurate neural-network model for a given objective without sharing their input datasets, and exploits the fact that the optimization algorithms used in modern deep learning, namely, those based on stochastic gradient descent, can be parallelized and executed asynchronously.