Journal Article10.1109/COMST.2021.3091684
A Comprehensive Survey on Coded Distributed Computing: Fundamentals, Challenges, and Networking Applications
Jer Shyuan Ng,Wei Yang Bryan Lim,Nguyen Cong Luong,Zehui Xiong,Alia Asheralieva,Dusit Niyato,Cyril Leung,Chunyan Miao +7 more
103
TL;DR: Coded distributed computing (CDC) as discussed by the authors is a combination of coding theoretic techniques and distributed computing, which has been recently proposed as a promising solution to reduce communication load and straggler effects.
read more
Abstract: Distributed computing has become a common approach for large-scale computation tasks due to benefits such as high reliability, scalability, computation speed, and cost-effectiveness. However, distributed computing faces critical issues related to communication load and straggler effects. In particular, computing nodes need to exchange intermediate results with each other in order to calculate the final result, and this significantly increases communication overheads. Furthermore, a distributed computing network may include straggling nodes that run intermittently slower. This results in a longer overall time needed to execute the computation tasks, thereby limiting the performance of distributed computing. To address these issues, coded distributed computing (CDC), i.e., a combination of coding theoretic techniques and distributed computing, has been recently proposed as a promising solution. Coding theoretic techniques have proved effective in WiFi and cellular systems to deal with channel noise. Therefore, CDC may significantly reduce communication load, alleviate the effects of stragglers, provide fault-tolerance, privacy and security. In this survey, we first introduce the fundamentals of CDC, followed by basic CDC schemes. Then, we review and analyze a number of CDC approaches proposed to reduce the communication costs, mitigate the straggler effects, and guarantee privacy and security. Furthermore, we present and discuss applications of CDC in modern computer networks. Finally, we highlight important challenges and promising research directions related to CDC.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Reliable Distributed Computing for Metaverse: A Hierarchical Game-Theoretic Approach
TL;DR: In this article , a hierarchical game-theoretic collaborative computing framework for the metaverse services, especially for vehicular metaverse, is introduced, where idle resources from vehicles, acting as CDC workers, are aggregated to handle intensive computation tasks in the vehicular metropolis.
86
Towards 6G hyper-connectivity: Vision, challenges, and key enabling technologies
TL;DR: In this article , the authors identify the main challenges for 6G hyperconnectivity, including terabits-per-second (Tbps) data rates for immersive user experiences, zero coverage-hole networks, and pervasive computing for connected intelligence.
Towards 6G Hyper-Connectivity: Vision, Challenges, and Key Enabling Technologies
Howon Lee,Byungju Lee,Heecheol Yang,Junghyun Kim,Seung-Nam Kim,Wonjae Shin,Byonghyo Shim,H. Vincent Poor +7 more
TL;DR: In this paper , the authors identify the main challenges for 6G hyperconnectivity, including terabits-per-second (Tbps) data rates for immersive user experiences, zero coverage-hole networks, and pervasive computing for connected intelligence.
•Posted Content
Reliable Coded Distributed Computing for Metaverse Services: Coalition Formation and Incentive Mechanism Design.
TL;DR: In this article, a reliable collaborative coded distributed computing (CDC) framework for real-time rendering in the metaverse is proposed. And the framework is designed with a hierarchical structure composed of coalition formation and Stackelberg games to determine stable coalitions and rewards for reliable workers.
21
References
Deep Residual Learning for Image Recognition
Kaiming He,Xiangyu Zhang,Shaoqing Ren,Jian Sun +3 more
- 27 Jun 2016
TL;DR: In this article, the authors proposed a residual learning framework to ease the training of networks that are substantially deeper than those used previously, which won the 1st place on the ILSVRC 2015 classification task.
•Posted Content
Deep Residual Learning for Image Recognition
TL;DR: This work presents a residual learning framework to ease the training of networks that are substantially deeper than those used previously, and provides comprehensive empirical evidence showing that these residual networks are easier to optimize, and can gain accuracy from considerably increased depth.
117.9K
•Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
- 04 Sep 2014
TL;DR: This work investigates the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting using an architecture with very small convolution filters, which shows that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 weight layers.
102.6K
ImageNet classification with deep convolutional neural networks
TL;DR: A large, deep convolutional neural network was trained to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes and employed a recently developed regularization method called "dropout" that proved to be very effective.
•Proceedings Article
Very Deep Convolutional Networks for Large-Scale Image Recognition
Karen Simonyan,Andrew Zisserman +1 more
- 01 Jan 2015
TL;DR: In this paper, the authors investigated the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting and showed that a significant improvement on the prior-art configurations can be achieved by pushing the depth to 16-19 layers.
51.9K