Model-free control for distributed stream data processing using deep reinforcement learning
LiTeng,XuZhiyuan,TangJian,WangYanzhi +3 more
- 01 Feb 2018
39
TL;DR: In this paper, the authors focus on general-purpose Distributed Stream Data Processing Systems (DSDPSs), which deal with processing of unbounded streams of continuous data at scale distributedly in real or real-time.
read more
Abstract: In this paper, we focus on general-purpose Distributed Stream Data Processing Systems (DSDPSs), which deal with processing of unbounded streams of continuous data at scale distributedly in real or ...
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
Nguyen Cong Luong,Dinh Thai Hoang,Shimin Gong,Dusit Niyato,Ping Wang,Ying-Chang Liang,Dong In Kim +6 more
TL;DR: This paper presents a comprehensive literature review on applications of deep reinforcement learning (DRL) in communications and networking, and presents applications of DRL for traffic routing, resource sharing, and data collection.
1.9K
A Gentle Introduction to Reinforcement Learning and its Application in Different Fields
TL;DR: A literature review of the application of RL to a variety of fields, including robotics and autonomous control, communication and networking, natural language processing, games and self-organized system, scheduling management and configuration of resources, and computer vision is presented.
MIRAS: Model-based Reinforcement Learning for Microservice Resource Allocation over Scientific Workflows
Zhe Yang,Phuong Nguyen,Haiming Jin,Klara Nahrstedt +3 more
- 07 Jul 2019
TL;DR: This paper proposes an adaptive resource allocation approach for microservice workflow system based on recent advances in reinforcement learning and demonstrates that it outperforms existing resource allocation approaches with read-world emulated workflows.
98
Performance and Cost-Efficient Spark Job Scheduling Based on Deep Reinforcement Learning in Cloud Computing Environments
TL;DR: In this article , the authors formulate the job scheduling problem of a cloud-deployed Spark cluster and propose a novel reinforcement learning (RL) model to accommodate the SLA objectives.
69
DeepAPP: a deep reinforcement learning framework for mobile application usage prediction
Zhihao Shen,Kang Yang,Wan Du,Xi Zhao,Jianhua Zou +4 more
- 10 Nov 2019
TL;DR: A deep reinforcement learning framework, named as DeepAPP, which learns a model-free predictive neural network from historical app usage data and reduces the prediction time of the state-of-the-art by 6.58× is presented.
60
References
Human-level control through deep reinforcement learning
Volodymyr Mnih,Koray Kavukcuoglu,David Silver,Andrei Rusu,Joel Veness,Marc G. Bellemare,Alex Graves,Martin Riedmiller,Andreas K. Fidjeland,Georg Ostrovski,Stig Petersen,Charles Beattie,Amir Sadik,Ioannis Antonoglou,Helen King,Dharshan Kumaran,Daan Wierstra,Shane Legg,Demis Hassabis +18 more
TL;DR: This work bridges the divide between high-dimensional sensory inputs and actions, resulting in the first artificial agent that is capable of learning to excel at a diverse array of challenging tasks.
•Book
Data Mining: Concepts and Techniques
Jiawei Han,Micheline Kamber,Jian Pei +2 more
- 08 Sep 2000
TL;DR: This book presents dozens of algorithms and implementation examples, all in pseudo-code and suitable for use in real-world, large-scale data mining projects, and provides a comprehensive, practical look at the concepts and techniques you need to get the most out of real business data.
MillWheel: fault-tolerant stream processing at internet scale
Tyler Akidau,Alex Balikov,Kaya Bekiroglu,Slava Chernyak,Josh Haberman,Reuven Lax,Sam McVeety,Daniel Mills,Paul Nordstrom,Sam Whittle +9 more
- 01 Aug 2013
TL;DR: In practice, this paper finds that MillWheel's unique combination of scalability, fault tolerance, and a versatile programming model lends itself to a wide variety of problems at Google.
Determining the initial states in forward-backward filtering
TL;DR: This work proposes a method to choose the initial state to obtain uniqueness and to remove transients at both ends in forward-backward filtering.
FlumeJava: easy, efficient data-parallel pipelines
Craig D. Chambers,Ashish Raniwala,Frances J. Perry,Stephen R. Adams,Robert R. Henry,Robert Bradshaw,Nathan Weizenbaum +6 more
- 05 Jun 2010
TL;DR: The combination of high-level abstractions for parallel data and computation, deferred evaluation and optimization, and efficient parallel primitives yields an easy-to-use system that approaches the efficiency of hand-optimized pipelines.