A Backpressure Mitigation Scheme in Distributed Stream Processing Engines
- Title
- A Backpressure Mitigation Scheme in Distributed Stream Processing Engines
- Author
- 이춘화
- Keywords
- Streaming; backpressure; SLA; Distributed Computing; Cloud Computing; Engines; Task analysis; Ink; Monitoring; Distributed databases; Pipelines
- Issue Date
- 2020-01
- Publisher
- IEEE
- Citation
- 2020 International Conference on Information Networking (ICOIN), page. 713-716
- Abstract
- There is a significant rise in the adaptation of streaming applications in the past decade by individuals researchers and organizations in both industry and academia. These applications are all based on the modern data stream processing systems that implement resource allocation and management in order to provide an uninterrupted track of queries over incoming input distributed data streams. More than a few stream processing engines exists to handle these distributed streaming applications. These distributed applications have open challenges like backpressure. In this paper, we introduce a backpressure mitigation mechanism for the distributed stream processing systems. The proposed backpressure mitigation technique is a generic one and is feasible to be implemented on top of a number of popular streaming frameworks. We use Flink as a testbed for this work and use its available APIs.
- URI
- https://ieeexplore.ieee.org/document/9016513https://repository.hanyang.ac.kr/handle/20.500.11754/160879
- ISBN
- 978-1-7281-4199-2
- ISSN
- 1976-7684
- DOI
- 10.1109/ICOIN48656.2020.9016513
- Appears in Collections:
- COLLEGE OF ENGINEERING[S](공과대학) > COMPUTER SCIENCE(컴퓨터소프트웨어학부) > Articles
- Files in This Item:
There are no files associated with this item.
- Export
- RIS (EndNote)
- XLS (Excel)
- XML