Distributed stream processing at edge

Abstract

A vast amount of data is produced by billions of modern devices each year. An effective Stream Processing Engine (SPE) is needed to arrange and handle this data. Among the well-known SPEs are Apache Hadoop, Apache Spark, and Apache Storm. SPE researchers are working hard to improve their efficiency, and one area of study uses these techniques in a distributed edge setting. after reading through a number of SPE research papers. EdgeWise: A Better Stream Processing Engine for the Edge has been put into practice and tested. This study attempts to optimize Apache Storm's performance by adjusting the threads' OS-level scheduling. Driven by the same, our objective is to enhance Apache Storm's throughput and latency.