000225696 001__ 225696
000225696 005__ 20180913064204.0
000225696 020__ $$a978-1-5090-2825-2
000225696 0247_ $$2doi$$a10.1109/Icppw.2016.42
000225696 022__ $$a1530-2016
000225696 02470 $$2ISI$$a000392498600026
000225696 037__ $$aCONF
000225696 245__ $$aCyclone: Unified Stream and Batch Processing
000225696 260__ $$bIeee$$c2016$$aNew York
000225696 269__ $$a2016
000225696 300__ $$a10
000225696 336__ $$aConference Papers
000225696 490__ $$aInternational Conference on Parallel Processing Workshops
000225696 520__ $$aDue to the rising demand for large-scale data processing, there is a growing interest in both batch processing, where large volumes of data are processed offline, and stream processing, where large quantities of streaming data are processed online. The dichotomy between these vastly different computing paradigms has led to the development of substantially different methodologies and systems. As there is an increasing number of applications requiring stream and batch processing, there is a need to bridge this gap and offer support for both paradigms. We introduce a new direction for the unification of stream and batch processing, which, contrary to other proposed approaches, uses a stream processing platform as its foundation and supports batch processing on top. Our proof-of-concept implementation of such a middleware layer, called Cyclone, offers the widely popular MapReduce programming model and translates MapReduce jobs for execution on the underlying streaming platform. Cyclone not only achieves a tight integration of batch and stream processing, our evaluation further shows significant performance gains, in particular for sequential and iterative jobs, which naturally arise in many applications.
000225696 6531_ $$astream processing
000225696 6531_ $$abatch processing
000225696 6531_ $$adistributed systems
000225696 6531_ $$aiterative algorithms
000225696 6531_ $$aMapReduce
000225696 700__ $$uABB Corp Res, Baden, Switzerland$$aHarvan, Matus
000225696 700__ $$uABB Corp Res, Baden, Switzerland$$aLocher, Thomas
000225696 700__ $$0249004$$g226541$$aSima, Ana Claudia
000225696 7112_ $$dAUG 16-19, 2016$$cPhiladelphia, PA$$a45th International Conference on Parallel Processing (ICPP)
000225696 773__ $$tProceedings Of 45Th International Conference On Parallel Processing Workshops (Icppw 2016)$$q220-229
000225696 909C0 $$xU11275$$0252225$$pDSLAB
000225696 909CO $$pconf$$pIC$$ooai:infoscience.tind.io:225696
000225696 917Z8 $$x172241
000225696 937__ $$aEPFL-CONF-225696
000225696 973__ $$rREVIEWED$$sPUBLISHED$$aOTHER
000225696 980__ $$aCONF