Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2675743.2774214acmconferencesArticle/Chapter ViewAbstractPublication PagesdebsConference Proceedingsconference-collections
research-article

Solution patterns for realtime streaming analytics

Published: 24 June 2015 Publication History

Abstract

Large-scale data analytics has received much attention under the theme "Big Data". Big data usecases have found a wide range of applications from individual health monitoring to urban planning. Even at this initial stage, big data has demonstrated it's potential to transform the world. Although most early use cases used batch processing technologies like MapReduce, there are many usecases such as stock markets, traffic, surveillance, and patient monitoring that need realtime analytics. Realtime Analytics Technologies like Apache Storm, Spark Streaming, and several Complex Event Processing systems have received attention under realtime analytics. However, most practitioners still focus on implementing realtime analytics from the scratch. There is no common shared understanding about how to implement those analytics usecases among the early adopters. This tutorial tries to address this gap by describing thirteen common relatime analytics patterns and explaining how to implement them. In the discussion, we will draw heavily from real life usecases done under Complex Event Processing and other technologies.

References

[1]
Apache samza. http://samza.apache.org/. Accessed: 2015-05-02.
[2]
Apache storm. https://storm.apache.org/. Accessed: 2015-05-02.
[3]
Cep tooling market survey. http://www.complexevents.com/2014/12/03/cep-tooling-market-survey-2014/. Accessed: 2015-05-02.
[4]
Complex event processing: Ten design patterns. http://complexevents.com/wp-content/uploads/2007/04/Coral8DesignPatterns.pdf. Accessed: 2015-05-02.
[5]
Esper complex event processing engine. http://www.espertech.com/. Accessed: 2015-05-02.
[6]
Esper solution patterns. http://www.espertech.com/esper/solution_patterns.php. Accessed: 2015-05-02.
[7]
Football demo based on debs 2013 grand challenge. https://www.youtube.com/watch?v=nRI6buQ0NOM. Accessed: 2015-05-02.
[8]
Questioning the lambda architecture. http://radar.oreilly.com/2014/07/questioning-the-lambda-architecture.html. Accessed: 2015-05-02.
[9]
Sap hana. http://hana.sap.com/abouthana.html. Accessed: 2015-05-02.
[10]
Siddhi complex event processing library. https://github.com/wso2/siddhi. Accessed: 2015-05-02.
[11]
Tibco streambase. http://www.tibco.com/products/event-processing/complex-event-processing/streambase-complex-event-processing. Accessed: 2015-05-02.
[12]
Voltdb. http://voltdb.com/. Accessed: 2015-05-02.
[13]
Wso2 london tfl demo. https://www.youtube.com/watch?v=mjPPbTFAqes. Accessed: 2015-05-02.
[14]
D. Abadi, Y. Ahmad, et al. The design of the borealis stream processing engine. In Second Biennial Conference on Innovative Data Systems Research (CIDR 2005), Asilomar, CA, pages 277--289, 2005.
[15]
D. Abadi, D. Carney, et al. Aurora: a data stream management system. In Proceedings of the 2003 ACM SIGMOD international conference on Management of data, pages 666--666, 2003.
[16]
R. Arachchi, M. Bandara, et al. A complex event processing toolkit for detecting technical chart patterns. High Performance Big Data and Cloud Computing Workshop (HPBC), 2015.
[17]
T. N. Bulkowski. Encyclopedia of chart patterns, volume 225. John Wiley & Sons, 2011.
[18]
G. Cugola and A. Margara. Processing flows of information: From data stream to complex event processing. ACM Computing Surveys, 2012.
[19]
A. Paschke and P. Vincent. A reference architecture for event processing. In Proceedings of the Third ACM International Conference on Distributed Event-Based Systems, page 25. ACM, 2009.
[20]
S. Suhothayan, K. Gajasinghe, I. L. Narangoda, S. Chaturanga, S. Perera, and V. Nanayakkara. Siddhi: A second look at complex event processing architectures. In Gateway Computing Environments Workshop (GCE). IEEE, 2011.

Cited By

View all
  • (2024)Exploring Business analytics: Trends, Challenges, Advantages, and Background Implementation2024 4th International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET)10.1109/IRASET60544.2024.10548079(1-6)Online publication date: 16-May-2024
  • (2023)EPAComp: An Architectural Model for EPA CompositionProceedings of the XIX Brazilian Symposium on Information Systems10.1145/3592813.3592889(61-69)Online publication date: 29-May-2023
  • (2022)The Use of a Modelling & Simulation Tier by the EMULSION IoT PlatformWSEAS TRANSACTIONS ON SYSTEMS AND CONTROL10.37394/23203.2022.17.1517(133-141)Online publication date: 3-Mar-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
DEBS '15: Proceedings of the 9th ACM International Conference on Distributed Event-Based Systems
June 2015
385 pages
ISBN:9781450332866
DOI:10.1145/2675743
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 June 2015

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. complex event processing
  2. data processing
  3. events

Qualifiers

  • Research-article

Conference

DEBS '15

Acceptance Rates

Overall Acceptance Rate 145 of 583 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)1
Reflects downloads up to 25 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Exploring Business analytics: Trends, Challenges, Advantages, and Background Implementation2024 4th International Conference on Innovative Research in Applied Science, Engineering and Technology (IRASET)10.1109/IRASET60544.2024.10548079(1-6)Online publication date: 16-May-2024
  • (2023)EPAComp: An Architectural Model for EPA CompositionProceedings of the XIX Brazilian Symposium on Information Systems10.1145/3592813.3592889(61-69)Online publication date: 29-May-2023
  • (2022)The Use of a Modelling & Simulation Tier by the EMULSION IoT PlatformWSEAS TRANSACTIONS ON SYSTEMS AND CONTROL10.37394/23203.2022.17.1517(133-141)Online publication date: 3-Mar-2022
  • (2022)Persistence of RDF Data into NoSQL: A Survey and a Reference ArchitectureIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2020.299452134:3(1370-1389)Online publication date: 1-Mar-2022
  • (2021)EasyFlinkCEPProceedings of the 30th ACM International Conference on Information & Knowledge Management10.1145/3459637.3482094(3029-3033)Online publication date: 26-Oct-2021
  • (2021)Real-Time Big Data Analytics Perspective on Applications, Frameworks and Challenges2021 7th International Conference on Contemporary Information Technology and Mathematics (ICCITM)10.1109/ICCITM53167.2021.9677849(1-6)Online publication date: 25-Aug-2021
  • (2021)A Modelling & Simulation Tier Design for the EMULSION IoT Platform2021 International Conference Automatics and Informatics (ICAI)10.1109/ICAI52893.2021.9639638(279-282)Online publication date: 30-Sep-2021
  • (2020)Extended Kalman Filter for Large Scale Vessels Trajectory Tracking in Distributed Stream Processing SystemsAdvanced Analytics and Learning on Temporal Data10.1007/978-3-030-39098-3_12(151-166)Online publication date: 23-Jan-2020
  • (2017)Identifying the potential of near data processing for apache sparkProceedings of the International Symposium on Memory Systems10.1145/3132402.3132427(60-67)Online publication date: 2-Oct-2017
  • (2017)Real time analytics — State of the art: Potentials and limitations in the smart factory2017 IEEE International Conference on Big Data (Big Data)10.1109/BigData.2017.8258562(4843-4845)Online publication date: Dec-2017
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media