Home

CONFLuEnCE: CONtinuous workFLows ExeCution Engine

Overview  |  Funding  |  People  |  Screenshots  |  Project Publications  |  Related Publications

Overview

Data streams have become pervasive and data production rates are increasing exponentially, driven by advances in technology, for example the proliferation of sensors, smart phones, and their applications. This fact effectuates an unprecedented opportunity to build real-time monitoring and analytics applications, which when used collaboratively and interactively, will provide insights to every aspect of our environment, both in the business and scientific domains.

We have identified the need for workflow management systems which are capable of orchestrating the processing of multiple heterogeneous data streams, while enabling their users to interact collaboratively with the workflows in real time. Based on that model we have built our prototype workflow enactments system: CONFLuEnCE (CONtinuous workFLow ExeCution Engine). CONFLuEnCE is built on top of Kepler, an existing workflow management system, by fusing stream semantics and stream processing methods as another computational domain. Furthermore, we have designed and implemented real-life business and scientific continuous workflow monitoring applications, which attest to the ease of use and applicability of our system.

Top

Funding

Partially funded by NSF OIA-1028162 (PI: Alexandros Labrinidis; Co-PIs: Panos Chrysanthis, Jeffrey Newman, Georgeta Marai, William Wood-Vasey) NSF Abstract

Top

People
Faculty:
Graduate Students:

Top

Screenshots

Top

Project papers

 

    [ 2013 | 2012 | 2011 | 2009 ]

    2013

  1. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, A continuous workflow scheduling framework, Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies (SWEET'13), 1-12, June 2013.

    2. 2012

  2. Panayiotis Neophytou, Roxana Gheorghiu, Rebecca Hachey, Timothy Luciani, Di Bao, Alexandros Labrinidis, G. Elisabeta Marai, Panos K. Chrysanthis, AstroShelf: Understanding the Universe Through Scalable Navigation of a Galaxy of Annotations, Proc. of the 31st ACM International Conference on Management of Data (SIGMOD'12), pp. 1-4, Scottsdale, Arizona, May 2012.

    3. 2011

  3. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, CONFLuEnCE: Implementation and Application Design, Proc. of the 7th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom'11), pp. 181-190, Orlando, Florida, October 2011.

  4. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, CONFLuEnCE: CONtinuous workFLow ExeCution Engine, Proc. of the 30th ACM International Conference on Management of Data (SIGMOD'11), pp. 1311-1314, Athens, Greece, June 2011, DOI:10.1145/1989323.1989485.

    5. 2009

  5. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, Towards Continuous Workflow Enactment Systems, Collaborative Computing: Networking, Applications and Worksharing (Springer Berlin Heidelberg), 162-178, Berlin, January 2009.

Top

Related publications

 

    [ 2016 | 2015 | 2014 | 2013 | 2012 | 2011 ]

    2016

  1. Cory Thoma, Adam J. Lee, Alexandros Labrinidis, PolyStream: Cryptographically Enforced Access Controls for Outsourced Data Stream Processing, Symposium on Access Control Models and Technologies (SACMAT'16), Shanghai, China, June 2016.

  2. Angen Zheng, Alexandros Labrinidis, Panos K. Chrysanthis, Planar: Parallel Lightweight Architecture-Aware Adaptive Graph Repartitioning, 32nd IEEE International Conference on Data Engineering (ICDE'16), 121-132, May 2016.

  3. Humaira Ehsan, Mohamed A. Sharaf, Panos K. Chrysanthis, MuVE: Efficient Multi-Objective View Recommendation for Visual Data Exploration, 32nd IEEE International Conference on Data Engineering (ICDE'16), 731-742, May 2016.

  4. Thao N. Pham, Panos K. Chrysanthis, Alexandros Labrinidis, Avoiding class warfare: Managing Continuous Queries with Differentiated Classes of Service, VLDB Journal (VLDB J. 2016), 25(2):197-221, April 2016, 11/12/2015 published on-line.

  5. Angen Zheng, Alexandros Labrinidis, Patrick H. Pisciuneri, Panos K. Chrysanthis, Peyman Givi, PARAGON: Parallel Architecture-Aware Graph Partition Refinement Algorithm, 19th International Conference on Extending Database Technology (EDBT'16), 365-376, January 2016.

    6. 2015

  6. Patrick H. Pisciuneri, Angen Zheng, Peyman Givi, Alexandros Labrinidis, Panos K. Chrysanthis, Repartitioning Strategies for Massively Parallel Simulation of Reacting Flow, 68th Annual Meeting of the APS Division of Fluid Dynamics (APS'15), 60(21):503, November 2015.

  7. Andreas Konstantinidis, George Nikolaides, Georgios Chatzimilioudis, Giannis Evagorou, Demetrios Zeinalipour-Yazti, Panos K. Chrysanthis, Radiomap Prefetching for Indoor Navigation in Intermittently Connected Wi-Fi Networks, 16th IEEE International Conference on Mobile Data Management (MDM'15), Vol.1, pp. 34-43, June 2015.

  8. Nick R. Katsipoulakis, Cory Thoma, Eric A. Gratta, Alexandros Labrinidis, Adam J. Lee, Panos K. Chrysanthis, CE-Storm: Confidential Elastic Processing of Data Streams, Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD'15), 859-864, May 2015.

  9. Roxana Gheorghiu, Alexandros Labrinidis, Panos K. Chrysanthis, Unifying Qualitative and Quantitative Database Preferences to Enhance Query Personalization, 2nd International Workshop on Exploratory Search in Databases and the Web (ExploreDB'15), 6-8, May 2015, Co-located with ACM SIGMOD 2015.

  10. Xiaoyu Ge, Panos K. Chrysanthis, Alexandros Labrinidis, Preferential Diversity, 2nd International Workshop on Exploratory Search in Databases and the Web (ExploreDB'15), 9-14, May 2015, Co-located with ACM SIGMOD 2015.

  11. Nathan R. Ong, Stephen E. Rojcewicz, Nicholas L. Farnan, Adam J. Lee, Panos K. Chrysanthis, Ting Yu, Interactive Preference-aware Query Optimization, IEEE 31st International Conference on Data Engineering (ICDE'15), 1512-1515, Seoul, South Korea, April 2015.

    12. 2014

  12. Angen Zheng, Alexandros Labrinidis, Panos K. Chrysanthis, Architecture-Aware Graph Repartitioning for Data-Intensive Scientific Computing, 1st International Workshop on High Performance Big Graph Data Management, Analysis, and Mining (BigGraphDM'14), 78-85, October 2014.

  13. Roxana Gheorghiu, Alexandros Labrinidis, Panos K. Chrysanthis, A user-friendly framework for database preferences, The 10th International Conference on Collaborative Computing (CollaborateCom'14), 1-10, Miami, Florida, USA, October 2014.

  14. Nicholas L. Farnan, Adam J. Lee, Panos K. Chrysanthis, Ting Yu, PAQO: Preference-Aware Query Optimization for Decentralized Database Systems, IEEE International Conference on Data Engineering (ICDE'14), 424-435, April 2014.

    15. 2013

  15. Nicholas L. Farnan, Adam J. Lee, Panos K. Chrysanthis, Ting Yu, PAQO: A Preference-Aware Query Optimizer for PostgreSQL, International Conference on Very Large Databases (VLDB'13), 6(12): 1334-1337, August 2013.

  16. Nicholas L. Farnan, Adam J. Lee, Panos K. Chrysanthis, Ting Yu, Enabling Intensional Access Control via Preference-aware Query Optimization, Symposium on Access Control Models and Technologies (SACMAT'13), 189-192, Amsterdam, The Netherlands, June 2013.

    17. 2012

  17. Roxana Gheorghiu, Alexandros Labrinidis, Panos K. Chrysanthis, Database Preferences -A Unified Model, 6th International Workshop on Personalized Access, Profile Management, and Context Awareness in Databases (PersDB'12), 1-6, August 2012.

  18. Lory Al Moakar, Alexandros Labrinidis, Panos K. Chrysanthis, Adaptive Class-Based Scheduling of Continuous Queries, Proc. of the Seventh International Workshop on Self-Managing Database Systems (SMDB'12), pp. 1-6, April 2012.

    19. 2011

  19. Marian K. Iskander, Dave W. Wilkinson, Adam J. Lee, Panos K. Chrysanthis, Enforcing Policy and Data Consistency of Cloud Transactions, Proc. of the 2nd ICDCS International Workshop on Security and Privacy on the Cloud (ICDCS-SPCC'11), pp. 253-262, Minneapolis, Minnesota, June 2011, DOI:10.1109/ICDCSW.2011.42.

Top