AQSIOS: Algorithms and Metrics for New Generation Data Stream Management Systems

Overview  |  Funding  |  News  |  Press  |  Releases  |  People  |  Project Publications  |  Related publications

Overview

The goal of this project is to design a new generation of data stream management systems (DSMSs), with equal emphasis on optimizing performance and enhancing functionality. New generation DSMSs simplify the development of a wide range of monitoring applications, with diverse requirements. Monitoring applications are core components in scientific exploration, health alerting, environmental monitoring, and business support systems. This project reexamines all four critical components of a DSMS: query scheduler, load shedder, query processor, and data dissemination modules. The two key innovations of this project are: (1) it looks at how these four modules can be integrated to work in combination, instead of making in isolation decisions that have a significant impact on the overall performance; and (2) this project formalizes QoS/QoD metrics for DSMSs and develops algorithms designed to optimize these metrics. In addition, the project plans include the analytical and experimental evaluation of the proposed algorithms and also the implementation and evaluation of a prototype system. This project provides opportunities for both graduate and undergraduate students to participate in the development of cutting edge technology.

Top

Funding

IIS-0534531 (PI: Panos K. Chrysanthis; Co-PIs: Alexandros Labrinidis, Kirk Pruhs) NSF Abstract

Top

News

  • APR 2010:  Shenoda Guirguis passed his PhD Thesis proposal, out of his work in AQSIOS Project.
  • FEB 2010:  AQSIOS 1.0 was released.
  • AUG 2007: Mohamed Sharaf earned his PhD degree out of his work in AQSIOS project.
Top

Press

Top

AQSIOS Software Releases

  • AQSIOS 1.0 Scheduling policies release. Released.
  • AQSIOS 2.0 Load Shedding release. Released.
  • AQSIOS 3.0 Query Optimization release. To be released (Scheduled for Aug 2011).
Top

People

Faculty: Collaborators:
Graduate Students:
Top

Project papers

 

    [ 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 ]

    2017

  1. Thao N. Pham, Nikos R. Katsipoulakis, Panos K. Chrysanthis, Alexandros Labrinidis, Uninterruptible Migration of Continuous Queries without Operator State Migration, ACM SIGMOD Record (SIGMOD Record), 46(3):17-22, September 2017.

  2. Anatoli U. Shein, Panos K. Chrysanthis, Alexandros Labrinidis, FlatFIT, Aggregate Continuous Query, Sliding-Window Processing, 29th International Conference on Scientific and Statistical Database Management (SSDBM '17), 5.1-5.12, June 2017.

  3. 2016

  4. Thao N. Pham, Panos K. Chrysanthis, Alexandros Labrinidis, Avoiding class warfare: Managing Continuous Queries with Differentiated Classes of Service, VLDB Journal (VLDB J. 2016), 25(2):197-221, April 2016, 11/12/2015 published on-line.

  5. 2015

  6. Anatoli U. Shein, Panos K. Chrysanthis, Alexandros Labrinidis, F1: Accelerating the optimization of Aggregate Continuous Queries, Proceedings of the 24th ACM International Conference on Information and Knowledge Management (CIKM'15), 1151-1160, Melbourne, Australia, October 2015.

  7. Anatoli U. Shein, Panos K. Chrysanthis, Alexandros Labrinidis, Processing of Aggregate Continuous Queries in a Distributed Environment, Proceedings of the 9th International Workshop on Business Intelligence for the Real Time Enterprise (BIRTE'15), Hawaii, USA, August 2015, Web Proceedings: http://db.cs.pitt.edu/birte2015.

  8. Anatoli U. Shein, Panos K. Chrysanthis, Alexandros Labrinidis, Scalable Processing of Aggregate Continuous Queries in a Distributed Environment, Proc. of ACM Symposium on Cloud Computing (SoCC 2015), August 2015.

  9. Chelsea Mafrica, John Johnson, Santiago Bock, Thao N. Pham, Bruce R. Childers, Panos K. Chrysanthis, Alexandros Labrinidis, Stream Query Processing on Emerging Memory Architectures, Proc. of the 4th IEEE Non-Volatile Memory Systems and Applications Symposium (NVMSA'15), August 2015.

  10. 2013

  11. Thao N. Pham, Panos K. Chrysanthis, Alexandros Labrinidis, Self-managing load shedding for data stream management systems, The Eighth International Workshop on Self-Managing Database Systems (SMDB'13), pp. 1-7, April 2013.

  12. 2012

  13. Lory Al Moakar, Panos K. Chrysanthis, Christine Chung, Shenoda Guirguis, Alexandros Labrinidis, Panayiotis Neophytou, Kirk Pruhs, Auction-based Admission Control for Continuous Queries in a Multi-Tenant DSMS, International Journal of Next-Generation Computing (IJNGC), 3(3):247-273, November 2012.

  14. Shenoda Guirguis, Panos K. Chrysanthis, Alexandros Labrinidis, Mohamed A. Sharaf, Three-level Processing of Multiple Aggregate Continuous Queries, Proc. of the 28th IEEE International Conference on Data Engineering (ICDE'12), pp. 929-940, Washington DC, April 2012.

  15. Lory Al Moakar, Alexandros Labrinidis, Panos K. Chrysanthis, Adaptive Class-Based Scheduling of Continuous Queries, Proc. of the Seventh International Workshop on Self-Managing Database Systems (SMDB'12), pp. 1-6, April 2012.

  16. 2011

  17. Shenoda Guirguis, Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Optimized Processing of Multiple Aggregate Continuous Queries, Proc. of Conference on Information and Knowledge Management (CIKM'11), 1515-1524, Glasgow, UK, October 2011, DOI:10.1145/2063576.2063793.

  18. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, CONFLuEnCE: CONtinuous workFLow ExeCution Engine, Proc. of the 30th ACM International Conference on Management of Data (SIGMOD'11), pp. 1311-1314, Athens, Greece, June 2011, DOI:10.1145/1989323.1989485.

  19. Jesse Szwedko, Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, Mohamed A. Sharaf, Visualization of Energy Consumption of Continuous Query Processing with Mobile Clients , Proc. of the 12th International IEEE Conference on Mobile Data Management (MDM'11), (1):337-340, Lulea, Sweden, June 2011, DOI:10.1109/MDM.2011.70.

  20. Panayiotis Neophytou, Jesse Szwedko, Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Optimizing the Energy Consumption of Continuous Query Processing with Mobile Clients, Proc. of the 12th International IEEE Conference on Mobile Data Management (MDM'11), (1):98-103, Lulea, Sweden, June 2011, DOI:10.1109/MDM.2011.71.

  21. Thao N. Pham, Lory Al Moakar, Panos K. Chrysanthis, Alexandros Labrinidis, DILoS: A Dynamic Integrated Load Manager and Scheduler for Continuous Queries, The Sixth International Workshop on Self-Managing Database Systems (SMDB'11), pp. 10-15, April 2011, DOI:10.1109/ICDEW.2011.5767652.

  22. Panayiotis Andreou, Demetrios Zeinalipour-Yazti, Andreas Pamboris, Panos K. Chrysanthis, George Samaras, Optimized query routing trees for wireless sensor networks, Information Systems (InfoSys), 3(2):267-291, January 2011, DOI:10.1016/j.is.2010.06.001.

  23. Panayiotis Andreou, Demetrios Zeinalipour-Yazti, Panos K. Chrysanthis, George Samaras, In-Network Data Acquisition and Replication in Mobile Sensor Networks, Distributed and Parallel Databases (DAPD), 29(1-2):87-112, January 2011, DOI:10.1007/s10619-010-7073-4.

  24. Panayiotis Andreou, Demetrios Zeinalipour-Yazti, Panos K. Chrysanthis, George Samaras, Power Efficiency through Tuple Ranking in Wireless Sensor Network Monitoring, Distributed and Parallel Databases (DAPD), 29(1-2):113-150, January 2011, DOI:10.1007/s10619-010-7072-5.

  25. 2010

  26. Panayiotis Neophytou, Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Power-Aware Operator Placement and Broadcasting of Continuous Query Results, Proc. of the ACM International Workshop on Data Engineering for Mobile and Wireless Data Access (MobiDE'10), pp. 1-8, June 2010, DOI:10.1145/1850822.1850831.

  27. Panos K. Chrysanthis, AQSIOS - Next Generation Data Stream Management System, CONET Newsletter (CONET), 1(9):1-3, June 2010.

  28. Lory Al Moakar, Panos K. Chrysanthis, Christine Chung, Shenoda Guirguis, Alexandros Labrinidis, Panayiotis Neophytou, Kirk Pruhs, Admission Control Mechanisms for Continuous Queries in the Cloud, Proc. of the 26th IEEE International Conference on Data Engineering (ICDE'10), Long Beach, CA, USA, March 2010.

  29. Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Tuning QoD in Stream Processing Engines, Twenty-First Australasian Database Conference (ADC'10), pp. 103-112, Brisbane, Australia, January 2010.

  30. 2009

  31. Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Cristiana Amza, Optimizing I/O-Intensive Transactions in Highly Interactive Applications, Proc. of the 28th ACM International Conference on Management of Data (SIGMOD'09), pp. 785-798, June 2009, DOI:10.1145/1559845.1559927.

  32. Jesse Szwedko, Callen Shaw, Alexander G. Connor, Alexandros Labrinidis, Panos K. Chrysanthis, Demonstrating an evacuation algorithm with mobile devices using an e-scavenger hunt game, Proc. of Eighth ACM International Workshop on Data Engineering for Wireless and Mobile Access (MobiDE'09), pp. 49-52, Providence, RI, USA, June 2009, held in conjunction with the SIGMOD 2009 conference, DOI:10.1145/1594139.1594154.

  33. Panayiotis Andreou, Andreas Pamboris, Demetrios Zeinalipour-Yazti, Panos K. Chrysanthis, George Samaras, ETC: Energy-driven Tree Construction in Wireless Sensor Networks, Proc. of the 2nd International Workshop on Sensor Network Technologies for Information Explosion Era (SenTIE'09), pp. 1-6, Taipei, Taiwan, May 2009.

  34. Shenoda Guirguis, Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Kirk Pruhs, Adaptive Scheduling of Web Transactions, Proc. of the 25th IEEE International Conference on Data Engineering (ICDE'09), pp. 357-368, Shanghai, China, April 2009, DOI:10.1109/ICDE.2009.137.

  35. Panayiotis Andreou, Demetrios Zeinalipour-Yazti, Martha Vassiliadou, Panos K. Chrysanthis, George Samaras, KSpot: Effectively Monitoring the K Most Important Events in a Wireless Sensor Network., Proceedings of the IEEE 25th International Conference on Data Engineering (ICDE'09), pp.1503-1506, Shanghai, China, April 2009, DOI:10.1109/ICDE.2009.54.

  36. Shenoda Guirguis, Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, Kirk Pruhs, Expanding Continuous Queries Scope for Better Event Detection, Workshop on Research Directions in Situational-aware Self-managed Proactive Computing in Wireless Adhoc Networks (SSPC'09), pp. 1-3, St. Louis, Missouri, March 2009, SSPC Workshop.

  37. 2008

  38. Mohamed A. Sharaf, Shenoda Guirguis, Alexandros Labrinidis, Kirk Pruhs, Panos K. Chrysanthis, ASETS: A Self-Managing Transaction Scheduler, Proc. of 3rd International Workshop on Self-Managing Database Systems (SMDB'08), pp. 56-62, Cancun, Mexico, April 2008, held in conjunction with the 24th International Conference on Data Engineering (ICDE 2008), DOI:10.1109/ICDEW.2008.4498285.

  39. Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Kirk Pruhs, Algorithms and Metrics for Processing Multiple Heterogeneous Continuous Queries , ACM Transactions in Database Systems (TODS), 33(2):5.1-5.44, March 2008, DOI:10.1145/1331904.1331909.

  40. 2007

  41. Demetrios Zeinalipour-Yazti, Panayiotis Andreou, Panos K. Chrysanthis, George Samaras, MINT Views: Materialized In-Network Top-k Views in Sensor Networks, Proc. of the 7th International Conference in Mobile Data Management (MDM'07), pp. 182-189, Mannheim, Germany, May 2007.

  42. 2006

  43. Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Kirk Pruhs, Efficient Scheduling of Heterogeneous Continuous Queries, Proc. of the 32nd Very Large Databases Conference (VLDB'06), pp. 511-522, Seoul, Korea, September 2006.

  44. 2005

  45. Mohamed A. Sharaf, Alexandros Labrinidis, Panos K. Chrysanthis, Kirk Pruhs, Scheduling Multiple Continuous Queries to Improve QoD, Proc. of the Fourth Hellenic Data Management Symposium (HDMS'05), Athens, Greece, August 2005.

  46. Mohamed A. Sharaf, Alexandros Labrinidis, Panos K. Chrysanthis, Kirk Pruhs, Freshness-Aware Scheduling of Continuous Queries in the Dynamic Web, Proc. of the Eighth International ACM Workshop on the Web and Databases (WebDB'05), pp. 73-78, Baltimore, Maryland, June 2005, held in conjunction with the SIGMOD 2005 Conference.

  47. Mohamed A. Sharaf, Panos K. Chrysanthis, Alexandros Labrinidis, Preemptive Rate-based Operator Scheduling in a Data Stream Management System, Proc. of the Third ACS/IEEE International Conference on Computer Systems and Applications (AICCSA'05), p. 46, Cairo, Egypt, January 2005.

Top

Related publications

 

    [ 2013 | 2011 | 2009 | 2008 | 2007 ]

    2013

  1. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, A continuous workflow scheduling framework, Proceedings of the 2nd ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies (SWEET'13), 1-12, June 2013.

  2. 2011

  3. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, CONFLuEnCE: Implementation and Application Design, Proc. of the 7th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom'11), pp. 181-190, Orlando, Florida, October 2011.

  4. 2009

  5. Lory Al Moakar, Thao N. Pham, Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, Mohamed A. Sharaf, Class-based Continuous Query Scheduling for Data Streams, Proc. of the 6th International Workshop on Data Management for Sensor Networks (DMSN'09), pp. 1-6, Lyon, France, August 2009, held in conjunction with the VLDB 2009 Conference, DOI:10.1145/1594187.1594199.

  6. Panayiotis Andreou, Orestis Spanos, Demetrios Zeinalipour-Yazti, George Samaras, Panos K. Chrysanthis, FSort: External Sorting on Flash-based Sensor Devices, Proc. of 6th International Workshop on Data Management for Sensor Networks (DMSN'09), Lyon, France, August 2009, held in conjunction with the VLDB 2009 Conference.

  7. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, Towards Continuous Workflow Enactment Systems, Collaborative Computing: Networking, Applications and Worksharing (Springer Berlin Heidelberg), 162-178, Berlin, January 2009.

  8. 2008

  9. Panayiotis Neophytou, Panos K. Chrysanthis, Alexandros Labrinidis, Towards Continuous Workflow Enactment Systems, Proc. of the 4th International Conference on Collaborative Computing: Networking, Applications and Worksharing (CollaborateCom'08), Orlando, Florida, November 2008.

  10. Panayiotis Andreou, Demetrios Zeinalipour-Yazti, Panos K. Chrysanthis, George Samaras, Workload-aware Query Routing Trees inWireless Sensor Networks, Proc. of the 9th Int'l Conference on Mobile Data Management (MDM'08), pp. 1-8, Beijing, China, April 2008, DOI:10.1109/MDM.2008.13.

  11. 2007

  12. Alexandros Labrinidis, Huiming Qu, Jie Xu, Quality Contracts for Real-Time Enterprises, Lecture Notes in Computer Science 4365: Post Proceedings of First International Workshop on Business Intelligence for the Real Time Enterprise (BIRTE'06), pp. 143-156, September 2007, BIRTE'06 was held in conjunction with the VLDB'06 Conference, Seoul, Korea, Sept. 2006.

  13. Demetrios Zeinalipour-Yazti, Panayiotis Andreou, Panos K. Chrysanthis, George Samaras, Andreas Pitsillides, The MicroPulse Framework for Adaptive Waking Windows in Sensor Networks, International Workshop on Data Intensive Sensor Networks 2007 (DISN'07), pp. 351-355, Mannheim, Germany, May 2007, held in conjunction with MDM'07, DOI:10.1109/MDM.2007.74.

Top