Browsing by Author "Liu, M."

Now showing 1 - 9 of 9

Metadata only
E-Cube: multi-dimensional event sequence analysis using hierarchical pattern query sharing
(ACM, 2011-06-12) Liu, M.; Rundensteiner, E.; Greenfield, K.; Gupta, C.; Wang, S.; Arı, İsmail; Mehta, A.; Computer Science; ARI, Ismail
Many modern applications, including online financial feeds, tag-based mass transit systems and RFID-based supply chain management systems transmit real-time data streams. There is a need for event stream processing technology to analyze this vast amount of sequential data to enable online operational decision making. Existing techniques such as traditional online analytical processing (OLAP) systems are not designed for real-time pattern-based operations, while state-of-the-art Complex Event Processing (CEP) systems designed for sequence detection do not support OLAP operations. We propose a novel E-Cube model which combines CEP and OLAP techniques for efficient multi-dimensional event pattern analysis at different abstraction levels. Our analysis of the interrelationships in both concept abstraction and pattern refinement among queries facilitates the composition of these queries into an integrated E-Cube hierarchy. Based on this E-Cube hierarchy, strategies of drill-down (refinement from abstract to more specific patterns) and of roll-up (generalization from specific to more abstract patterns) are developed for the efficient workload evaluation. Our proposed execution strategies reuse intermediate results along both the concept and the pattern refinement relationships between queries. Based on this foundation, we design a cost-driven adaptive optimizer called Chase, that exploits the above reuse strategies for optimal E-Cube hierarchy execution. Our experimental studies comparing alternate strategies on a real world financial data stream under different workload conditions demonstrate the superiority of the Chase method. In particular, our Chase execution in many cases performs ten fold faster than the state-of-the art strategy for real stock market query workloads.
Metadata only
E-Cube: multi-dimensional event sequence processing using concept and pattern hierarchies
(IEEE, 2010) Liu, M.; Rundensteiner, E. A.; Greenfield, K.; Gupta, C.; Wang, S.; Arı, İsmail; Mehta, A.; Computer Science; ARI, Ismail
Many modern applications including tag based mass transit systems, RFID-based supply chain management systems and online financial feeds require special purpose event stream processing technology to analyze vast amounts of sequential multi-dimensional data available in real-time data feeds. Traditional online analytical processing (OLAP) systems are not designed for real-time pattern-based operations, while Complex Event Processing (CEP) systems are designed for sequence detection and do not support OLAP operations. We will demonstrate a novel E-Cube model that combines CEP and OLAP techniques for multi-dimensional event pattern analysis at different abstraction levels. A London transit scenario will be given to demonstrate the utility and performance of this proposed technology.
Metadata only
High-performance complex event processing using continuous sliding views
(ACM, 2013) Ray, M.; Rundensteiner, E. A.; Liu, M.; Gupta, C.; Wang, S.; Arı, İsmail; Computer Science; ARI, Ismail
Complex Event Processing (CEP) has become increasingly important for tracking and monitoring anomalies and trends in event streams emitted from business processes such as supply chain management to online stores in e-commerce. These monitoring applications submit complex event queries to track sequences of events that match a given pattern. While the state-of-the-art CEP systems mostly focus on the execution of flat sequence queries, we instead support the execution of nested CEP queries specified by the (NEsted Event Language) NEEL. However the iterative execution often results in the repeated recomputation of similar or even identical results for nested subexpressions as the window slides over the event stream. In this work we thus propose to optimize NEEL execution performance by caching intermediate results. In particular we design two methods of applying selective caching of intermediate results. The first is the Continuous Sliding Caching technique. The second is a further optimization of the previous technique which we call the Interval-Driven Semantic Caching. Techniques for incrementally loading, purging and exploiting the cache content are described. Our experimental study using real-world stock trades evaluates the performance of our proposed caching strategies for different query types.
Metadata only
High-performance nested CEP query processing over event streams
(IEEE, 2011) Liu, M.; Rundensteiner, E.; Dougherty, D.; Gupta, C.; Wang, S.; Arı, İsmail; Mehta, A.; Computer Science; ARI, Ismail
Complex event processing (CEP) over event streams has become increasingly important for real-time applications ranging from health care, supply chain management to business intelligence. These monitoring applications submit complex queries to track sequences of events that match a given pattern. As these systems mature the need for increasingly complex nested sequence query support arises, while the state-of-art CEP systems mostly support the execution of flat sequence queries only. To assure real-time responsiveness and scalability for pattern detection even on huge volume high-speed streams, efficient processing techniques must be designed. In this paper, we first analyze the prevailing nested pattern query processing strategy and identify several serious shortcomings. Not only are substantial subsequences first constructed just to be subsequently discarded, but also opportunities for shared execution of nested subexpressions are overlooked. As foundation, we introduce NEEL, a CEP query language for expressing nested CEP pattern queries composed of sequence, negation, AND and OR operators. To overcome deficiencies, we design rewriting rules for pushing negation into inner subexpressions. Next, we devise a normalization procedure that employs these rules for flattening a nested complex event expression. To conserve CPU and memory consumption, we propose several strategies for efficient shared processing of groups of normalized NEEL subexpressions. These strategies include prefix caching, suffix clustering and customized “bit-marking” execution strategies. We design an optimizer to partition the set of all CEP subexpressions in a NEEL normal form into groups, each of which can then be mapped to one of our shared execution operators. Lastly, we evaluate our technologies by conducting a performance study to assess the CPU processing time using real-world stock trades data. Our results confirm that our NEEL execution in many cases performs 100 fold fast er than the traditional iterative nested execution strategy for real stock market query workloads.
Metadata only
NEEL: The nested complex event language for real-time event analytics
(Springer International Publishing, 2011) Liu, M.; Rundensteiner, E. A.; Dougherty, D.; Gupta, C.; Wang, S.; Arı, İsmail; Mehta, A.; Computer Science; ARI, Ismail
Complex event processing (CEP) over event streams has become increasingly important for real-time applications ranging from health care, supply chain management to business intelligence. These monitoring applications submit complex event queries to track sequences of events that match a given pattern. As these systems mature the need for increasingly complex nested sequence query support arises, while the state-of-art CEP systems mostly support the execution of only flat sequence queries. In this paper, we introduce our nested CEP query language NEEL for expressing nested queries composed of sequence, negation, AND and OR operators. Thereafter, we also define its formal semantics. Subtle issues with negation and predicates within the nested sequence context are discussed. An E-Analytics system for processing nested CEP queries expressed in the NEEL language has been developed. Lastly, we demonstrate the utility of this technology by describing a case study of applying this technology to a real-world application in health care.
Open Access
Positive energy districts: Identifying challenges and interdependencies
(MDPI, 2021-10) Krangsås, S. G.; Steemers, K.; Konstantinou, T.; Soutullo, S.; Liu, M.; Giancola, E.; Prebreza, B.; Ashrafian Bonab, Touraj; Murauskaitė, L.; Maas, N.; Architecture; ASHRAFIAN BONAB, Touraj
Positive Energy Districts (PED) are areas within cities that generate more renewable energy than they consume, contributing to cities’ energy system transformation toward carbon neutrality. Since PED is a novel concept, the implementation is very challenging. Within the European Cooperation in Science and Technology (COST) Action, which offers an open space for collaboration among scientists across Europe (and beyond), this paper asks what the needs for supporting the implementation of PEDs are. To answer this, it draws on Delphi process (expert reviews) as the main method alongside the literature review and also uses surveys as supplementary methods to identify the main challenges for developing PEDs. Initial findings reveal seven interacting topics that later were ranked as highest to the lowest as the following: governance, incentive, social, process, market, technology and context. These are interrelated and interdependent, implying that none can be considered in isolation of the others and cannot be left out in order to ensure the successful development of PEDs. The resources that are needed to address these challenges are a common need for systematic understanding of the processes behind them, as well as cross-disciplinary models and protocols to manage the complexity of developing PEDs. The results can be the basis for devising the conceptual framework on the development of new PED guides and tools.
Open Access
Processing nested complex sequence pattern queries over event streams
(ACM, 2010) Liu, M.; Ray, M.; Rundensteiner, E. A.; Dougherty, D. J.; Gupta, C.; Wang, S.; Arı, İsmail; Mehta, A.; Computer Science; ARI, Ismail
Complex event processing (CEP) has become increasingly important for tracking and monitoring applications ranging from healthcare, supply chain management to surveillance. These monitoring applications submit complex event queries to track sequences of events that match a given pattern. As these systems mature the needfor increasingly complex nested sequence queries arises, while thestate-of-the-art CEP systems mostly focus on the execution of flat sequence queries only. In this paper, we now introduce an iterative execution strategy for nested CEP queries composed of sequence, negation, AND and OR operators. Lastly the promise of applying selective caching of intermediate results to optimize the execution. Our experimental study using real-world stock trades evaluates the performance of our proposed iterative execution strategy for differentquery types.
Metadata only
Realtime healthcare services via nested complex event processing technology
(The ACM Digital Library, 2012) Liu, M.; Ray, M.; Zhang, D.; Rundensteiner, E.; Dougherty, D. J.; Gupta, C.; Wang, S.; Arı, İsmail; Computer Science; ARI, Ismail
Complex Event Processing (CEP) over event streams has become increasingly important for real-time applications ranging from healthcare to supply chain management. In such applications, arbitrarily complex sequence patterns as well as non existence of such complex situations must be detected in real time. To assure real-time responsiveness for detection of such complex pattern over high volume high-speed streams, efficient processing techniques must be designed. Unfortunately the efficient processing of complex sequence queries with negations remains a largely open problem to date. To tackle this shortcoming, we designed optimized strategies for handling nested CEP query. In this demonstration, we propose to showcase these techniques for processing and optimizing nested pattern queries on streams. In particular our demonstration showcases a platform for specifying complex nested queries, and selecting one of the alternative optimized techniques including sub-expression sharing and intermediate result caching to process them. We demonstrate the efficiency of our optimized strategies by graphically comparing the execution time of the optimized solution against that of the default processing strategy of nested CEP queries. We also demonstrate the usage of the proposed technology in several healthcare services.
Metadata only
VisDrone-MOT2021: The vision meets drone multiple object tracking challenge results
(IEEE, 2021) Chen, G.; Wang, W.; He, Z.; Wang, L.; Yuan, Y.; Zhang, D.; Zhang, J.; Zhu, P.; Gool, L. V.; Han, J.; Hoi, S.; Hu, Q.; Liu, M.; Sciarrone, A.; Sun, C.; Garibotto, C.; Tran, D. N. N.; Lavagetto, F.; Haleem, H.; Motorcu, Hakkı; Ateş, H. F.; Jeon, H. J.; Bisio, I.; Jeon, J. W.; Li, J.; Pham, J. H.; Jeon, M.; Feng, Q.; Li, S.; Tran, T. H. P.; Pan, X.; Song, Y. M.; Yao, Y.; Du, Y.; Xu, Z.; Luo, Z.; Motorcu, Hakkı
Vision Meets Drone: Multiple Object Tracking (VisDrone-MOT2021) challenge - the forth annual activity organized by the VisDrone team - focuses on benchmarking UAV MOT algorithms in realistic challenging environments. It is held in conjunction with ICCV 2021. VisDrone-MOT2021 contains 96 video sequences in total, including 56 sequences (~24K frames) for training, 7 sequences (~3K frames) for validation and 33 sequences (~13K frames) for testing. Bounding-box annotations for novel object categories are provided every frame and temporally consistent instance IDs are also given. Additionally, occlusion ratio and truncation ratio are provided as extra useful annotations. The results of eight state-of-the-art MOT algorithms are reported and discussed. We hope that our VisDrone-MOT2021 challenge will facilitate future research and applications in the field of UAV vision.