Feedback-Control Control & Queueing Theory Theory-Based Based Resource Management for Streaming Applications
Abstract: Recent advances in sensor technologies and instrumentation have led to an extraordinary growth of data sources and streaming applications. A wide variety of devices, from smart phones to dedicated sensors, have the capability of collecting and streaming large rge amounts of data at unprecedented rates. A number of distinct streaming data models have been proposed. Typical applications for this include smart cites & built environments for instance, where sensor-based sensor infrastructures continue to increase in scale and variety. Understanding how such streaming content can be processed within some time threshold remains a nonnon trivial and important research topic. We investigate how a cloud-based cloud computational infrastructure can autonomically respond to such streaming content, offering Quality of Service guarantees. We propose an autonomic controller (based on feedback control and queueing theory) to elastically provision virtual machines to meet performance targets associated with a particular data stream. Evaluation is carried out using a federated Cloud-based Cloud infrastructure (implemented using CometCloud) CometCloud)-where where the allocation of new resources can be based on: (i) differences between sites, i.e., types of resources supported (e.g., GPU versus CPU only), (ii) cost of ex execution; ecution; (iii) failure rate and likely resilience, etc. In particular, we demonstrate how Little's Law-a Law widely used