High-level Parallelisation in a Database Cluster: a Feasibility Study Using Document Services

Title High-level Parallelisation in a Database Cluster: a Feasibility Study Using Document Services
Author(s) T. Grabs, K. Böhm, H.-J. Schek
Type inproceedings
Booktitle Proceedings of the 17th International Conference on Data Engineering (ICDE2001)
Heidelberg, Germany
Organization
Month April 2-6
Year 2001

Abstract

Our concern is the design of a scalable infrastructure for complex application services. We want to find out if a cluster of commodity database systems is well-suited as such an infrastructure. To this end, we have carried out a feasibility study based on document services, e.g., document insertion and retrieval. We decompose a service request into short parallel database transactions. Our system, implemented as an extension of a transaction processing monitor, routes the short transactions to the appropriate database systems in the cluster. Routing depends on the data distribution that we have chosen. To avoid bottlenecks, we distribute document functionality such as term extraction over the cluster. Extensive experiments show the following: (1) A relatively small number of components - for example 8 components - already suffices to cope with high workloads of more than 100 concurrently active clients. (2) Speedup and throughput increase linearly for insertion operations when increasing the cluster size. These observations also hold when bundling service invocations into transactions at the semantic layer. A specialized coordinator component then implements semantic serializability and atomicity. Our experiments show that such a coordinator has minimal impact on CPU resource consumption and on response times.
!!! Dieses Dokument stammt aus dem ETH Web-Archiv und wird nicht mehr gepflegt !!!
!!! This document is stored in the ETH Web archive and is no longer maintained !!!