A Read-Optimized Index Structure for Distributed Log-Structured Key-Value Store

Abstract

Recently, Big Data processing is becoming a necessary technique to efficiently store, manage, and analyze massive data obtained by social media contents. NoSQL is one of databases that efficiently handle Big Data compared to the traditional database that has the limitation to manipulate Big Data. Log-structured key/value store, widely used in NoSQL, basically stores data into the disk storage in batch writing. Since this batch writing of the key/value store does not overwrite data in place, many data are accumulated in several places. Although it improves the write performance, the read performance decreases because the key/value store requires many accesses to widely-spread data. In order to address this problem, we propose T-tree index structure to reduce the search time by avoiding exploring contents stored in distributed many files. Finally, we show the performance improvement through the experimental results.