A new compression algorithm for fast text search

Authors

AYDIN CARUS
ALTAN MESUT

DOI

10.3906/elk-1407-178

Abstract

We propose a new compression algorithm that compresses plain texts by using a dictionary-based model and a compressed string-matching approach that can be used with the compressed texts produced by this algorithm. The compression algorithm (CAFTS) can reduce the size of the texts to approximately 41% of their original sizes. The presented compressed string matching approach (SoCAFTS), which can be used with any of the known pattern matching algorithms, is compared with a powerful compressed string matching algorithm (ETDC) and a compressed string-matching tool (Lzgrep). Although the search speed of ETDC is very good in short patterns, it can only search for exact words and its compression performance differs from one natural language to another because of its word-based structure. Our experimental results show that SoCAFTS is a good solution when it is necessary to search for long patterns in a compressed document.

Keywords

Compressed string matching, text compression, dictionary-based compression, exact pattern matching, CAFTS

First Page

4355

Last Page

4367

Recommended Citation

CARUS, AYDIN and MESUT, ALTAN (2016) "A new compression algorithm for fast text search," Turkish Journal of Electrical Engineering and Computer Sciences: Vol. 24: No. 5, Article 76. https://doi.org/10.3906/elk-1407-178
Available at: https://journals.tubitak.gov.tr/elektrik/vol24/iss5/76