How scalable is conceptSearching?
The designers of conceptSearching have many years experience in implementing proprietary file systems and custom databases. In particular the database format has been designed to allow concurrent indexing at full speed whilst allowing simultaneous access for retrievals. This concurrency has been achieved in part by reducing the amount of file restructuring typically found in competitive systems, which are often based on B-tree structures. The selected design tends to produce an index database a little larger than some alternatives but with higher quality retrieval. In general conceptSearching will produce an index database whose size is typically one quarter of the volume of text under index (i.e. 100GB of text will typically produce an index database of 25GB, assuming a typical mix of office document sources). The proprietary database format used by conceptSearching has been designed to provide optimum performance and concurrency. For testing and development the entire system can be i
