Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

How can indexing be accelerated?

April 26, 2017Accelerated indexing

0

10 Posted

How can indexing be accelerated?

1 Answer

0

10 Posted

A few ideas: • Include multiple documents in a single operations. Note: there is no advantage in trying to post a huge number of docs in a single go. I’d suggest going no further than 10 (full-size docs) to 100 (tiny docs). • Ensure you are not performing until you need to see the updated index. • If you are reindexing every document in your index, completely removing the index first can substantially speed up the required time and disk space. • Solr can do some, but not all, parts of indexing in parallel. Indexing on multiple threads can be a boon, particularly if you have multiple cpus and your analysis requirements are considerable. • Experiment with different mergeFactor and maxBufferedDocs settings (see [WWW] http://www.onjava.com/pub/a/onjava/2003/03/05/lucene.html).