« Using Solr / Lucene for full text search with MySQL DB
Cabot selected as best Web Developers on oDesk for May 2009 »

java.lang.OutOfMemoryError when indexing large databases in Solr

Posted on May 16th, 2009 by Shibu Basheer

When indexing large databases in Solr, if you encouter java.lang.OutOfMemoryError, this could be caused due to a bug in the mysql jdbc driver.  To resolve this, add include batchSize=”-1″ parameter in your dataSource entry of you data-import.xml file.  The entry should look something like :

<dataSource type="JdbcDataSource" name="ds-2"
          driver="com.mysql.jdbc.Driver"
          url="jdbc:mysql://localhost:8889/mysqldatabase" batchSize="-1"
          user="root" password="root"/>

Reference:

http://wiki.apache.org/solr/DataImportHandlerFaq#head-346bc6622c328a146d1691bc4ed6deb51086d9b3
  • Share/Save/Bookmark

Tags:

This entry was posted by Shibu Basheer on Saturday, May 16th, 2009 at 12:25 am and is filed under Categorized, Development. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

Leave a Reply