When indexing large databases in Solr, if you encouter java.lang.OutOfMemoryError, this could be caused due to a bug in the mysql jdbc driver.  To resolve this, add include batchSize=”-1″ parameter in your dataSource entry of you data-import.xml file.  The entry should look something like :

<dataSource type="JdbcDataSource" name="ds-2"
          driver="com.mysql.jdbc.Driver"
          url="jdbc:mysql://localhost:8889/mysqldatabase" batchSize="-1"
          user="root" password="root"/>

Reference:

http://wiki.apache.org/solr/DataImportHandlerFaq#head-346bc6622c328a146d1691bc4ed6deb51086d9b3

Solr is a standalone webservice application that can be installed on any servlet container like tomcat, jetty etc.  It uses the popular Lucene java library to provide enterprise level search results from databases, filesystem, web services etc.    Solr runs as a web service, so in effect it provides a cross platform search engine.  The results can be accessed from php, java, RoR or .NET by invoking its web service.  The only requirement on your server is that it should allow you to run java application or have deploy solr as a webapp in an existing servlet container such as tomcat or jetty.

This article shows how to get Solr index and provide search results for a simple MySQL table.  The search results will be provided in XML, so you can get your web application to read the results, parse it and display it any form desired. (more…)

I am not sure if the road to Munnar can be compared to the famous North American Shore drive, Cabot Trail, but this past weekend, there was surely some Cabot in the air at Munnar where our team headed out for a fun team building trip. The trip has been long in the planning and the last delay is attributed to me and the team waited patiently for me to join the organization and then go on the trip. (more…)

Yes, we are on twitter now as cabotsolutions.

Out twitter url is http://www.twitter.com/cabotsolutions/

Eclipse’s PDT project provides an excellent development tool for LAMP developers.  It provides  great features like code completion, zend debugger,  error checking and all the goodness that comes with default eclipse package.   One of the nice things that PDT lacks out of the box is SVN support.  This can be easily achieved using subclipse plugin available for eclipse.   This is how you would install PDT, subclipse and get productive in less than 15 minutes (depending on your bandwidth).  For this article, we are using Ubuntu 8.10, so change use commands specific to your favorite flavour of linux. (more…)