solr

Indexing SOLR Using Data from Google’s BigQuery

For this entry I assume you already know how to configure SOLR’s Data Import Handler as that is how we’ll configure SOLR to use BigQuery: https://wiki.apache.org/solr/DataImportHandler Steps Google’s Service Account File Download the service account file as described here: https://cloud.google.com/docs/authentication/getting-started  I used the JSON version of the file. For the Read more…

By dan, ago
solr

Adding SOLR to WordPress

There are a couple of fully developed plugins that bring the magic of SOLR into WordPress. However, if you want to just get something up and running without having to install a plugin this article may be for you. Here I describe how to bring a better search experience to Read more…

By dan, ago
programming

Bash Programming

Redirection Put these at the top of your scripts to direct bash to send all standard out and standard error created after the statement  to $log_file.  One way or another the following statements will send everything created by the current script, sub-shells, etc. to $log_file.  Your code will be cleaner Read more…

By dan, ago
programming

AWK Scripts

I need to process text every day.  At times it is useful to find counts and I found that using AWK is the easiest way to do so.  Say I had a data file that looks like this: row col1 col2 col3 0 3500.352 10l1.1 2356.4 1 292.2 3100.0 1997.99 2 Read more…

By dan, ago
hadoop

Using Hadoop to Create SOLR Indexes

One of the most challenging projects I faced at work recently was to create a Apache SOLR index consisting of approx 15 million records. This index had been created once in the history of the company using a MySQL database and SOLR's Data Import Handler (DIH). It had not been attempted since then because the original indexing process was time consuming (12-14 hours), required human supervision, and on failure had to be restarted from the very beginning. (more…)

By dan, ago
android

Android apps on my phone

I was the first one at work to get an Android phone. As word got around I have become the guy to go to when it comes to Android. I get asked questions about Android before they buy. I also get questions about Android after they've bought their new phone. One thing that people seem to appreciate is when I provide them with a list of apps to get them started. Without further ado, here is a list of most of the apps I have on my phone. I've not included some of the apps (e.g., OEM pre-installed crap). (more…)

By dan, ago
android

How I managed to install the CyanogenMod 6.0.0-Droid-RC2 on my Motorola Droid from a Mac Book Pro (OSX v.10.6.4)

First I read the wiki entry http://wiki.cyanogenmod.com/index.php?title=Full_Update_Guide_-_Motorola_Droid As I was reading I noticed that there were no directions for OSX; only for Windows and Linux. It turns out that the flash recovery tools are not available for OSX. That means that I would have to do this from a virtual machine. (more…)

By dan, ago
android

To Android or to iPhone?

I've wanted an iPhone for at least a year. Six to eight months ago I decided I was going to make the switch from Verizon to AT&T - just for the iPhone. Our Verizon contract expires next month. Now that December 8th is almost here I have begun counting the days. How exciting it will be to walk into the AT&T store and pick up my new iPhone. I appreciate the quality of Apple products. From the beauty and elegance of the design to the simplicity of the user interface. It is obvious that they put great thought into the product as a whole. I wouldn't call myself a "fanboy" but I'm pretty close. This is why it has come as a surprise that I have decided to go with the new Droid that Verizon just made available (http://phones.verizonwireless.com/motorola/droid/). (more…)

By dan, ago