• Optics: Pulling Google Spreadsheet and Salesforce.com data into Elasticsearch

    Above: The basic architecture of what I build as part of this blogpost. I’m not trying to knock Salesforce.com (SFDC) reporting. My last three companies have used SFDC to track our software sales business and we love the hell out of it. The problem is we are staring to expect...

  • Quantified Self: Week three progress and real time beer events using Untappd

    Untappd beer data turned out to be very easy to add to my quantified self dashboard. Registerring an app on their api page gives you a client ID and key useable for 100 REST calls an hour without any kind of OAuth trickery (all untapped data is pretty wide open)....

  • Quantified Self: Week two progress and 'Near Real-Time' Fitibit activity

    I’m about a week into quantified self tracking. At this point my IFTTT and Zapier feeds are stable and I have good trust that the new data will have arrived in my Kibana dashboard each morning. None of my behaviors and habits have changed of course. Activity level-wise, they’ve probably...

  • Quantified Self: IFTTT, Zapier, and Elasticsearch

    As a new years resolution I’m embarking on a Quantified Self project. It is known that I love tracking things. As an example: 3 years of my beer drinking history from Untappd exported to CSV as a static dataset and loaded into Kibana: Dashboards and visualizations are fun, but in...

  • Pulling and Splitting live XML with Logstash

    As someone who demos Elasticsearch and Kibana quite a bit, the new “http_poller” input to Logstash [1] is probably the most useful tool I have yet run into for quickly cooking up real-time demos for Elasticsearch that use live data. Here’s a quick outline of what I’m going to do...