heka

You could build a piwik-type system using Heka, but Heka is a lower level tool w/ a wider focus.

I've been experimenting with metrics collection using heka (node) -> amqp -> heka (aggregator) -> influxdb -> grafana.

So heka does the same job as the central logstash server or does it offer a persistence layer, too?

And Heka provides mechanisms for in-flight data processing and graphing output, in addition to logging and routing.

But you're also right that Heka might in some cases also be used in place of syslog.

You can quite easily do that with Mozilla Heka [1] and a bit of Lua scripting.

My sense of 'well-known' might be a bit skewed, but let's say docker and heka.

We've been running Influxdb 0.9 (pre-rc32), Heka 0.9 and Grafana 2 as well.

Hey just curious, why did you pick spacemonkeygo/monitor over mozilla-services/heka for data collection?

I've been running infxludb 0.9 + heka 0.9.x + grafana 2.x stack in a production environment for over a month.

I'm using Heka to send numeric time series data to Influx and full logs to ElasticSearch.

It's been going OK, though we really needed to add stats collecting and batch write in Heka layer to not spike the CPU on writes to Influxdb.

Of course, both syslog and collectd have been around and battle-hardened for many(!) years, whereas this first Heka release is being called "0.2-beta-1" for a reason.

Actually, there is a fair amount of overlap between collectd and Heka.

Heka's plugin system looks like a nice way to structure things.

It's certainly not available out-of-box, and it would take a bit of work, but it should be possible to build something like this with Heka.