Awesome Open Source
Awesome Open Source

Logging Utility & Daemon

Read log data from Inputs [Tail Files, Stdin, Monit], perform transforms [Combine lines(multi-line-errors)] and output to [ElasticSearch, Stdout] Recognize lines with metrics and send to Monitoring [Graphite, InfluxDB, ..]

Drawing

Why?

We had 2 needs: 1) to send data to Elasticsearch for viewing in http://kibana.org/ and 2) if possible, unify the Logging/Metrics systems data-collection-forwarding.

There are probably better tools out there for this but putting together the specific combination of: (LogStash format in Elasticsearch, Tail files, Read Kafka, Metrics read from log files) didn't happen, see alternates below.

Features

  • Inputs
    • Stdin
    • Tail Logs (multiple files)
    • Monit (metrics via http)
    • Http (custom)
  • Transforms:
    • Logstash http://logstash.net/
    • Colorizer for console
    • Concat into single line when needed (e.g. error stack trace)
    • Separate Metrics Log Lines from regular log lines
    • Custom plugins
  • Log Line Outputs
    • Stdout (optional colorized)
    • Elasticsearch
  • Metric Outputs
    • Graphite

Alternatives

Usage

loges --source=monit,tail --filter=stdfiles --out=elasticsearch --metrics=graphite \
   /path/to/my/file \
   /path/to/another/file



Alternative Project Comparisons
Related Awesome Lists
Top Programming Languages
Top Projects

Get A Weekly Email With Trending Projects For These Topics
No Spam. Unsubscribe easily at any time.
Golang (160,486
Logger (15,870
Metrics (13,653
Elasticsearch (11,367
Kafka (9,603
Daemon (8,279
Logstash (2,848
Graphite (1,656
Fluentd (1,190