Files
elasticsearch-js/scripts/generate/logs
Spencer Alger b063dfdca7 Added "extends" key to the jshint config files, so there is less repetition.
Mocha now runs from grunt, just run "grunt"

Copied es-php's README.md, will modify later

More logging around sending a request, including stack traces for debug messages

Connections now manage their own state, and emit a "status changed" event which
the connection pool listens for

Fixed the custom errors

Stream loggers will dump their buffered output to stderr when the process exits
so that log messages will be sort of saved, File logger overrides this and
writes to the file syncronously

Added _.handler(), _.scheduled(), and _.makeBoundMethods() to the utils
2013-10-21 10:09:12 -07:00
..
2013-10-16 15:36:54 -07:00

Log Generator

Simple generator used to push events into ES. Uses the JS client, and serves as a "simple" type test to make sure it's sort of efficient.

Uses the Bulk API to communicate push docs into logstash-YYYY.MM.DD style indices which are easyily consumed by Kibana.

Documents look like this:

{
  "_index": "logstash-2013.10.20",
  "_type": "apache",
  "_id": "42",
  "_score": 1,
  "_source": {
    "index": "logstash-2013.10.20",
    "@timestamp": "2013-10-20T10:50:22.980Z",
    "ip": "193.224.70.190",
    "extension": "html",
    "response": "404",
    "country": "JO",
    "point": [
      43.73331611,
      -103.6176947
    ],
    "@tags": [
      "success",
      "security"
    ],
    "utc_time": "2013-10-20T10:50:22.980Z",
    "referer": "http://twitter.com/success/wendy-lawrence",
    "agent": "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)",
    "clientip": "193.224.70.190",
    "bytes": 4409.774264320731,
    "request": "/pyotr-kolodin.html",
    "memory": 0,
    "@message": "193.224.70.190 - - ..." // apache error log
  }
}

to run

from the project root, call:

node scripts/generate/logs # use --help to see usage