How to analyze your pipe runs with Bunyan

Introduction
In this post, we'll discuss how the Simple Data Pipe leverages the Bunyan nodejs logging framework (https://github.com/trentm/node-bunyan) to capture detailled logging information about a pipe run. Reports are then automatically attached to a Cloudant database for further analysis. We'll then show how to analyze the report using the Bunyan viewer tool

A word about Bunyan
Bunyan is a simple and fast JSON logging library for node.js services. It can be configured to output the data to streams that can be stored anywhere. Simple Data pipes is using this library to capture log information about a particular run, then attach the report to the pipe run document stored in the pipe_db Cloudant database. This logging framework support many log levels: trace, debug, info, warning, error.
Bunyan also provide a CLI utility to view the log in a pretty formatted manner with the ability to filter by logging group and level. See (https://github.com/trentm/node-bunyan) for more information.