@muktaaWe are hiring! Send resume to: hr@whitehedge.com Application Monitoring using Datadog Mukta Aphale (DevOps Practice Head, WhiteHedge Technologies) 12 Dec 2015, DevOps Meetup, Pune
@muktaaWe are hiring! Send resume to: hr@whitehedge.com WhiteHedge Technologies
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Application Monitoring • Ensure that a software application processes and performs in an expected manner and scope APM Runtime  Metrics Health  of  the   application Health  of   infrastructure Provide   system/application   feedback Continuous   Improvement
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Datadog • Monitoring as a Service • Agent Based • Python • Integrations • Dashboards • Tagging • Alerts • Checks
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Environment
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Challenge • Monitor System Health • Monitor Redis, MongoDB • Application (API Server) runs as docker container • Monitor application performance • Logging slowed down performance • Rapid development, No feedback mechanism • Insight in application needed by management • Insight needed by support, devops and developers
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Integration Dashboards
@muktaaWe are hiring! Send resume to: hr@whitehedge.com AWS
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Amazon - ElastiCache
@muktaaWe are hiring! Send resume to: hr@whitehedge.com System Overview
@muktaaWe are hiring! Send resume to: hr@whitehedge.com But… •How to impress the management?! J •How to deal with X environments and Y versions? •How to measure performance, without affecting performance?
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Overview Dashboard Dummy Dummy Dummy Dummy Dummy
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Debug: API Error Rate Which  endpoint  is  having  more  errors?  Which  error  codes  are  being  thrown? Search  logs  in  Loggly if  needed.
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Datadog Tags • Inherited from Integrations • Custom tags
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Templated Dashboards • Dashboard variables • Dynamically explore metrics
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Datadog API •We can code: • Instance configuration • Infrastructure • Deployments •Why not monitoring?! •Datadog has great API
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Datadog module for nodejs
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Measuring http response times from application code
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Plot it! Dummy1 Dummy2 Dummy3 Dummy4 Dummy  Data
@muktaaWe are hiring! Send resume to: hr@whitehedge.com What about performance while tracking performance? • Metrics from code are sent to local datadog agent using UDP • Local datadog agent syncs the metrics to the datadog server • Datadog dashboard reflects the metrics with some delay • Application performance does not get affected
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Alerts
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Datadog Checks •Collect metrics from datadog agent check •Out of the box agent checks •Custom agent checks in Python •Interesting use cases: • Keep alive check (Service is up) • Network Check (HTTP, TCP) • Validate response for expected data
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Using Datadog we could… • Monitor dynamic infrastructure • Monitor system health • Monitor application availability • Monitor application performance • Show application & infra health graphically • Provide feedback about health of system
@muktaaWe are hiring! Send resume to: hr@whitehedge.com Thank You! Questions? We are Authorized Datadog Partners! You can write to me at: maphale@whitehedge.com Twitter: @muktaa

Application Monitoring using Datadog

  • 1.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Application Monitoring using Datadog Mukta Aphale (DevOps Practice Head, WhiteHedge Technologies) 12 Dec 2015, DevOps Meetup, Pune
  • 2.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com WhiteHedge Technologies
  • 3.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Application Monitoring • Ensure that a software application processes and performs in an expected manner and scope APM Runtime  Metrics Health  of  the   application Health  of   infrastructure Provide   system/application   feedback Continuous   Improvement
  • 4.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog • Monitoring as a Service • Agent Based • Python • Integrations • Dashboards • Tagging • Alerts • Checks
  • 5.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Environment
  • 6.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Challenge • Monitor System Health • Monitor Redis, MongoDB • Application (API Server) runs as docker container • Monitor application performance • Logging slowed down performance • Rapid development, No feedback mechanism • Insight in application needed by management • Insight needed by support, devops and developers
  • 7.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Integration Dashboards
  • 8.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com AWS
  • 9.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Amazon - ElastiCache
  • 10.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com System Overview
  • 11.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com But… •How to impress the management?! J •How to deal with X environments and Y versions? •How to measure performance, without affecting performance?
  • 12.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Overview Dashboard Dummy Dummy Dummy Dummy Dummy
  • 13.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Debug: API Error Rate Which  endpoint  is  having  more  errors?  Which  error  codes  are  being  thrown? Search  logs  in  Loggly if  needed.
  • 14.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog Tags • Inherited from Integrations • Custom tags
  • 15.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Templated Dashboards • Dashboard variables • Dynamically explore metrics
  • 16.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog API •We can code: • Instance configuration • Infrastructure • Deployments •Why not monitoring?! •Datadog has great API
  • 17.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog module for nodejs
  • 18.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Measuring http response times from application code
  • 19.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Plot it! Dummy1 Dummy2 Dummy3 Dummy4 Dummy  Data
  • 20.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com What about performance while tracking performance? • Metrics from code are sent to local datadog agent using UDP • Local datadog agent syncs the metrics to the datadog server • Datadog dashboard reflects the metrics with some delay • Application performance does not get affected
  • 21.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Alerts
  • 22.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Datadog Checks •Collect metrics from datadog agent check •Out of the box agent checks •Custom agent checks in Python •Interesting use cases: • Keep alive check (Service is up) • Network Check (HTTP, TCP) • Validate response for expected data
  • 23.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Using Datadog we could… • Monitor dynamic infrastructure • Monitor system health • Monitor application availability • Monitor application performance • Show application & infra health graphically • Provide feedback about health of system
  • 24.
    @muktaaWe are hiring!Send resume to: hr@whitehedge.com Thank You! Questions? We are Authorized Datadog Partners! You can write to me at: maphale@whitehedge.com Twitter: @muktaa