Download as PDF, PPTX
Uploaded byJames Titcumb
Low Latency Logging with RabbitMQ (PHP London - 4th Sep 2014)
The document discusses low latency logging using RabbitMQ and PHP, highlighting the importance of logging exceptions, errors, and events effectively. It covers various logging techniques and methods, including error handling and configuring RabbitMQ for performance scalability. Key PSR-3 compatibility and various logging options such as Monolog and custom implementations are also presented.
Low Latency Logging with RabbitMQ (PHP London - 4th Sep 2014)
- 1. Low Latency Logging with RabbitMQ PHP London 4th September 2014
- 2. Who is thisguy? James Titcumb www.jamestitcumb.com www.protected.co.uk www.phphants.co.uk @asgrim
- 3. Let’s go backto basics...
- 4.
- 5.
- 10.
- 11.
- 12.
- 13. Log to fileonly
- 14. Ways Around //Will raise E_WARNING fopen($somefile, 'r');
- 15. Ways Around //No error! :) if (file_exists($somefile)) { fopen($somefile, 'r'); } else { // nice handling... // maybe throw exception... }
- 16.
- 17. Jargon Buster ●throw Triggering ● try Try to run ● catch Handle it ● finally Run code after try/catch
- 18.
- 19.
- 20.
- 21. Turn into fatalerrors if not caught
- 22.
- 23.
- 24. Example (exception class) class DivisionByZeroException extends LogicException { }
- 25. Example (throw) classMathematics { public function divide($a, $b) { if ($b == 0) { $msg = sprintf(“Divide %s by zero”, $a); throw new DivisionByZeroException($msg); } return ($a / $b); } }
- 26. Example (catch) $maths= new Mathematics(); try { $result = $maths->divide(5, 0); } catch (DivisionByZeroException $exception) { $logger->warning($exception->getMessage()); }
- 27.
- 29.
- 30. What is “logging”? Keeping a record of all events...
- 31. What is “logging”? Keeping a record of all events... exceptions, errors, warnings, info, debug
- 32. Logging is apaper trail
- 33. Log like youjust don’t care
- 35. Log wherever youlike
- 36. What about Apache’serror_log? source: http://up-ship.com/blog/?p=20903
- 37. Doin’ it rightwrong… // Magic file that makes your entire project work perfectly @ini_set('display_errors', 0); @error_reporting(0); function __globalErrorHandler() { return true; } @set_error_handler('__globalErrorHandler'); @set_exception_handler('__globalErrorHandler'); @register_shutdown_function(function() { if(error_get_last()) echo "Script executed successfully!"; }); https://github.com/webarto/boostrap.php
- 38. Requirements (for everyone) ● Fire & forget ● Minimum or zero latency ● Highly available ● Log everything ● PSR-3 compatible
- 39.
- 40. Logging Options ●monolog (PSR-3) ● Drupal - PSR-3 Watchdog ● phpconsole ● log4php ● RavenPHP + Sentry ● FirePHP (dev environment) ● Roll your own
- 41.
- 42. Capturing Logging Use“capture methods”, send to $logger ● set_exception_handler() ○ Handles all uncaught exceptions ● set_error_handler() ○ Handles most errors ● register_shutdown_function() ○ Handles fatal errors
- 43. Sending Log Messages ● Handler/Adapter translates ● However you want… ● Monolog has loads: ○ syslog-compatible / error_log ○ Email, HipChat ○ AMQP, Sentry, Zend Monitor, Graylog2 ○ Redis, MongoDB, CouchDB
- 44. Typical PSR-3 CompatibleDesign Capture Method Logger (PSR-3) Handler / Adapter Data Storage
- 45. MonologErrorHandler ->handleException() MonologLogger ->log() MonologHandler ->handle() Monolog
- 46. Low Latency HighPerformance
- 47. Slow Logging BrowserApplication Log Server HTTP request Send log message to database Error! Acknowledge message HTTP response to client
- 48. Zero Latency Logging(ideal) Browser Application Log Server HTTP request Send log message to database Error! HTTP response to client
- 49.
- 50. Low Latency Logging(balance) Browser Application Log Server HTTP request Send log message to database Error! HTTP response to client
- 51.
- 52. Say hello toRabbitMQ
- 53. RabbitMQ - Basic test_queue 1 2 3 4 5 Producer Consumer source: http://www.rabbitmq.com/tutorials/tutorial-one-php.html
- 54. RabbitMQ - Exchanges Exchange Consumer test_queue 1 2 3 4 5 source: http://www.rabbitmq.com/tutorials/tutorial-three-php.html Consumer Consumer Consumer Consumer
- 55. Using Queues ===Fast! Add RabbitMQ to logging architecture...
- 56. Low Latency (usingAMQP) EdLogHandlerErrorHandler ->handleException() EdLogLogger ->log() EdLogPublisherAmqpPublisher ->publish() RabbitMQ JSON payload Logging Server
- 57. Low Latency Logging(with AMQP) Browser Application Log Server Fetch message HTTP request JSON via AMQP Error! HTTP response RabbitMQ
- 58. Why bother? ●Scalability RabbitMQ Application A Application B Application C Log Worker Log Worker Log Worker Log Worker
- 59. Single Point ofFailure... ● RabbitMQ can do HA or clustering RabbitMQ Node 1 RabbitMQ Node 3 RabbitMQ Node 2 RabbitMQ Node 4 RabbitMQ Node 6 RabbitMQ Node 5
- 60.
- 61. Thanks for watching! James Titcumb www.jamestitcumb.com www.protected.co.uk www.phphants.co.uk @asgrim