Download as PDF, PPTX
![POST /my-index {"acknowledged":true} POST/my-index/my-type { "key" : "value", "date" : "2015-05-10", "counter" : 1, "tags" : ["tag1","tag2","tag3"] } { "_index": "my-index", "_type": "my-type", "_id": "AU089olr9oI99a_rK9fi", "_version": 1, "created": true } Confirmation](https://image.slidesharecdn.com/beyondthelampstackcodemotion16-160330100210/75/PHP-projects-beyond-the-LAMP-stack-54-2048.jpg)
![GET/my-index/my-type/AU089olr9oI99a_rK9fi?pretty { "_index": "my-index", "_type": "my-type", "_id": "AU089olr9oI99a_rK9fi", "_version": 1, "found": true, "_source": { "key": "value", "date": "2015-05-10", "counter": 1, "tags": [ "tag1", "tag2", "tag3" ] } } Retrieve document by id Document & meta data](https://image.slidesharecdn.com/beyondthelampstackcodemotion16-160330100210/75/PHP-projects-beyond-the-LAMP-stack-55-2048.jpg)
![POST /products/product/_search?pretty { "fields": ["category","price","name"], "query": { "match": { "name.raw": "blazer" } }, "aggs": { "avg_price": { "avg": { "field": "price" } }, "min_price" : { "min": { "field": "price" } }, "max_price" : { "max": { "field": "price" } }, "number_of_products_per_category" : { "terms": { "field": "category", "size": 10 } } } } Multi-group by & query](https://image.slidesharecdn.com/beyondthelampstackcodemotion16-160330100210/75/PHP-projects-beyond-the-LAMP-stack-61-2048.jpg)
!["aggregations": { "min_price": { "value": 455 }, "number_of_products_per_category": { "doc_count_error_upper_bound": 0, "sum_other_doc_count": 0, "buckets": [ { "key": "Blazers", "doc_count": 2 }, { "key": "Default Category", "doc_count": 2 }, { "key": "Men", "doc_count": 2 } ] }, "max_price": { "value": 490 }, "avg_price": { "value": 472.5 } } Aggregation output](https://image.slidesharecdn.com/beyondthelampstackcodemotion16-160330100210/75/PHP-projects-beyond-the-LAMP-stack-62-2048.jpg)
Uploaded byCodemotion
PHP projects beyond the LAMP stack
The document discusses advanced techniques for improving web application performance beyond traditional LAMP stack approaches, introducing tools like Varnish for caching, Redis for fast data storage, and Elasticsearch for query and analytics capabilities. It emphasizes the significance of message queues, asynchronous processes, and the potential use of languages such as Go for building efficient APIs. Overall, it advocates for selecting the most suitable technology for specific needs to optimize application architecture.
PHP projects beyond the LAMP stack
- 1. projects Beyond the LAMP stack ByThijs Feryn PHP
- 2.
- 3.
- 4.
- 5.
- 6.
- 7. CPU memory I/O PHPconsumes lots of
- 8.
- 11.
- 12.
- 13.
- 14.
- 15.
- 16.
- 17.
- 18.
- 19. Reverse proxy User VarnishServer Proxy in the data center
- 20. ✓ Varnish ConfigurationLanguage ✓ Edge Side Include support ✓ Gzip compression/decompression ✓ Cache purging ✓ HTTP streaming ✓ Grace mode ✓ Configure backends ✓ Backend loadbalancing ✓ ACL protection ✓ VMODs in C Varnish
- 21.
- 22. ✓Strip tracking cookies(Google Analytics, …) ✓Sanitize URL ✓URL whitelist/blacklist ✓PURGE ACLs ✓Edge Side Include rules ✓Alway cache static files ✓Extend hash keys ✓Override TTL ✓Define grace mode What to extend?
- 23. vcl 4.0; import std; aclpurge { "127.0.0.1" } backend default { .host = "176.62.160.59"; .port = "80"; .connect_timeout = 600s; .first_byte_timeout = 600s; .between_bytes_timeout = 600s; } sub vcl_recv { if (req.http.Authorization) { return (pass); } if (req.http.Accept-Encoding) { if (req.http.Accept-Encoding ~ "gzip") { set req.http.Accept-Encoding = "gzip"; } else if (req.http.Accept-Encoding ~ "deflate") { set req.http.Accept-Encoding = "deflate"; } else { unset req.http.Accept-Encoding; } } if (req.method == "PURGE") { if (!client.ip ~ purge) {
- 24.
- 25.
- 26.
- 27. Cache-control: public, max- age=3600,s-maxage=7200 Cache-control: no-cache, no- store VS
- 28.
- 29.
- 30.
- 31.
- 32. <!DOCTYPE html> <html> <head> <title>The Demo</title> <metaname="viewport" content="width=device-width, initial-scale=1.0"> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" /> <link rel="stylesheet" href="/css/bootstrap.min.css"> <link rel="stylesheet" href="/css/bootstrap-theme.min.css"> <script src=“/js/jquery-2.1.4.min.js"></script> <script src="/js/bootstrap.min.js"></script> </head> <body> <nav class="navbar navbar-inverse navbar-fixed-top"> <esi:include src=“http://mysite.dev/nav" /> </nav> <div class="jumbotron"> <esi:include src="http://mysite.dev/jumbotron" /> </div> <div class="container"> {% block content %}{% endblock %} <hr> <footer> <esi:include src="http://mysite.dev/footer" /> </footer> </div> </body> </html> ESI tags
- 33.
- 34. ✓Cache pages andstatic assets ✓Fastest way ✓Hit rate may vary ✓Chop your content up in pieces ✓Use ESI or AJAX ✓Gateway to your application Where does Varnish fit in?
- 35. You can also hostyour static files on a separate set of Nginx servers
- 36.
- 37. CDNs are nothing buta bunch of reverse caching proxies
- 38. Put the content whereyour user is
- 39.
- 40. Data is storedfor flexibility, not for performance SQL (joins) allow different compositions of the same data
- 41.
- 43. ✓ Key-value store ✓Fast ✓ Lightweight ✓ Data stored in RAM ✓ ~Memcached ✓ Data types ✓ Data persistance ✓ Replication ✓ Clustering Redis
- 44. Redis $ redis-cli 127.0.0.1:6379> ping PONG 127.0.0.1:6379>set mykey somevalue OK 127.0.0.1:6379> get mykey "somevalue
- 45. ✓ Strings ✓ Hashes ✓Lists ✓ Sets ✓ Sorted sets ✓ Geo ✓ … Redis data types
- 46. Redis $ redis-cli 127.0.0.1:6379> hsetcustomer_1234 id 1234 (integer) 1 127.0.0.1:6379> hset customer_1234 items_in_cart 2 (integer) 1 127.0.0.1:6379> hmset customer_1234 firstname Thijs lastname Feryn OK 127.0.0.1:6379> hgetall customer_1234 1) "id" 2) "1234" 3) "items_in_cart" 4) "2" 5) "firstname" 6) "Thijs" 7) "lastname" 8) "Feryn" 127.0.0.1:6379>
- 47. $ redis-cli 127.0.0.1:6379> lpushproducts_for_customer_1234 5 (integer) 1 127.0.0.1:6379> lpush products_for_customer_1234 345 (integer) 2 127.0.0.1:6379> lpush products_for_customer_1234 78 12 345 (integer) 5 127.0.0.1:6379> llen products_for_customer_1234 (integer) 5 127.0.0.1:6379> lindex products_for_customer_1234 1 "12" 127.0.0.1:6379> lindex products_for_customer_1234 2 "78" 127.0.0.1:6379> rpop products_for_customer_1234 "5" 127.0.0.1:6379> rpop products_for_customer_1234 "345" 127.0.0.1:6379> rpop products_for_customer_1234 "78" 127.0.0.1:6379> rpop products_for_customer_1234 "12" 127.0.0.1:6379> rpop products_for_customer_1234 "345" 127.0.0.1:6379> rpop products_for_customer_1234 (nil) 127.0.0.1:6379> Redis
- 48.
- 49. ✓ Database/API cache ✓PHP session storage ✓ Message queue (lists) ✓ NoSQL database ✓ Real-time data retrieval Where does Redis fit in?
- 50.
- 51. BUT: MySQL can still remain“source of truth” database
- 53. ✓Full-text search engine ✓Analyticsengine ✓NoSQL database ✓Lucene based ✓Built-in clustering, replication, sharding ✓RESTful interface ✓Schemaless ElasticSearch
- 54. POST /my-index {"acknowledged":true} POST/my-index/my-type { "key" :"value", "date" : "2015-05-10", "counter" : 1, "tags" : ["tag1","tag2","tag3"] } { "_index": "my-index", "_type": "my-type", "_id": "AU089olr9oI99a_rK9fi", "_version": 1, "created": true } Confirmation
- 55. GET/my-index/my-type/AU089olr9oI99a_rK9fi?pretty { "_index": "my-index", "_type": "my-type", "_id":"AU089olr9oI99a_rK9fi", "_version": 1, "found": true, "_source": { "key": "value", "date": "2015-05-10", "counter": 1, "tags": [ "tag1", "tag2", "tag3" ] } } Retrieve document by id Document & meta data
- 56.
- 57.
- 58. POST /products/product/_search?pretty { "query": { "match":{ "name.raw": "Linen Blazer" } } } POST /products/product/_search?pretty { "query": { "filtered": { "query": { "match_all": {} }, "filter": { "term": { "name": "Linen Blazer" } } } } } Matches 2 products Matches 1 product
- 59.
- 60. Group by onsteroids
- 61. POST /products/product/_search?pretty { "fields": ["category","price","name"], "query":{ "match": { "name.raw": "blazer" } }, "aggs": { "avg_price": { "avg": { "field": "price" } }, "min_price" : { "min": { "field": "price" } }, "max_price" : { "max": { "field": "price" } }, "number_of_products_per_category" : { "terms": { "field": "category", "size": 10 } } } } Multi-group by & query
- 62. "aggregations": { "min_price": { "value":455 }, "number_of_products_per_category": { "doc_count_error_upper_bound": 0, "sum_other_doc_count": 0, "buckets": [ { "key": "Blazers", "doc_count": 2 }, { "key": "Default Category", "doc_count": 2 }, { "key": "Men", "doc_count": 2 } ] }, "max_price": { "value": 490 }, "avg_price": { "value": 472.5 } } Aggregation output
- 63.
- 64. ✓ Full-text searchengine with drill-down search ✓ Human language & text analysis ✓ NoSQL database ✓ Big data analytics tool using Kibana Where does ElasticSearch fit in?
- 66.
- 67.
- 68. ✓ Uses PHP-CLI ✓Runs continuously ✓ Process forking ✓ Pthreads ✓ Run worker scripts in parallel ✓ Managed by supervisord Worker scripts
- 69. ✓ Sync MySQL& Redis/ ElasticSearch ✓ Resize images ✓ Async logging & metrics ✓ Other tasks that shouldn’t block the user process Worker scripts
- 70.
- 72. ✓ Pub/sub ✓ SpeaksAMQP protocol ✓ Supported by Pivotal ✓ Channels/Exchanges/ Queues ✓ Built-in clustering ✓ Reliable messaging RabbitMQ
- 73. ✓ Take loadaway from user process ✓ Free up resources on frontend servers ✓ Elaborate messaging strategies ✓ Async event-based actions Where do RabbitMQ/workers fit in?
- 74. But with mostof these tools we still go through the PHP runtime …
- 77.
- 78. ✓ Javascript runtime ✓Async ✓ Event-driven ✓ Non-blocking I/O ✓ Callbacks ✓ Lightweight ✓ NPM packages ✓ Backend-code in Javascript NodeJS
- 79. const http =require('http'); const hostname = '127.0.0.1'; const port = 1337; http.createServer((req, res) => { res.writeHead(200, { 'Content-Type': 'text/plain' }); res.end('Hello Worldn'); }).listen(port, hostname, () => { console.log(`Server running at http://${hostname}:${port}/`); });
- 80.
- 82. ✓ Compiled languagefor the web ✓ Invented by Google ✓ Strictly typed ✓ Feels like your average interpreted language ✓ Async features ✓ Built for systems programming ✓ REALLY fast ✓ Not object oriented Go(lang)
- 83. package main import ( "fmt" "net/http" "goji.io" "goji.io/pat" "golang.org/x/net/context" ) funchello(ctx context.Context, w http.ResponseWriter, r *http.Request) { name := pat.Param(ctx, "name") fmt.Fprintf(w, "Hello, %s!", name) } func main() { mux := goji.NewMux() mux.HandleFuncC(pat.Get("/hello/:name"), hello) http.ListenAndServe("localhost:8000", mux) }
- 84. Really fast workers Reallyfast APIs Could replace PHP workers Could replace NodeJS
- 85.
- 86. ✓ Cache pages(Varnish) ✓ Assemble content via ESI or AJAX ✓ Static assets on Nginx or CDN ✓ Business logic in lightweight API calls (NodeJS, Go) ✓ Key-value stores for volatile & real-time data in Redis ✓ ElasticSearch as a NoSQL database ✓ RabbitMQ for async communication ✓ Worker processes read from message queue End game
- 87. Use the righttool for the job
- 88. Use the toolsyou like