Uploaded byData Con LA
Serverless Architectures with AWS Lambda and MongoDB Atlas by Sig Narvaez
The document discusses the evolution of serverless architectures using AWS Lambda and MongoDB Atlas, emphasizing the shift towards cloud services and the role of microservices. It highlights the architecture for a hypothetical customer single view platform in the insurance industry, detailing the use of APIs, VPC peering, and automated deployment strategies. Additionally, it addresses scaling considerations for both Lambda functions and MongoDB Atlas, encouraging a focus on development rather than operations.
Serverless Architectures with AWS Lambda and MongoDB Atlas by Sig Narvaez
- 1. @SigNarvaez | @MongoDB| @BigDataDayLA On-Prem, IaaS, etc. Serverless
- 2. Serverless Architectures with AWSLambda and MongoDB Atlas Sig Narváez Sr. Solutions Architect sig@mongodb.com @SigNarvaez
- 3.
- 4. Big Iron Commodity Hardware VirtualizedContainers Functions Where will my code run? @SigNarvaez | @MongoDB | @BigDataDayLA
- 5. 1. Cloud serviceshave matured 2. BaaS à “SaaS-ification” 3. API’s are the glue 4. Containers – now per function 5. SysOps à DevOps à NoOps Less Ops, More Engineering Forbes: 5 factors fuelling Serverless Computing https://www.forbes.com/sites/janakirammsv/2016/02/28/five-factors-that-are-fueling-serverless-computing-part-1 @SigNarvaez | @MongoDB | @BigDataDayLA
- 6. EVERYCOMPANYISASOFTWARECOMPANY DEVELOPERSAREVALUABLERESOURCE BUILDVALUE-NOTOPERATIONS @SigNarvaez | @MongoDB| @BigDataDayLA WE LIVE IN A SOFTWARE DEFINED ECONOMY
- 7.
- 8. AWS re:Invent 2016:The State of Serverless Computing (SVR311)
- 9. AWS re:Invent 2016:The State of Serverless Computing (SVR311)
- 10.
- 11.
- 12. Serverless Microservice @SigNarvaez |@MongoDB | @BigDataDayLA
- 13. Shape • Person • InsurancePolicies • Shape changes per policy type • Addresses Operations via API • GET Customers with soon-to-expire policies, within a geo radius • GET Customers / by SSN, id, etc. • PATCH Update basic contact info (cell, email, …) Customer Single View - Insurance Industry (hypothetical) High-level architecture of a single view platform @SigNarvaez | @MongoDB | @BigDataDayLA
- 14. CQRS on ServerlessMicroservices COMMAND Update basic info QUERY Soon to Expire GEO By SSN, ID, … CUD API Key Read API Key Lambda Function(s) Majority Writes Secondary Reads Lambda Function(s) VPC Peering @SigNarvaez | @MongoDB | @BigDataDayLA
- 15.
- 16. Automated Service On-demandDBaaS Secure Highly Available Disaster Recovery Elastic Scalability MongoDB Atlas
- 17. Setup MongoDB Atlas- M10+ Need assigned AWS region @SigNarvaez | @MongoDB | @BigDataDayLA
- 18. mgeneratejs • https://github.com/rueckstiess/mgeneratejs • npminstall -g mgeneratejs • Create template – generate data • Upload to Atlas via mongoimport • Hint: get connection string from Atlas UI! • Browse with Compass Generate dataset (optional) Template (CustomerSingleView.json) mgeneratejs -n 100 CustomerSingleView.json | mongoimport --host ”YOUR ATLAS CLUSTER" --numInsertionWorkers 4 --db SingleView--collection Customers --authenticationDatabase admin -- ssl --username YOURUSER --password YOURPASSWORD @SigNarvaez | @MongoDB | @BigDataDayLA
- 19. IAM • Role withLambda execute policies VPC • VPC Peering Connection • Security Group Required AWS Services Lambda • Set VPC, Security Group and IAM role • Upload deployment package (.zip) API Gateway • API definition (Resources & HTTP Methods) • Map Routes to Lambda functions • API Keys & Usage Plans @SigNarvaez | @MongoDB | @BigDataDayLA
- 20.
- 21.
- 22.
- 23.
- 24.
- 25.
- 26.
- 27.
- 28. Connections & Containers http://docs.aws.amazon.com/lambda/latest/dg/lambda-introduction.html …AWS Lambda maintains the container for some time in anticipation of another Lambda function invocation. … the service freezes the container after a function completes, and thaws the container for reuse. If AWS Lambda chooses to reuse the container, this has the following implications: - Any declarations in your Lambda function code (outside the handler code, see Programming Model) remains initialized, providing additional optimization when the function is invoked again. For example, if your Lambda function establishes a database connection, instead of reestablishing the connection, the original connection is used in subsequent invocations. You can add logic in your code to check if a connection already exists before creating one. @SigNarvaez | @MongoDB | @BigDataDayLA
- 29. Python lambda functionskeleton @SigNarvaez | @MongoDB | @BigDataDayLA
- 30. Node.js lambda functionskeleton @SigNarvaez | @MongoDB | @BigDataDayLA
- 31. Local Emulators :Test on EC2 instance against Atlas python-lambda-local at https://pypi.python.org/pypi/python-lambda-local lambda-local (node.js) at https://www.npmjs.com/package/lambda-local
- 32.
- 33. Lambda functions @SigNarvaez |@MongoDB | @BigDataDayLA
- 34. Upload & configure functionThe handler function The role with lambda permissions The VPC (peered with Atlas) The security group that allows traffic At least 2 subnets
- 35.
- 36. Read API –GET /api/v1/customers
- 37. CUD API -PATCH /api/v1/customers
- 38.
- 39. Access and throttlingvia API Keys
- 40.
- 41. Test with Postman @SigNarvaez| @MongoDB | @BigDataDayLA
- 42.
- 43. AWS CloudWatch @SigNarvaez |@MongoDB | @BigDataDayLA
- 44. MongoDB Atlas Monitoringand Alerts @SigNarvaez | @MongoDB | @BigDataDayLA
- 45. MongoDB Compass @SigNarvaez |@MongoDB | @BigDataDayLA
- 46.
- 47. RetroPie – Old-schoolgames, killer tiny hardware @SigNarvaez | @MongoDB | @BigDataDayLA
- 48. Retro Web Appbased on aws-serverless-express https://github.com/snarvaez/bddla17/t ree/master/singleViewWebApp https://github.com/awslabs/aws- serverless-express @SigNarvaez | @MongoDB | @BigDataDayLA
- 49.
- 50. Scaling? Scaling Lambda No userintervention required - Default safety throttle of 100 concurrent executions per account per region. Functions invoked synchronously throw 429 error code. Functions invoked asynchronously can absorb reasonable bursts for approx. 15-30 minutes. If exhausted, consider using Simple Queue Service (SQS) or Simple Notification Service (SNS) as the Dead Letter Queue (DLQ). Read more at https://aws.amazon.com/lambda/faqs/ Scaling MongoDB Atlas On-Demand Zero downtime Upscale/Downscale: • Instance size • Storage size • IOPS • Replication factor. @SigNarvaez | @MongoDB | @BigDataDayLA
- 51. Serverless Architectures with AWSLambda and MongoDB Atlas Sig Narváez Sr. Solutions Architect sig@mongodb.com @SigNarvaez Q & A https://github.com/snarvaez/bddla17 https://resources.mongodb.com/serverles s-architectures @SigNarvaez | @MongoDB | @BigDataDayLA