Download as PDF, PPTX
Uploaded byAWS Vietnam Community
Cloudsolutionday 2016: DevOps workflow with Docker on AWS
The document discusses DevOps workflow with Docker on AWS. It describes using Docker to isolate application environments, increasing team productivity and decreasing development team size. Key elements include using Gitlab for source control and CI/CD, building Docker images via Gitlab runners, and deploying to Kubernetes clusters. The workflow allows writing applications once and running them anywhere and forever through continuous integration and delivery of Docker images to private container registries on AWS.
Cloudsolutionday 2016: DevOps workflow with Docker on AWS
- 1. DevOps workflow withDocker on AWS Nov 19 2016 @Wayarmy – Quanpc@topica.edu.vn Topica Edumall SysAdmin
- 2. About me • @wayarmy •Interested: Cloud Computing, AWS, Docker, IaaS, SaaS, PaaS, Apache Stack, Elastic Stack, Hashi Stack, Ruby on Rails, Linux, Unix… • Github: http://github.com/wayarmy • Sysadmin, SysOps, DevOps, HumanOps
- 3. 1. DevOps 2. CI- CD 3. System Design with Docker on AWS 4. CI - CD workflow with Docker 5. Q&A Techtalk AWS and Docker
- 4. DEVOPS • DevOps isthe practice of operations and development engineers participating together in the entire service lifecycle, from design through the development process to production support. https://theagileadmin.com
- 5. DevOps requirement • DevOpsSkills • Program Language, Application design... • Knowhow about system design • Experience with SaaS, PaaS, IaaS... • Knowhow about Cloud Computing, Virtualization. • Knowhow about concept of CI - CD
- 6. 1. DevOps 2. CI- CD 3. System Design with Docker on AWS 4. CI - CD workflow with Docker 5. Q&A Techtalk AWS and Docker
- 7. Continous Intergration • Continuousintegration (CI) is the practice of merging all developer working copies to a shared mainline several times a day. - Wiki Pedia - • Implement: • Source code managerment • Automation testing • Automation QA • Automation releasing
- 8. Continous Delivery • Continuousdelivery (CD) is a software engineering approach in which teams produce software in short cycles, ensuring that the software can be reliably released at any time • - Wiki Pedia -
- 9. Target • Optimize released-timeof Production. • Optimize Dev workflow. • Decrease number of tester - Optimize business benefit.
- 10. 1. DevOps 2. CI- CD 3. System Design with Docker on AWS 4. CI - CD workflow with Docker 5. Q&A Techtalk AWS and Docker
- 11. Difficulty of DevOpsin System • So hard to get experience with physical, network • So difficult to know all SaaS, PaaS, IaaS... • Everything with Dev is code, everything with developer will be moved to code • So difficult to maintain software => System need "write once, run forever"
- 12. Topica Edumall (old)System Design
- 14. AWS EC2 Feature •Autoscale • High Availability • Secure
- 15. Edumall Infrastructure SystemDesign on AWS
- 27. Benifit • High availabilitysystem • Easy with scale and everything will be automated • Auto healing • Save much money ( save about 40% with 100% running application on AWS )
- 28. Difficult with DevOps •Server is not transparent with Dev • Deploy with Command line, get error when deploy • Application environment is not isolate • Deploying is not automation • Hardware is still get high, cannot optimize
- 29. Difficult with DevOps •Server is not transparent with Dev • Deploy with Command line, get error when deploy • Application environment is not isolate • Deploying is not automation • Hardware is still get high, cannot optimize => Need a system with isolate environment and orchestration tools for platform
- 30. Docker • Docker containerswrap a piece of software in a complete filesystem that contains everything needed to run: code, runtime, system tools, system libraries – anything that can be installed on a server. This guarantees that the software will always run the same, regardless of its environment. • Build – Ship – Run • Build once, run any where
- 31. Kubernetes • Kubernetes isan open-source system for automating deployment, scaling, and management of containerized applications. • “Write once, run forever” • Build Auto-scale and self-healing system
- 32.
- 34. Some numbers • Videocontent transfer: 1,5 TB (/1 day) • Static Content (image, js, html, css): 100GB • Total Request: ~ 5 mil • Total Ram: ~ 2TB • Total CPU: ~400vCpus • Unique Visitor: ~50k • Total User: ~20m • Maximum Unique Visitors: ~5k • EC2 Start: ~ 5 (M4 2xLarge)
- 35. Techtalk AWS andDocker 1. DevOps 2. CI - CD 3. System Design with Docker on AWS 4. CI - CD workflow with Docker 5. Q&A
- 36. Target • Server istransparent with Dev • PaaS • Everything is Automation • Easy with operation • Document as Code
- 37. Element • Source codemanagerment: Gitlab • CI builder: Gitlab multi runner • Platform: Docker • Docker registry: Private registry store on AWS S3, ECR • Provisioning: Gitlab runner / Ansible (Near future)
- 38. CI-CD workflow Developer pusha new commit to gitlab Gitlab Trigger Gitlab Runner fetch and pull repo Gitlab-runner build Docker image from Dockerfile Excute test on all target With all environment Delivery images to Docker hub Or Private registry Deploy to K8s Cluster
- 39. Sumary • DevOps workflowwith AWS IaaS, Kuberntes, Gitlab... • Isolate application environment with Docker • Increase team productivity • Decrease the number of member in Developer Team, SysAdmin Team, increase the benefit • Write one, run any where and forever!!!!!! => Don't care about the system, take care of your health
- 40. Techtalk AWS andDocker 1. DevOps 2. CI - CD 3. System Design with Docker on AWS 4. CI - CD workflow with Docker 5. Q&A
- 41.
- 42. Meetup: www.meetup.com/AWS-vietnam FB: www.facebook.com/groups/amazonwebservicevietnam JoinSlack: https://aws-vn.herokuapp.com/