Varun Kumar Senior Consultant, Cloud Engineering Background Varun Kumar is a Senior Consultant with Deloitte SEA. He is a cloud professional with over 8+ years of diversified experience in DevOps. • Varun is also a Research Scholar, published three research papers, including IEEE. His research area & topic was virtualization and Hypervisors • He is a Technical Blogger, wrote many blogs about AWS cloud, DevOps. DevSecOps and in general cloud computing topics. • He is a professional cloud trainer, delivered many training across the glob and share his knowledge toward community which includes collage students, fresher's and Corporate professionals. Please find more details: • https://www.linkedin.com/in/vkmanik/ • https://medium.com/@varunmanik1 • https://www.youtube.com/channel/UCcuMPYJ4Osax4528rgqQWrw • https://www.facebook.com/cloudvirtualization/
Qualifications and Professional Affiliations Qualification: • Master Degree in Computer Science. Professional Certificate: • AWS Certified Solutions Architect - Professional • AWS Certified Developer – Associate • AWS Certified SysOps - Associate • AWS Certified Solution Architect – Associate • AWS Certified Practitioner • Red Hat Certificate of Expertise in Ansible Automation
Notable Recent Experiences • Cloud migration lead at a large media company based in South East Asia, providing ongoing consulting, improvement feedback, and cloud expertise to this team for implementation of DevOps practices and migration of their CRM/billing systems to cloud. • Building DevOps, DevSecOps capabilities and Automation labs within the organization by implementing various tools for Continuous Integration (CI), Continuous Deployment (CD) and Continuous Assessment (CA) for multiple accounts. • Lead the automation team, Automate daily Cloud tasks in DevOps Tools, Create & configure automation of AWS resources with DevOps best practice to enhance the CICD (Continuous Integration and Continuous Delivery) process for the organization. • Built the DevOps, DevSecOps, DevFinOps practice within the organization and enabled a DevOps champion in every product team, leading to cohesive standards and capabilities in these areas.
Topic: DevOps Culture and CICD pipeline for AWS ECS • About DevOps Culture 5 min • Brief Discussion about Micro Services 10 min • Over all project explanation 10 min • Project implementation 45-50 min • AWS Copilot 10 -15 min • Question & Answers 10 min.
What is DevOps DevOps is a software delivery approach, culture and practice that brings the development team, business, testing and operations teams together to achieve a common business goal.
What is DevOps Technology Process Business •Scaled Capacity – Operate more apps at the same cost & better SLAs •Optimized Continuous Delivery Environments – Right-sized & standardized, less wait times, more stability, optimized usage, reduced costs (hardware, software & people) •Release Ready – Better code quality, always-available deployable pipelines •Rapid Iteration – Increased builds & shift-left testing allows early failures to become future successes •Efficiency – More cost effective, automated processes enabling faster deployments with reduced wait times •Quality – Test automation allows decreased testing time & increased test coverage. Automated code scans help to improve the code quality. This can help to reduce technical debt. •Speed – Increased time to market •Consistency – Consistent and transparent continuous delivery that helps align pace of change to business readiness.
Prerequisites Basics of AWS • What is Container / Docker • ECR • ECS • FARGE • TASK • ALB • IAM DevOps Tools • Code Commit • Code Build • Code Deploy • Code Pipeline • ECS
AWS DevOps Tools
Open Source DevOps Tools
Complete CICD pipeline for AWS ECS, ECR, Code Commit, Code Deploy & Code Pipeline Step 1: Docker Basic 1. Create EC2 Instance 2. Install Docker 3. Pull centos:centos6 4. Create index.html 5. Create Dockerfile 6. Build Docker image
Step 2: AWS ECR Creation 1. Create AWS ECR 2. Login to ECR 3. Tag existing image as AWS ECR repo 4. Push image into the ECR 5. https://us-east- 1.console.aws.amazon.com/ecr/repositorie s?region=us-east-1#
Step 3: Create ALB 1. Create Target group 2. Create ALB 3. Create Security Group
Step 4: Create AWS ECS Cluster 1. Create a Task with Fargate Compatibility 2. Create a Fargate Cluster 3. Create a Service with ALB enabled 4. Test ALB DNS, weather your site is running or not
Step 5: AWS Code Commit 1. Create a Repo 2. Set ssh connectivity in your local machine 3. Push your code into the newly created repo
Step 6: AWS Code Build 1. Create a Code build Project 2. Select an Artifact for output 3. Build your Docker image & push to AWS ECR
Step 7: AWS Code Pipeline 1. Create a pipeline Project 2. Select your Code commit repo as a input repo from step 5 3. Select Code build project from Step 6 4. Select Code Deploy for ECS 5. Select your cluster and Service name from step 3 6. Crete the Code pipeline
Step 8: Error 1. In above pipeline first 2 steps will run successfully 2. Step 3 deploy will give you an error 3. For this you need to Create one “imagedefinitions.json” file and push it to the code commit 4. Pipeline will run again and you will again get an error on step 3
Step 9: Modify Input Artifacts Settings for Stage Change the input
Step 10: Final Deployment Test and Validation 1. Push the new version of code in code commit 2. It will automatically deploy the new task with new version 3. At last you can run the DNS ALB on your browser
AWS Copilot 1. AWS Copilot is designed for both existing ECS users, and new ECS users who want to move beyond manual management of lower-level infrastructure, 2. Instead just start thinking about their application and its lifecycle. 3. Copilot creates modern application deployments by default, based on production-ready patterns that include best practices designed by ECS engineers and customers over the years
Question & Answers….?
Thanks…..!
Contact Me …..!

AWS ECS Copilot DevOps Presentation

  • 1.
    Varun Kumar Senior Consultant, CloudEngineering Background Varun Kumar is a Senior Consultant with Deloitte SEA. He is a cloud professional with over 8+ years of diversified experience in DevOps. • Varun is also a Research Scholar, published three research papers, including IEEE. His research area & topic was virtualization and Hypervisors • He is a Technical Blogger, wrote many blogs about AWS cloud, DevOps. DevSecOps and in general cloud computing topics. • He is a professional cloud trainer, delivered many training across the glob and share his knowledge toward community which includes collage students, fresher's and Corporate professionals. Please find more details: • https://www.linkedin.com/in/vkmanik/ • https://medium.com/@varunmanik1 • https://www.youtube.com/channel/UCcuMPYJ4Osax4528rgqQWrw • https://www.facebook.com/cloudvirtualization/
  • 2.
    Qualifications and ProfessionalAffiliations Qualification: • Master Degree in Computer Science. Professional Certificate: • AWS Certified Solutions Architect - Professional • AWS Certified Developer – Associate • AWS Certified SysOps - Associate • AWS Certified Solution Architect – Associate • AWS Certified Practitioner • Red Hat Certificate of Expertise in Ansible Automation
  • 3.
    Notable Recent Experiences •Cloud migration lead at a large media company based in South East Asia, providing ongoing consulting, improvement feedback, and cloud expertise to this team for implementation of DevOps practices and migration of their CRM/billing systems to cloud. • Building DevOps, DevSecOps capabilities and Automation labs within the organization by implementing various tools for Continuous Integration (CI), Continuous Deployment (CD) and Continuous Assessment (CA) for multiple accounts. • Lead the automation team, Automate daily Cloud tasks in DevOps Tools, Create & configure automation of AWS resources with DevOps best practice to enhance the CICD (Continuous Integration and Continuous Delivery) process for the organization. • Built the DevOps, DevSecOps, DevFinOps practice within the organization and enabled a DevOps champion in every product team, leading to cohesive standards and capabilities in these areas.
  • 4.
    Topic: DevOps Cultureand CICD pipeline for AWS ECS • About DevOps Culture 5 min • Brief Discussion about Micro Services 10 min • Over all project explanation 10 min • Project implementation 45-50 min • AWS Copilot 10 -15 min • Question & Answers 10 min.
  • 5.
    What is DevOps DevOpsis a software delivery approach, culture and practice that brings the development team, business, testing and operations teams together to achieve a common business goal.
  • 6.
    What is DevOps TechnologyProcess Business •Scaled Capacity – Operate more apps at the same cost & better SLAs •Optimized Continuous Delivery Environments – Right-sized & standardized, less wait times, more stability, optimized usage, reduced costs (hardware, software & people) •Release Ready – Better code quality, always-available deployable pipelines •Rapid Iteration – Increased builds & shift-left testing allows early failures to become future successes •Efficiency – More cost effective, automated processes enabling faster deployments with reduced wait times •Quality – Test automation allows decreased testing time & increased test coverage. Automated code scans help to improve the code quality. This can help to reduce technical debt. •Speed – Increased time to market •Consistency – Consistent and transparent continuous delivery that helps align pace of change to business readiness.
  • 7.
    Prerequisites Basics of AWS •What is Container / Docker • ECR • ECS • FARGE • TASK • ALB • IAM DevOps Tools • Code Commit • Code Build • Code Deploy • Code Pipeline • ECS
  • 8.
  • 9.
  • 10.
    Complete CICD pipelinefor AWS ECS, ECR, Code Commit, Code Deploy & Code Pipeline Step 1: Docker Basic 1. Create EC2 Instance 2. Install Docker 3. Pull centos:centos6 4. Create index.html 5. Create Dockerfile 6. Build Docker image
  • 11.
    Step 2: AWSECR Creation 1. Create AWS ECR 2. Login to ECR 3. Tag existing image as AWS ECR repo 4. Push image into the ECR 5. https://us-east- 1.console.aws.amazon.com/ecr/repositorie s?region=us-east-1#
  • 12.
    Step 3: CreateALB 1. Create Target group 2. Create ALB 3. Create Security Group
  • 13.
    Step 4: CreateAWS ECS Cluster 1. Create a Task with Fargate Compatibility 2. Create a Fargate Cluster 3. Create a Service with ALB enabled 4. Test ALB DNS, weather your site is running or not
  • 14.
    Step 5: AWSCode Commit 1. Create a Repo 2. Set ssh connectivity in your local machine 3. Push your code into the newly created repo
  • 15.
    Step 6: AWSCode Build 1. Create a Code build Project 2. Select an Artifact for output 3. Build your Docker image & push to AWS ECR
  • 16.
    Step 7: AWSCode Pipeline 1. Create a pipeline Project 2. Select your Code commit repo as a input repo from step 5 3. Select Code build project from Step 6 4. Select Code Deploy for ECS 5. Select your cluster and Service name from step 3 6. Crete the Code pipeline
  • 17.
    Step 8: Error 1.In above pipeline first 2 steps will run successfully 2. Step 3 deploy will give you an error 3. For this you need to Create one “imagedefinitions.json” file and push it to the code commit 4. Pipeline will run again and you will again get an error on step 3
  • 18.
    Step 9: ModifyInput Artifacts Settings for Stage Change the input
  • 19.
    Step 10: FinalDeployment Test and Validation 1. Push the new version of code in code commit 2. It will automatically deploy the new task with new version 3. At last you can run the DNS ALB on your browser
  • 20.
    AWS Copilot 1. AWSCopilot is designed for both existing ECS users, and new ECS users who want to move beyond manual management of lower-level infrastructure, 2. Instead just start thinking about their application and its lifecycle. 3. Copilot creates modern application deployments by default, based on production-ready patterns that include best practices designed by ECS engineers and customers over the years
  • 21.
  • 22.
  • 23.