ZERO TOUCH QA AUTOMATION PLATFORM FOR DEVOPS
About TaUB Solutions • TaUB - “Taking you Beyond” • HQ in Bangalore – Office in USA and Singapore • Gamification Consulting, Training and Implementation Services • Focus on Value and help customer reach strategic objectives
Hari Gurumoorthi | DevOps & Agile Practice Head | Continuous Delivery Architect | DevSecOps | Data Analytics | UXCIO @ TaUB Solutions ■ 19+ years of experience Quality Assurance for fortune 500 clients ■ Experienced in building data-driven solutions ■ Passionate in spreading DevOps Best Practices ■ Frequent Blogger and Speaker in International Conferences
Varadharajan Srinivasan | Delivery Management | Quality Engineering | Data Engineering Associate Director ■ 17+ years of experience Quality Assurance for fortune 500 clients ■ Expert in quality organization transformation towards DevOps and Agile delivery model ■ Focus on LeanQA and POD delivery model ■ 50+ blogs and speaker in conferences ■ Winner of QAI Best of the Best Testing Leadership Award
What is your current state of QA Automation in your organization? • QA is manual • QA is 20% automated • QA is 50% automated • QA is 75% automated • QA is fully automated https://linkto.run/p/NIQ653OE Please provide your answers in the below Link
Challenges in QA Automation
Top 5 Challenges 01 Need simplified automation approach to enable functional testers with test automation 02 Need manual effort reduction in end-to-end test process 03 Need ability to automatically analyze the test failures 04 Need ability to focus on 360 degree Quality Assurance 05 Need solution to measure Code coverage
Challenge 1 Need to simplify Test Automation AGILE ADOPTION Expected to have more frequent releases Current Team have less automation expertise Go beyond UI test to API and data testing Need to automate regression / progression test cases AND NO COMPROMISE ON PRODUCT QUALITY CHALLENGE Stress endures handling knowledge upskilling and project deadlines in parallel Automation Enablement for entire team is time taking process Testing needs to go away from only E2E to Component, API to reduce cycle time Agile Transformation demands Layered | High adoption | Simplified
Challenge 2 Need to automate the E2E QA Lifecycle Is it practically possible to practice every phase of Software Test Life Cycle Process in DevOps/Agile Model ? What if we skip QA Process?  No E2E Traceability  Lack of documentation  loss of knowhow  Low Defect Containment efficiency  No view on project health  Lack of Quality Control What if hours on the QA Process?  Considerable manual effort  Prolonged Time to Market  Not suitable in Agile delivery models ImpactsOutweigh Focus not just on Test Execution Automation Efficient and Continuous Testing Agility possible through Fully automated QA Process Requirement Analysis Test Design ALM Update Test Scripts Development Test Execution Test Logs Test Reporting Test Closure
Costly & Complicated Adoption! Challenge in adapting to complicated tools amidst project deadlines No Transparency on Project Health Cumbersome to monitor and maintain KPIs in multiple forum Delayed Feedback! Unproductive days due to bad builds and test failures caused by environmental issues Huge Effort spent! Multiple test runs a day & continuous investigation of failures leading to considerable effort spend Challenge 3 Simplify Test Analysis & Reporting
360 degree Quality Functional Performance Security Accessibility Resiliency Usability Need to go beyond functional assurance for better customer experience Need to have early feedback on non functional areas like performance and security needs Challenge Challenge 4 360 Degree Quality Assurance
Challenge 5 Need solution to measure Code coverage There are too many test cases which test the same code path A tester is not aware of the areas that have not been tested Redundant & non-productive Incomplete & un-tested Conventional requirements-based testing of code tends to result in considerable over-testing without the guarantee of complete coverage Focusing on high value tests? Facilitating faster Stabilization of final release ? Enough testing in place ? Impact - This typically results in additional QA cost and extended testing timelines which in turn impact project success
A Vision for Digital IT Industry ZERO TOUCH QA Adopt next-generation testing practices to test early, often, automatically and continuously
1 Automated Functional Testing Simplification/ Script less Automation Challenge 01 Getting the existing team to upskill in programming language to automate 02 Meeting the current project deliverables and upskilling puts stress on the testers 03 To retain the domain knowledge that enables quality product delivery Solution Simplify the various types of automation using a BDD construct Example: Karate for API test Benefits Enabled 90% of existing team for progression and regression automation Reduced test automation effort by 60%
1 Automated Functional Testing UI Test Simplification Then I enter the text {103 John F Kennedy Pkwy, STE 234} into {Billing Street} Text Area Then I enter the text {New York} into {Billing City} Text Box Then I select the drop down value as {Available} in {Customer Status} Then I select the {Active Account} checkbox Then I select the {Current Date} date for {Data Update Date} field Then I click on the {Edit} Button Control 1. Identify Patten (Generic XPATH ) Text Area //label[text()='"+ LABEL +"']/following::td[1]/textarea Text Box //label[text()='"+ LABEL +"']/following::input[1] Check Box //label[text()='"+ LABEL +"']/following::input[1] Date Field //label[text()='"+ LABEL +"']/following::td[1]//span[@class='dateFormat'] Button //input[@value='"+ LABEL +"'] Drop Down //label[text()='"+ LABEL +"']//following::td[1]//select 3. Abstract with BDD Construct (Scenario) 1. Identify Patterns 2. Review and Align with UI Developers 3. Abstract with BDD Construct 4. Publish Language of Automation
1 Automated Functional Testing API Test Simplification 1. Identify Patterns 2. Review and Align with UI Developers 3. Abstract with BDD Construct 4. Publish Language of Automation Karate Framework Integration with BDD
2 Automatic creation of Test Cases/Defects Automate E2E QA Lifecycle Process JIRA Dashboard with Test Metrics Creation of Bugs in JIRA for failed test cases and Auto Analysis of Failed Bugs Update the Test Cases as Pass/Fail as per Test Results Creation of Test Cases in JIRA under the Test Cycle Run the Automation Test Cases in QA Environment Trigger Job from Jenkins Begin Step 1 Step 2 Step 3 Step 4 End
2 Automatic creation of Test Cases/Defects Zephyr JIRA Integration AUTOMATED STATUS AND DEFECTSAUTOMATED TEST CASE Note: Options are available to avoid logging of duplicate defects in JIRA
2 Automatic creation of Test Cases/Defects JIRA Serenity Integration
3 Auto Analysis of failures AI powered Test Automation Dashboard with Real-Time Analytics
3 Auto Analysis of failures AI powered Test Automation Dashboard with Real-Time Analytics AL BASED ANALYSIS CENTRAL REPOSITORY FOR INTEGRATED DASHBOARD AND REPORTS FAILURE TRACKING / MANAGEMENT
4 Automatic trigger of NFT and auto upload of test results 360 degree Quality Assurance Features:  Perform Performance Testing using Jmeter, integrated with Jenkins  Perform Security Testing using Fortify, integrated with Jenkins  Upload the Results in Confluence automatically Benefits:  Transparent visibility of test results  70% of effort savings in Test Closure activities
5 Quality Intelligence Test with Sealights tool Automatic Code Coverage Analysis Features: o Test Gap Analytics o Release Quality Analytics o Block Untested Code Changes o Utilize Test Impact Analytics to Test Smarter Benefits: o 100% Improvement in Code Coverage for Test Cases o Test Quality Analytics to Test More with “Less Tests Approach”
UAT/STAKEHOLDER’S DEMO Production Release Zero Touch QA Automation Platform Deployment Pipeline AUTOMATED QA WORKFLOW AUTOMATIC TRIGGER OF QA FUNCTIONAL TEST AUTOMATIC CREATION OF TEST CASES/DEFECTS AUTOMATED FAILURE ANALYSIS Karate 1 2 3 AUTO., TRIGGER OF QA PERF. TEST AUTOMATIC RESULTS RECORDING AUTO., TRIGGER OF SECURITY TEST 4 QUALITY INTELLIGENCE TEST 5 USER STORY IDE Code Commit Status update Commit code VERSION CONTROL CODE QUALITY UNIT TEST COVERAGE UNIT TEST BUILD PIPELINE STATIC CODE ANALYSIS CI / CD ORCHESTRATION UNIT TEST
Q&A
Upcoming Events Webinar Lean Experimentational Model for DevOps Public Training Continuous Delivery Architect Certified Agile Service Management DevSecOps Engineering (DSOE)℠ 16, 17 FEB 2019 Virtual Instructor Lead 16, 17 FEB 2019 Virtual Instructor Lead 09, 10 MAR 2019 Virtual Instructor Lead Build features that provides an impact to your customers by well structure and data driven model APRIL 2019
Thank You 15692 Kiefer Rd Germantown, Ohio USA 45327 Novel Tech Park Kudlu Gate, Bangalore, INDIA 560068 30 Cecil Street, #19-08 Prudential Tower, Singapore, SINGAPORE 049712 www.taubsolutions.com info@taubsolutions.com

Zero touch QA automation platform for DevOps

  • 1.
  • 2.
    About TaUB Solutions •TaUB - “Taking you Beyond” • HQ in Bangalore – Office in USA and Singapore • Gamification Consulting, Training and Implementation Services • Focus on Value and help customer reach strategic objectives
  • 3.
    Hari Gurumoorthi | DevOps &Agile Practice Head | Continuous Delivery Architect | DevSecOps | Data Analytics | UXCIO @ TaUB Solutions ■ 19+ years of experience Quality Assurance for fortune 500 clients ■ Experienced in building data-driven solutions ■ Passionate in spreading DevOps Best Practices ■ Frequent Blogger and Speaker in International Conferences
  • 4.
    Varadharajan Srinivasan | Delivery Management |Quality Engineering | Data Engineering Associate Director ■ 17+ years of experience Quality Assurance for fortune 500 clients ■ Expert in quality organization transformation towards DevOps and Agile delivery model ■ Focus on LeanQA and POD delivery model ■ 50+ blogs and speaker in conferences ■ Winner of QAI Best of the Best Testing Leadership Award
  • 6.
    What is yourcurrent state of QA Automation in your organization? • QA is manual • QA is 20% automated • QA is 50% automated • QA is 75% automated • QA is fully automated https://linkto.run/p/NIQ653OE Please provide your answers in the below Link
  • 7.
    Challenges in QAAutomation
  • 8.
    Top 5 Challenges 01Need simplified automation approach to enable functional testers with test automation 02 Need manual effort reduction in end-to-end test process 03 Need ability to automatically analyze the test failures 04 Need ability to focus on 360 degree Quality Assurance 05 Need solution to measure Code coverage
  • 9.
    Challenge 1 Need tosimplify Test Automation AGILE ADOPTION Expected to have more frequent releases Current Team have less automation expertise Go beyond UI test to API and data testing Need to automate regression / progression test cases AND NO COMPROMISE ON PRODUCT QUALITY CHALLENGE Stress endures handling knowledge upskilling and project deadlines in parallel Automation Enablement for entire team is time taking process Testing needs to go away from only E2E to Component, API to reduce cycle time Agile Transformation demands Layered | High adoption | Simplified
  • 10.
    Challenge 2 Need toautomate the E2E QA Lifecycle Is it practically possible to practice every phase of Software Test Life Cycle Process in DevOps/Agile Model ? What if we skip QA Process?  No E2E Traceability  Lack of documentation  loss of knowhow  Low Defect Containment efficiency  No view on project health  Lack of Quality Control What if hours on the QA Process?  Considerable manual effort  Prolonged Time to Market  Not suitable in Agile delivery models ImpactsOutweigh Focus not just on Test Execution Automation Efficient and Continuous Testing Agility possible through Fully automated QA Process Requirement Analysis Test Design ALM Update Test Scripts Development Test Execution Test Logs Test Reporting Test Closure
  • 11.
    Costly & Complicated Adoption! Challenge inadapting to complicated tools amidst project deadlines No Transparency on Project Health Cumbersome to monitor and maintain KPIs in multiple forum Delayed Feedback! Unproductive days due to bad builds and test failures caused by environmental issues Huge Effort spent! Multiple test runs a day & continuous investigation of failures leading to considerable effort spend Challenge 3 Simplify Test Analysis & Reporting
  • 12.
    360 degree Quality Functional Performance Security Accessibility Resiliency Usability Needto go beyond functional assurance for better customer experience Need to have early feedback on non functional areas like performance and security needs Challenge Challenge 4 360 Degree Quality Assurance
  • 13.
    Challenge 5 Need solutionto measure Code coverage There are too many test cases which test the same code path A tester is not aware of the areas that have not been tested Redundant & non-productive Incomplete & un-tested Conventional requirements-based testing of code tends to result in considerable over-testing without the guarantee of complete coverage Focusing on high value tests? Facilitating faster Stabilization of final release ? Enough testing in place ? Impact - This typically results in additional QA cost and extended testing timelines which in turn impact project success
  • 14.
    A Vision forDigital IT Industry ZERO TOUCH QA Adopt next-generation testing practices to test early, often, automatically and continuously
  • 15.
    1 Automated FunctionalTesting Simplification/ Script less Automation Challenge 01 Getting the existing team to upskill in programming language to automate 02 Meeting the current project deliverables and upskilling puts stress on the testers 03 To retain the domain knowledge that enables quality product delivery Solution Simplify the various types of automation using a BDD construct Example: Karate for API test Benefits Enabled 90% of existing team for progression and regression automation Reduced test automation effort by 60%
  • 16.
    1 Automated FunctionalTesting UI Test Simplification Then I enter the text {103 John F Kennedy Pkwy, STE 234} into {Billing Street} Text Area Then I enter the text {New York} into {Billing City} Text Box Then I select the drop down value as {Available} in {Customer Status} Then I select the {Active Account} checkbox Then I select the {Current Date} date for {Data Update Date} field Then I click on the {Edit} Button Control 1. Identify Patten (Generic XPATH ) Text Area //label[text()='"+ LABEL +"']/following::td[1]/textarea Text Box //label[text()='"+ LABEL +"']/following::input[1] Check Box //label[text()='"+ LABEL +"']/following::input[1] Date Field //label[text()='"+ LABEL +"']/following::td[1]//span[@class='dateFormat'] Button //input[@value='"+ LABEL +"'] Drop Down //label[text()='"+ LABEL +"']//following::td[1]//select 3. Abstract with BDD Construct (Scenario) 1. Identify Patterns 2. Review and Align with UI Developers 3. Abstract with BDD Construct 4. Publish Language of Automation
  • 17.
    1 Automated FunctionalTesting API Test Simplification 1. Identify Patterns 2. Review and Align with UI Developers 3. Abstract with BDD Construct 4. Publish Language of Automation Karate Framework Integration with BDD
  • 18.
    2 Automatic creationof Test Cases/Defects Automate E2E QA Lifecycle Process JIRA Dashboard with Test Metrics Creation of Bugs in JIRA for failed test cases and Auto Analysis of Failed Bugs Update the Test Cases as Pass/Fail as per Test Results Creation of Test Cases in JIRA under the Test Cycle Run the Automation Test Cases in QA Environment Trigger Job from Jenkins Begin Step 1 Step 2 Step 3 Step 4 End
  • 19.
    2 Automatic creationof Test Cases/Defects Zephyr JIRA Integration AUTOMATED STATUS AND DEFECTSAUTOMATED TEST CASE Note: Options are available to avoid logging of duplicate defects in JIRA
  • 20.
    2 Automatic creationof Test Cases/Defects JIRA Serenity Integration
  • 21.
    3 Auto Analysisof failures AI powered Test Automation Dashboard with Real-Time Analytics
  • 22.
    3 Auto Analysisof failures AI powered Test Automation Dashboard with Real-Time Analytics AL BASED ANALYSIS CENTRAL REPOSITORY FOR INTEGRATED DASHBOARD AND REPORTS FAILURE TRACKING / MANAGEMENT
  • 23.
    4 Automatic triggerof NFT and auto upload of test results 360 degree Quality Assurance Features:  Perform Performance Testing using Jmeter, integrated with Jenkins  Perform Security Testing using Fortify, integrated with Jenkins  Upload the Results in Confluence automatically Benefits:  Transparent visibility of test results  70% of effort savings in Test Closure activities
  • 24.
    5 Quality IntelligenceTest with Sealights tool Automatic Code Coverage Analysis Features: o Test Gap Analytics o Release Quality Analytics o Block Untested Code Changes o Utilize Test Impact Analytics to Test Smarter Benefits: o 100% Improvement in Code Coverage for Test Cases o Test Quality Analytics to Test More with “Less Tests Approach”
  • 25.
    UAT/STAKEHOLDER’S DEMO Production Release Zero Touch QAAutomation Platform Deployment Pipeline AUTOMATED QA WORKFLOW AUTOMATIC TRIGGER OF QA FUNCTIONAL TEST AUTOMATIC CREATION OF TEST CASES/DEFECTS AUTOMATED FAILURE ANALYSIS Karate 1 2 3 AUTO., TRIGGER OF QA PERF. TEST AUTOMATIC RESULTS RECORDING AUTO., TRIGGER OF SECURITY TEST 4 QUALITY INTELLIGENCE TEST 5 USER STORY IDE Code Commit Status update Commit code VERSION CONTROL CODE QUALITY UNIT TEST COVERAGE UNIT TEST BUILD PIPELINE STATIC CODE ANALYSIS CI / CD ORCHESTRATION UNIT TEST
  • 26.
  • 27.
    Upcoming Events Webinar Lean ExperimentationalModel for DevOps Public Training Continuous Delivery Architect Certified Agile Service Management DevSecOps Engineering (DSOE)℠ 16, 17 FEB 2019 Virtual Instructor Lead 16, 17 FEB 2019 Virtual Instructor Lead 09, 10 MAR 2019 Virtual Instructor Lead Build features that provides an impact to your customers by well structure and data driven model APRIL 2019
  • 28.
    Thank You 15692 KieferRd Germantown, Ohio USA 45327 Novel Tech Park Kudlu Gate, Bangalore, INDIA 560068 30 Cecil Street, #19-08 Prudential Tower, Singapore, SINGAPORE 049712 www.taubsolutions.com info@taubsolutions.com

Editor's Notes

  • #7 https://linkto.run/p/NIQ653OE Results https://linkto.run/r/NIQ653OE