DISCOVER THE POWER OF QA AUTOMATION TESTING SERVICES
Table Of Contents Executive Summary What is Automation testing? Manual Testing Automated Testing Why choose Automation testing over Manual testing? Benefits of Automation Testing Leading Tools available Comparison Matrix (Web Tools) Comparison Matrix (Mobile Tools) Conclusion About Softweb Solutions 3 3 3 3 4 4 4 5 6 7 8 8 © 2014 Softweb Solutions, Inc. All Rights Reserved. This document, as well as the software described in it, is furnished under license. The information in this manual may only be used in accordance with the terms of the license. This document should not be reproduced, stored or transmitted in any form, except as permitted by the license or by the express permission of Softweb Solutions, Inc. Other product and company names referenced in this document are trademarks and/or registered trademarks of their respective companies.
EXECUTIVE SUMMARY This whitepaper aims at explaining the benefits of automated testing by providing relevant information regarding the various testing tools available today. We take a look at the manual testing process and its limitations, and how they can be turned around using automation. The paper also includes detailed compar-ison matrices of some of the leading automation te sting tools for web and mobile based testing. WHAT IS AUTOMATION TESTING? Automation testing is achieved by using automation tools to define and execute test cases without any manual input during the testing process. Essential but repetitive tasks can be automated in a formalized testing process that is already in place. Test cases that are difficult to perform manually can also be added to the automated testing process. MANUAL TESTING Manual testing requires dedicated personnel to run each test case, which is tedious and time consuming. More testers are required as test cases need to be executed manually. Human errors are likely to crop up, which questions the reliability of manual testing. Sophisticated tests cannot be programmed to fetch hidden information, which means the tester has to manually look for that information. For every software release the same set of tests must be rerun by a manual tester. The company will have to invest in testers with good coding knowledge, which, in the long term proves costly.
AUTOMATION TESTING Automated test cases run significantly faster than manual tests. Automation tools ensure fewer testers are required as the test cases are run by the software. Once a test case is designed, automation tests precisely perform the same operation every time they are executed. Hidden information can be fetched by program-ming sophisticated tests. Automation has the ability to run regressions on a code that is continuously chang-ing, while it can be run simultaneously on different machines thus decreasing overall testing time. Long term costs are reduced by eliminating the human element otherwise required for manual tests. WHY CHOOSE AUTOMATION TESTING OVER MANUAL TESTING? As we can see from their respective definitions, the two vastly vary in their execution. While manual testing has to have a human input at every stage, once a test case is designed, automated testing makes sure to follow the programmed code to the core resulting in an absolute and concrete result, which in the case of manual testing gets lengthy and tedious. BENEFITS OF AUTOMATION TESTING SHORTEN APPLICATION DEVELOPMENT CYCLES AVOID INCONVENIENT AND REPETITIVE TASKS IMPROVE SOFTWARE QUALITY 1 MANUAL TESTITING
QUICK TEST PRO (UFT) SELENIUM SPECFLOW WITH SELENIUM MONKEY TALK A SOASTA STUDY FOUND THREE-QUARTERS (77%) OF MOBILE USERS ARE CONCERNED ABOUT APP PERFORMANCE BEFORE THEY BUY AND THAT HALF (51%) OF APP DEVELOPERS SAY THEY 'DON'T HAVE TIME' TO PROPERLY TEST APPS BEFORE RELEASE. “ ” LEADING TOOLS AVAILABLE TELERIK TEST STUDIO SEETEST
COMPARISON MATRIX WEB TOOLS Feature HP UFT Language Support Windows (Non-browser) based Application support VB Script Selenium Java, C#, Ruby, Python, Perl PHP , JavaScript Yes No In-built Object Repository (storing Element Id, multiple attributes) along with weightage that gives exibility on deviation acceptance in control recognition Reports Quality Center has in-built dashboards UI Maps and dierent object location strategy such as -XPath Element ID / attribute DOM Jenkins integration can give good reporting dashboard capabilitie Browser support Environment Support Google Chrome, Internet Explorer , Mozilla Firefox, Safari Google Chrome , Internet Explorer, Mozilla Firefox , Opera Html Unit Only Windows Windows , Linux , Solaris OS X , Others (if browser JVM o JavaScript support exists) Mobile (Phones Tablets) support Framework Separate commercial product i.e. HP UFT Mobile (formerly known as MobileCloud for QTP) Android , iPhone, iPad , Blackberry , Headles WebKit Easily integrates with HP Quality Center or HP ALM (separate commercial products) Selenium + Eclipse + Maven / AN + Jenkins / Hudson its plugins / Cruise Control + TestNG + SVN Continuous Integration Object Recognition / Storage Possible through Quality Center / ALM or Jenkins Possible through Jenkins / Hudson / Cruise Control Image based Tests Easily possible Possible but not easy Coding Experience of Engineer Not Much Should be very good along with technical capabilities of integrating dierent pieces of framework Software Cost License Annual maintenance fees Zero Script Creation Time Less High Hardware resource (CPU+ RAM) consumption during script execution High Low Product Support Dedicated HP support along with support forums Open Source Community
Mobile (Phones Tablets) support iOS and Android iOS, Android, Windows and Blackberry Software Cost Licensing with extra costs Hardware resource (CPU+ RAM) consumption during script execution Objects are recognized by components. In-built Object Repository for add ons. Free and open source up to an extent 1: 2: Paid for professional edition Medium Medium Product Support No External Tool Support Supports UFT (QTP), RFT, TestComplete, Visual Studio COMPARISON MATRIX MOBILE Feature MonkeyTalk Language Support Windows (Non-browser) based Application support JavaScript or JAVA API or Own Native Language SeeTest Automation Java, C#, Ruby, Python, Perl PHP , JavaScript No Yes Browser support Environment Support No Identies Web Properties Windows, MAC and Linux Windows and MAC Framework Do not integrate with external frameworks. Plug-Ins for: UFT (QTP), RFT, TestComplete, C#, MSTest/ Visua Studio/TFS Continuous Integration Not Possible Possible through Jenkins / Hudson / Cruise Control / IBM Rational/ Maven / Visual Studio / QC / Team City Reports XML, HTML or XUnit with screenshots XML, HTML or PDF with screenshots Object Recognition / Storage Image based Tests Easily possible Easily Possible Coding Experience of Engineer Not Much Should be very good along with technical capabilities of integrating dierent pieces of framework Script Creation Time Less Less
CONCLUSION As software is becoming more robust, so is its capability to be automated. The automation tools compared above each have their features that set them apart, but the bottom line is that they all save immense time and effort by carrying out detailed and repetitive tests in an effective and efficient manner. ABOUT SOFTWEB SOLUTIONS Softweb Solutions, Inc. is a Chicago, IL, based software development company that specializes in Enterprise Mobility, Mobile Application Management (MAM), Content Management System (CMS), Cloud Services, and Mobile Application Development. Softweb Solutions has been providing high-quality and exceptionally flexible solutions to Large Enterprises and SMEs for last 10 years. The company has an extensive experience in providing the most sophisticated, high-end enterprise grade solutions to a range of industries including health and life science, construction, manufacturing, automotive, IT, financial services, entertainment and many other sectors. For more information, visit http://www.softwebsolutions.com/ Expert Developers for iOS, Android Windows Softweb Solutions 2531 Technology Drive, Suite 312, Elgin, Illinois 60124 US Toll Free Number: 1-866-345-7638 Email: info@softwebsolutions.com | www.softwebsolutions.com 300+ Years of Software Development 10+ Successful Projects Delivered 1000+ Satisfied Clients Growing 500+

Discover the power of QA automation testing

  • 1.
    DISCOVER THE POWEROF QA AUTOMATION TESTING SERVICES
  • 2.
    Table Of Contents Executive Summary What is Automation testing? Manual Testing Automated Testing Why choose Automation testing over Manual testing? Benefits of Automation Testing Leading Tools available Comparison Matrix (Web Tools) Comparison Matrix (Mobile Tools) Conclusion About Softweb Solutions 3 3 3 3 4 4 4 5 6 7 8 8 © 2014 Softweb Solutions, Inc. All Rights Reserved. This document, as well as the software described in it, is furnished under license. The information in this manual may only be used in accordance with the terms of the license. This document should not be reproduced, stored or transmitted in any form, except as permitted by the license or by the express permission of Softweb Solutions, Inc. Other product and company names referenced in this document are trademarks and/or registered trademarks of their respective companies.
  • 3.
    EXECUTIVE SUMMARY Thiswhitepaper aims at explaining the benefits of automated testing by providing relevant information regarding the various testing tools available today. We take a look at the manual testing process and its limitations, and how they can be turned around using automation. The paper also includes detailed compar-ison matrices of some of the leading automation te sting tools for web and mobile based testing. WHAT IS AUTOMATION TESTING? Automation testing is achieved by using automation tools to define and execute test cases without any manual input during the testing process. Essential but repetitive tasks can be automated in a formalized testing process that is already in place. Test cases that are difficult to perform manually can also be added to the automated testing process. MANUAL TESTING Manual testing requires dedicated personnel to run each test case, which is tedious and time consuming. More testers are required as test cases need to be executed manually. Human errors are likely to crop up, which questions the reliability of manual testing. Sophisticated tests cannot be programmed to fetch hidden information, which means the tester has to manually look for that information. For every software release the same set of tests must be rerun by a manual tester. The company will have to invest in testers with good coding knowledge, which, in the long term proves costly.
  • 4.
    AUTOMATION TESTING Automatedtest cases run significantly faster than manual tests. Automation tools ensure fewer testers are required as the test cases are run by the software. Once a test case is designed, automation tests precisely perform the same operation every time they are executed. Hidden information can be fetched by program-ming sophisticated tests. Automation has the ability to run regressions on a code that is continuously chang-ing, while it can be run simultaneously on different machines thus decreasing overall testing time. Long term costs are reduced by eliminating the human element otherwise required for manual tests. WHY CHOOSE AUTOMATION TESTING OVER MANUAL TESTING? As we can see from their respective definitions, the two vastly vary in their execution. While manual testing has to have a human input at every stage, once a test case is designed, automated testing makes sure to follow the programmed code to the core resulting in an absolute and concrete result, which in the case of manual testing gets lengthy and tedious. BENEFITS OF AUTOMATION TESTING SHORTEN APPLICATION DEVELOPMENT CYCLES AVOID INCONVENIENT AND REPETITIVE TASKS IMPROVE SOFTWARE QUALITY 1 MANUAL TESTITING
  • 5.
    QUICK TEST PRO(UFT) SELENIUM SPECFLOW WITH SELENIUM MONKEY TALK A SOASTA STUDY FOUND THREE-QUARTERS (77%) OF MOBILE USERS ARE CONCERNED ABOUT APP PERFORMANCE BEFORE THEY BUY AND THAT HALF (51%) OF APP DEVELOPERS SAY THEY 'DON'T HAVE TIME' TO PROPERLY TEST APPS BEFORE RELEASE. “ ” LEADING TOOLS AVAILABLE TELERIK TEST STUDIO SEETEST
  • 6.
    COMPARISON MATRIX WEBTOOLS Feature HP UFT Language Support Windows (Non-browser) based Application support VB Script Selenium Java, C#, Ruby, Python, Perl PHP , JavaScript Yes No In-built Object Repository (storing Element Id, multiple attributes) along with weightage that gives exibility on deviation acceptance in control recognition Reports Quality Center has in-built dashboards UI Maps and dierent object location strategy such as -XPath Element ID / attribute DOM Jenkins integration can give good reporting dashboard capabilitie Browser support Environment Support Google Chrome, Internet Explorer , Mozilla Firefox, Safari Google Chrome , Internet Explorer, Mozilla Firefox , Opera Html Unit Only Windows Windows , Linux , Solaris OS X , Others (if browser JVM o JavaScript support exists) Mobile (Phones Tablets) support Framework Separate commercial product i.e. HP UFT Mobile (formerly known as MobileCloud for QTP) Android , iPhone, iPad , Blackberry , Headles WebKit Easily integrates with HP Quality Center or HP ALM (separate commercial products) Selenium + Eclipse + Maven / AN + Jenkins / Hudson its plugins / Cruise Control + TestNG + SVN Continuous Integration Object Recognition / Storage Possible through Quality Center / ALM or Jenkins Possible through Jenkins / Hudson / Cruise Control Image based Tests Easily possible Possible but not easy Coding Experience of Engineer Not Much Should be very good along with technical capabilities of integrating dierent pieces of framework Software Cost License Annual maintenance fees Zero Script Creation Time Less High Hardware resource (CPU+ RAM) consumption during script execution High Low Product Support Dedicated HP support along with support forums Open Source Community
  • 7.
    Mobile (Phones Tablets) support iOS and Android iOS, Android, Windows and Blackberry Software Cost Licensing with extra costs Hardware resource (CPU+ RAM) consumption during script execution Objects are recognized by components. In-built Object Repository for add ons. Free and open source up to an extent 1: 2: Paid for professional edition Medium Medium Product Support No External Tool Support Supports UFT (QTP), RFT, TestComplete, Visual Studio COMPARISON MATRIX MOBILE Feature MonkeyTalk Language Support Windows (Non-browser) based Application support JavaScript or JAVA API or Own Native Language SeeTest Automation Java, C#, Ruby, Python, Perl PHP , JavaScript No Yes Browser support Environment Support No Identies Web Properties Windows, MAC and Linux Windows and MAC Framework Do not integrate with external frameworks. Plug-Ins for: UFT (QTP), RFT, TestComplete, C#, MSTest/ Visua Studio/TFS Continuous Integration Not Possible Possible through Jenkins / Hudson / Cruise Control / IBM Rational/ Maven / Visual Studio / QC / Team City Reports XML, HTML or XUnit with screenshots XML, HTML or PDF with screenshots Object Recognition / Storage Image based Tests Easily possible Easily Possible Coding Experience of Engineer Not Much Should be very good along with technical capabilities of integrating dierent pieces of framework Script Creation Time Less Less
  • 8.
    CONCLUSION As softwareis becoming more robust, so is its capability to be automated. The automation tools compared above each have their features that set them apart, but the bottom line is that they all save immense time and effort by carrying out detailed and repetitive tests in an effective and efficient manner. ABOUT SOFTWEB SOLUTIONS Softweb Solutions, Inc. is a Chicago, IL, based software development company that specializes in Enterprise Mobility, Mobile Application Management (MAM), Content Management System (CMS), Cloud Services, and Mobile Application Development. Softweb Solutions has been providing high-quality and exceptionally flexible solutions to Large Enterprises and SMEs for last 10 years. The company has an extensive experience in providing the most sophisticated, high-end enterprise grade solutions to a range of industries including health and life science, construction, manufacturing, automotive, IT, financial services, entertainment and many other sectors. For more information, visit http://www.softwebsolutions.com/ Expert Developers for iOS, Android Windows Softweb Solutions 2531 Technology Drive, Suite 312, Elgin, Illinois 60124 US Toll Free Number: 1-866-345-7638 Email: info@softwebsolutions.com | www.softwebsolutions.com 300+ Years of Software Development 10+ Successful Projects Delivered 1000+ Satisfied Clients Growing 500+