Test plan
• Test plan containing the details of the testing process, has to
be prepared during the project planning stage itself.
• This plan should contain all the details of required …
– Resources
– Testing approaches
– Testing methodologies
– Test cases.
03/05/24 Prepared By M.GNANAVEL 1
Contd..
• Test plan can be categories into three ..
– Test oracles
– Test cases
– Test Plan Format(TPF)
03/05/24 Prepared By M.GNANAVEL 2
TEST ORACLES
• Oracle is a repository of knowledge.
• Test oracles are the people or machines used to check
the correctness of the program for the given test
cases.
• The automated testing tools act as test oracles.
03/05/24 Prepared By M.GNANAVEL 3
Test cases
• Test cases can be defined as sets of input parameters
for which the software will be tested.
• Test cases are selected, the program is executed and
the results are compared with the estimated results.
• Test cases process using test cases..
– Select the test cases -execute test cases
analyze test results..
03/05/24 Prepared By M.GNANAVEL 4
TEST CASE Definition
• Test Case is defined as
• A set of test inputs, execution conditions and expected results,
developed for a particular objective.
– Documentation specifying inputs, predicted results
– A set of execution conditions for a test item.
• Specific inputs that will be tried and the procedures that will be
followed when the software tested.
• Sequence of one or more subtests executed as a sequence as the
outcome and/or final state of one subtests is the input and/or
initial state of the next.
• Specifies the pretest state of the AUT and its environment, the test
inputs or conditions.
• The expected result specifies what the AUT should produce from
the test inputs
03/05/24 PREPARED BY M.GNANAVEL 5
There are two criteria for designed for test cases
• Reliability-a set of test cases is considered to be reliable if it
detects all errors.
• Validity-a set of test cases is considered as valid if at least one
test case exposes the errors.
03/05/24 Prepared By M.GNANAVEL 6
The following techniques are used for selecting test
cases:
• Equivalence class partitioning
• Boundary value analysis
• Cause effect graphing
03/05/24 Prepared By M.GNANAVEL 7
Equivalence class partitioning
• Equivalence class partitioning technique all the
possible valid inputs and valid outputs are identified.
• It consists of both valid inputs and invalid inputs.
• For example on testing software to check whether
three numbers form a triangle.
03/05/24 Prepared By M.GNANAVEL 8
Boundary value analysis
• Boundary value analysis: values that are on the
boundary of the equivalence classes are “high yield”
test cases.
• For example, for(i=0;i<n;++i)
• {
• }
• i=n-1 is one boundary value , because there is a
likelihood that the programmer would have made a
mistake ;i<n or i<=n?
03/05/24 Prepared By M.GNANAVEL 9
Cause effect graphing
• Cause effect graphing approach for each
cause(inputs),effect(actions) is identified and a cause effect
graph is drawn.
• For example withdrawal form verification in a bank account.
– C1:Account number is correct
– C2:Signature matches
– C3:Enough money
– a1:Give money
– A2:Inform not enough money
– A3:Print fraud case
03/05/24 Prepared By M.GNANAVEL 10
Contd..
• Each of the cause(C1 to C3) can be true or false.
• For the various combinations of these causes , the action or
effect can be A1 or A2 or A3.
03/05/24 Prepared By M.GNANAVEL 11
Test Plan Format
• Prepare a test plan during the planning stage itself.
• Project name:
• Estimated start date for testing
• Estimated end date for testing
• Actual start date for testing
• Actual end date for testing
• Estimated effort in person hours / person months.
– Test set up including the hardware , software environment.
03/05/24 Prepared By M.GNANAVEL 12
Contd..
• Testing tools to be used
• Test schedule for each type of testing
• Test cases to be executed for regression testing..
03/05/24 Prepared By M.GNANAVEL 13
TESTING TOOLS
03/05/24 Prepared By M.GNANAVEL
Testing Tools
Manual Testing Automated Testing
• Time consuming ● Speed
● Repeatability
• Low reliability ● Programming Capabilities
• Human Resources ● Coverage
• Inconsistent. ● Reliability
● Reusability
• WINRUNNER
• QUICK TEST PRO (QTP)
• LOAD RUNNER
• RATIONAL ROBOT
• SILK TEST
03/05/24 Prepared By M.GNANAVEL
What is a WinRunner?
• WinRunner is Mercury Interactive Functional Testing
Tool.
• Developed by Mercury Interactive’s in 1995
03/05/24 Prepared By M.GNANAVEL 17
WINRUNNER (WR)
• WinRunner is a testing tool to do functional testing
and regression testing.
• Use GUI operations
• Functional testing tool
• WinRunner automatically creates a test script.
• Test script can be run automatically.
03/05/24 Prepared By M.GNANAVEL
Contd..
• Functional tests:
► Tests to verify that application functionality conforms to
predefined specifications.
• Automated functional testing tools:
► Tools to build and automatically execute suites of
functional tests scripts.
Important aspects of WinRunner
• Function testing/ regression testing of a variety of
application software written in programming
languages such as PowerBuilder,VB,C,C++ and Java
• Testing on ERP /CRM software packages
• Testing of Windows OS and different browser
environments such as IE and Netscape Navigator.
03/05/24 Prepared By M.GNANAVEL
FEATURES
• Increased test Power and flexibility without any extra
programming
• Multiple verification types used to ensure sound
functionality
• Data integrity verified at the back-end database
• Tests multiple environments with a single application
• Simplify creation of test scripts
• Automatically identify discrepancies in data
03/05/24 Prepared By M.GNANAVEL
WinRunner Only Environments
Custom Client/Server PowerBuilder
Forte
Delphi
Centura
Stingray
SmallTalk
ERP/CRM Baan
PeopleSoft Windows
Siebel 5, 6 GUI Clients
Oracle GUI Forms
03/05/24 Prepared By M.GNANAVEL
Vendors and tools we evaluated
Vendor Tool Name of testing suite or companion tools
Compuware TestPartner QACenter Enterprise Edition+
Empirix e-Tester e-TEST suite
Test Manager, Manual Tester,
IBM Rational Functional Tester
Performance Tester
QuickTest
Mercury Quality Center
Professional
RadView WebFT TestView Suite
Seapine QA Wizard TestTrack Pro
Segue SilkTest SilkCentral, SilkPerformer
Testing an application using WinRunner
• After installing the WinRunner on your computer ,
invoke the WinRunner application:
• Start->program->WinRunner->WinRunner
• The opening screen of the WinRunner application is
displayed ,prompting you to select one of the three
options.
– New Test: To create a new test script
– Open Test: To open an existing test script
– Quick Preview: To view the quick preview of WinRunner.
03/05/24 Prepared By M.GNANAVEL
03/05/24 Prepared By M.GNANAVEL 25
03/05/24 Prepared By M.GNANAVEL 26
TSL
• Test Script Language is a scripting language with syntax
similar to C language.
• There are 4 categories of TSL functions; Each category of
functions is for performing specific tasks;
– Analog functions
– Context sensitive functions
– Customization functions
– Standard functions
03/05/24 Prepared By M.GNANAVEL 27
CONTD..
• Analog functions-Analog mode is to exact coordinates of the
GUI map are required.
• Context sensitive functions-exact coordinates are not required.
• Customization functions-user to improve the testing tool by
adding functions to the Function Generator.
• Standard functions-include all the basic elements of
programming language like control flow
statement,mathematical functions and string related functions .
03/05/24 Prepared By M.GNANAVEL 28
QUICK TEST PRO
• Developed by Mercury in 2002
• Functional testing tool
03/05/24 Prepared By M.GNANAVEL
FEATURES
• Less time consumption
• Widely usable
03/05/24 Prepared By M.GNANAVEL
Quick Test Pro Only Environments
ERP/CRM SAP
Siebel 7.x
PeopleSoft 8.x
.Net WinForms
WebForms
.Net controls
Web Services XML, HTTP
WSDL, SOAP
J2EE, .Net
Multimedia RealAudio/Video
03/05/24 Prepared By M.GNANAVEL
Flash
LOAD RUNNER-FEATURES
• Determine if a system will meet the
requirement going live.
• Identify areas where the performance drops
down.
03/05/24 Prepared By M.GNANAVEL
RATIONAL ROBOT
• Product of IBM
• Contains various testing tools
03/05/24 Prepared By M.GNANAVEL
Features
• General-purpose test automation tool for QA
teams who want to perform functional testing.
• Simplifies configuration testing
• Tests many types of applications
03/05/24 Prepared By M.GNANAVEL
Silk Test
Silk Test – Segue
• Is an automated tool for testing the functionality of
enterprise applications in any environment.
• Designed for ease of use,
• Silk Test includes a host of productivity-boosting features
that let both beginner and expert users create functional
tests quickly, execute them automatically and analyze
results accurately.
03/05/24 Prepared By M.GNANAVEL 35
Contd..
• Silk test is a cost-effective, powerful tool for automated
function and regression testing, delivering advanced test
automation capabilities that can be used by many project
stakeholders.
• Silk test creates powerful, robust and fast test automation
across a broad range of application technologies to identify
quality problems early in development lifecycles
03/05/24 Prepared By M.GNANAVEL 36
SILK TEST - FEATURES
• Functional testing of GUI applications.
• Enables high reusability of test scripts across test
projects.
• Unicode-support to simultaneously test multiple
language versions of a global application on multiple
local platforms with a single script.
• Built-in, customizable error recovery system.
• Uncover the root cause of performance problems
quickly and easily.
03/05/24 Prepared By M.GNANAVEL
Strength and Weakness
• Strength-Good development language, good online
community, recovery system.
• Weakness- More expensive.
03/05/24 Prepared By M.GNANAVEL 38
Silk Test Products
• Silk4JRegression and functional testing for
developers using Eclipse .
• Silk4Net Regression and functional testing for
developers using Microsoft Visual Studio
03/05/24 Prepared By M.GNANAVEL 39
Manual Test Procedures
• Writing Test procedures
• Procedures vs. Scripts
• Automate Procedures
Test Script
Resources
1: Add Item
Test ID Test Objective Pass/Fail Notes
1.1 Add an empty folder
Make folder publicly
1.1.1 available
Restrict folder access to
1.1.2 site participants
Add more than one folder
1.1.3 at one time
Add a folder with spaces in
1.1.4 the name
Test Procedure
Step ID Action Expected Result
1. Select the Announcements tool o The Announcements page is displayed
2. Select the Add link o The Add Announcement page is
displayed with the following options:
oAnnouncement Title
oBody
oAccess
oAvailability
oAttachments
oEmail Notification
3. Create an Announcement with the o The Announcements page is displayed
following information: showing the This is a Test announcement.
Title: This is a Test
Body: Lorem ipsum …
Access: No change
Availability: No Change
Attachments: None
Email Notification: No change
Select the Add Announcement button