Escolar Documentos
Profissional Documentos
Cultura Documentos
com
Presents
IBMMAINFRAMES.com 1
INTRODUCTION
IBMMAINFRAMES.com 2
What is Testing?
IBMMAINFRAMES.com 3
Major Testing Objective
According to G.J.Meyers, the primary role
of Testing is not demonstration of correct
performance.
But, exposure of hidden defects.
IBMMAINFRAMES.com 4
Major principles of Testing
Exhaustive input testing is not possible
Testing is creative and difficult
Prevention of defects –Testing early in the
life cycle reduces errors.
Testing is risk based.
Testing must be planned.
Testing requires independence
IBMMAINFRAMES.com 5
Necessary constituents to
Effective testing
Creativity.
Sound domain knowledge.
Testing experience.
Sound methodology.
IBMMAINFRAMES.com 6
What is Risk?
It is a Loss associated with an event
IBMMAINFRAMES.com 7
Some Major Risks
Economical Risks (Banking).
Life threatening (Air Traffic Controls).
IBMMAINFRAMES.com 8
How to minimize Risks?
You can minimize the risk or avoid the
impact of risk by analysis and experience.
IBMMAINFRAMES.com 9
Heads under which risk
assessment can be made.
Structural
Technical and
Size.
IBMMAINFRAMES.com 10
What is a Fault/Error?
Difference between a computed, observed
or measured value or condition and the true,
specified or theoretically correct value or
condition.
IBMMAINFRAMES.com 11
What is Failure?
The inability of a system (or component) to
perform its required functions within
specified performance requirements.
IBMMAINFRAMES.com 12
An Anomaly
Any condition that deviates from
expectations is called an Anomaly.
IEEE prefers to call errors, defects, fault,
bugs, incident, problem as an “Anomaly”.
IBMMAINFRAMES.com 13
What is IEEE?
IEEE stands for Institution of Electronic
and Electrical Engineers.
IBMMAINFRAMES.com 14
Anomaly Classification
Process steps
Recognition.
Investigation.
Action and
Disposition.
IBMMAINFRAMES.com 15
Verification & Validation
Testing whether we are building the Product
Right is Called….?
Verification.
Testing whether we are building the Right
product is called…?
Validation.
IBMMAINFRAMES.com 16
Fundamental Test Process
Test Planning.
Test Specification.
Test Execution.
Test Recording.
Test Completion.
IBMMAINFRAMES.com 17
Dynamic Testing Techniques
IBMMAINFRAMES.com 18
This is a simple exercise aimed at
introducing the basic concepts of
Dynamic Testing Techniques
IBMMAINFRAMES.com 19
Test Strategies
IBMMAINFRAMES.com 21
Black Box Vs White Box
Black Box White Box
Tests are derived from the Tests require knowledge of
functional design the internal program
specifications structure and code.
Will fail to test “hidden Will fail to detect “missing
functions” functions”
Data driven Logic driven
IBMMAINFRAMES.com 22
Levels of Testing
Unit Testing: Done by developers at module
level – White box.
Integration Testing: By integration team –
Black box.
System Testing: By project team or by
separate team – Black Box.
Acceptance Testing: By client (either at his
site or developer’s site)- Black box
IBMMAINFRAMES.com 23
White Box Testing
Difficulties:
Number of unique logical paths will be very
high.
Such exhaustive testing might still not detect
any errors.
IBMMAINFRAMES.com 24
White Box Testing
Methodologies
Statement coverage
Branch/decision coverage
Condition coverage
Condition/Decision coverage.
Multiple condition coverage.
Data flow coverage.
IBMMAINFRAMES.com 25
Testing throughout the Life Cycle
IBMMAINFRAMES.com 26
This is a simple exercise aimed at introducing
the basic concepts of software testing.
IBMMAINFRAMES.com 27
Identify the document which :
Describes the scope, approach, resources and
schedule of intended activities.
It also identifies
• test items,
• the features to be tested,
• the testing tasks,
• who will do each task and
• any risk requiring contingency planning.
Answer: Test Plan
IBMMAINFRAMES.com 28
Software Test Life Cycle
IBMMAINFRAMES.com 29
Which part of IEEE describes about the Test Plan?
IBMMAINFRAMES.com 30
Following are salient features of which document?
Identifier Introduction
Test Items Features to be
tested
Features NOT to be tested Approach
Item pass/ fail criteria
Suspension criteria & Resumption requirements
Test Deliverables Testing Tasks
Environmental Needs Responsibilities
Staffing and Training needs Schedule
Risks & Contingencies Approvals
IBMMAINFRAMES.com 31
Test plan describes some of the features of the
software that are to be tested. Give examples :
Answer:
•Functionality
•Security
•Efficiency
•Portability
•Recovery
IBMMAINFRAMES.com 32
Test plan describes some of the features of the
software NOT to be tested. Give examples :
Answer:
•Security.
•Particular features of functionality.
•HELP
These are mainly to appraise the testers not
to spend time on these now.
IBMMAINFRAMES.com 33
Test plan describes the Suspension criteria and
resumption requirements. Give examples :
IBMMAINFRAMES.com 34
All failed test cases must contain ___ report
IBMMAINFRAMES.com 35
Some major levels of Testing
• Unit Testing
• Integration testing
• System Testing
• Acceptance Testing
IBMMAINFRAMES.com 36
Unit Testing - Salient Features
Testing done by developers and not
by testing team.
First test to start as soon as the code
is ready.
Logic related problems will be tested.
White Box testing.
IBMMAINFRAMES.com 37
Integration Testing
IBMMAINFRAMES.com 38
Comparison
TOP DOWN BOTTOM UP
Functionality Tested early Functionality tested last
IBMMAINFRAMES.com 39
Sandwich Testing Explained
IBMMAINFRAMES.com 40
System testing is done at client’s place
(True/False)
--------
IBMMAINFRAMES.com 41
Testing that a defect fix has not caused some
Regression test
other errors is called ___________
IBMMAINFRAMES.com 42
System Testing- Summary
IBMMAINFRAMES.com 43
Various tests in system testing
1. Facility Testing 8. Recovery Testing
2. Volume Testing 9. Procedure Testing
3. Load Testing 10. Compatible Testing
4. Stress Testing 11. Installability Testing
5. Usability Testing 12. Serviceability Testing
6. Security Testing 13. Documentation Testing
7. Storage Testing 14. Configuration Testing
IBMMAINFRAMES.com 44
Client complains that Context sensitive Help agreed
has not been provided. Suggest a Test
IBMMAINFRAMES.com 45
_________test
Facility scans the objectives line by line
and compare it with the user manual.
Facility
Missing facilities are identified by _________
test?
IBMMAINFRAMES.com 46
Number of records is the main criteria in
Volume Test.
________
IBMMAINFRAMES.com 47
Which tests are done by creating virtual
users?
IBMMAINFRAMES.com 48
Think Time is used to simulate authentic user
_________
behavior in Load test?
IBMMAINFRAMES.com 49
Test Scenario for Load Test
Users: CEO: 1, GM: 7, Manager: 20, Clerks: 12
So, total legitimate users: 40
Performance Requirements: Say 30 seconds for a query.
IBMMAINFRAMES.com 50
Stress test subjects the application under test to
_______
peak volume of data in a short time.
IBMMAINFRAMES.com 51
Stress Test - Explained
IBMMAINFRAMES.com 52
Usability Test checks for human factor
________
problems?
IBMMAINFRAMES.com 53
Salient features of Usability Test
IBMMAINFRAMES.com 54
Test cases devised to subvert the program’s
Security test
security concerns are written in __________
IBMMAINFRAMES.com 55
Storage test is performed to detect amount of
_________
main and storage requirements of a program.
IBMMAINFRAMES.com 56
Recovery
________ test determines the ability of the
user to recover data after a failure.
IBMMAINFRAMES.com 57
Procedure
_________ test enables the user to do exactly
what the manuals have requested.
IBMMAINFRAMES.com 58
_____________________
Compatible/Conversion test ensures that the
software works with all required optional
software components.
IBMMAINFRAMES.com 59
Checking whether the software favorably
responds to requests like Custom Install,
Installability Test
Partial Install is done by ____________
____________
Installability Test is to be conducted to
ensure that the current version of the software
coexist with the previous version.
IBMMAINFRAMES.com 60
Serviceability Test ensures that the software
____________
automatically goes to the maintenance
module, in case of any error/defect with the
program.
IBMMAINFRAMES.com 62
Configuration
____________ test is to be conducted to find
whether the program works with different
hardware devices with minimum and maximum
configuration.
IBMMAINFRAMES.com 63
Acceptance
__________ test is conducted to determine
whether a software satisfies its acceptance
criteria.
IBMMAINFRAMES.com 64
When a software is developed for more than
one customer, then the software builders use a
Alpha & ________
process called _______ Beta Tests.
IBMMAINFRAMES.com 65
Alpha test is conducted at Developer’s/ Clients
site by Client/Developer. ----------
-------------
IBMMAINFRAMES.com 66
Same product to be used by many clients is
Beta testing.
given to privileged customers for _____
IBMMAINFRAMES.com 67
Beta Testing
Advantages Disadvantages
Many Testers Many testers reporting the
same defect.
Live Environment Potential defects found, but
not escalated.
IBMMAINFRAMES.com 68
Alpha Vs Beta Test
IBMMAINFRAMES.com 69
Test Management
IBMMAINFRAMES.com 70
This is a simple exercise aimed at
introducing the basic concepts of
software Test Management.
IBMMAINFRAMES.com 71
What is Test Management ?
IBMMAINFRAMES.com 72
Why Test Management ?
IBMMAINFRAMES.com 73
How to go about Test Management?
IBMMAINFRAMES.com 74
What is Strategy?
IBMMAINFRAMES.com 75
What is Test Strategy?
IBMMAINFRAMES.com 76
What is Risk?
IBMMAINFRAMES.com 77
Test Strategies
IBMMAINFRAMES.com 78
Testing Strategies
IBMMAINFRAMES.com 79
What are the chances of Error?
IBMMAINFRAMES.com 81
Why to assess Risk and Damages?
IBMMAINFRAMES.com 82
Test Strategies, when there is not enough time.
IBMMAINFRAMES.com 83
What is a Test Plan?
IBMMAINFRAMES.com 84
Test Plan – When to start?
IBMMAINFRAMES.com 85
Measuring Test Effort
IBMMAINFRAMES.com 86
Testing Resources
IBMMAINFRAMES.com 87
Who is responsible for Test Management?
IBMMAINFRAMES.com 88
Test Management Activities
IBMMAINFRAMES.com 89
Test Management Tools
IBMMAINFRAMES.com 90
What is Model based Testing?
a. Manual testing.
b. Static scripts for regression testing.
c. Monkey Testing
- All sorts of Inputs/activities.
- Tests only for robustness of software.
- Does not fully test the functionalities.
d. Model based testing.
IBMMAINFRAMES.com 92
How to verify the Implementation?
IBMMAINFRAMES.com 93
What is achieved by Test Management?
IBMMAINFRAMES.com 94
Test your Testing Skills
IBMMAINFRAMES.com 95
This is a simple exercise aimed at rechecking
the understanding of an individual with respect
to the basic types of software testing.
IBMMAINFRAMES.com 96
By no means comprehensive, an attempt has been
made here, to inculcate various test practices,
methods to students and practitioners of testing, so
that a revisit to the concepts could be made.
IBMMAINFRAMES.com 97
The domain has been deliberately chosen as
Banking, as banking operations, with all the
security features and exposure to a sensitive
and volatile group of clientele, provides the right
breeding ground for errors with embarrassing
consequences.
IBMMAINFRAMES.com 98
While an innocent error could pass as a defect
due to negligence, the same error runs the risk
of being viewed from the vigilance angle also
and thus requires the best of testing minds.
IBMMAINFRAMES.com 99
People’s Bank of India (PBI) is a commercial Bank
giving varied services to the customers both at India
and abroad.
Their services include:
• Fixed Deposits
• Loans & Advances.
• Savings Account.
• Current Account.
IBMMAINFRAMES.com 100
• Demand Drafts, Mail Transfers.
• Clearing of local and outstation cheques.
Their auxiliary services include:
- Safe Deposit Lockers
- Standing Instructions
- Money Transfers
IBMMAINFRAMES.com 101
You are in the team , which develops the Savings
Bank (called SB) module of Banking operations.
IBMMAINFRAMES.com 102
Other modules under preparation are Current
Account, Loans and Deposits.
As a Software Test professional, please
provide the solution that you feel would be
appropriate for the following questions.
IBMMAINFRAMES.com 103
Q-1: Your Test Manager asks you to test the
functionality of the Current account module
developed by others. What type of test will you be
undertaking, White box or Black box?
IBMMAINFRAMES.com 104
Q-2: You were asked to test a particular loop in
the code written for Savings Bank Transactions.
What type of test will you be undertaking, Black
box or White Box?
IBMMAINFRAMES.com 105
Q-3. For availing Cheque book facility, a customer
must maintain a minimum balance of Rs. 5000/. In
the black box testing, which of the optimization
technique will you use to check?
IBMMAINFRAMES.com 106
Q-4: In the Cheque book maintenance problem
referred above, the program works well for test
values of 1, 2500 and 5000 but not for a value of
5001. Which particular range of the Boundary
value analysis is throwing the error here?
Answer: Epsilon
point.
IBMMAINFRAMES.com 107
Q-5: After fixing the problem of Cheque books, that
particular path works well, but a hitherto unknown
problem has crept in suddenly. After the new defect
is fixed, will you be testing all other paths with
respect to this module or only that particular path
which was giving error?
IBMMAINFRAMES.com 108
Q-6: If you choose to test all paths after the above
mentioned defect fix, what type of testing will you
be undertaking?
Answer:Regression Test.
IBMMAINFRAMES.com 109
Q-7: After the SB module has been tested and handed
over, the client complains that a provision called “Stop
Cheques” already discussed and agreed in the
Software Requirement Specification (SRS) has not
been provided. Which test, if done, could have avoided
this feedback from the customer.
IBMMAINFRAMES.com 110
Q-8: The knowledgeable client asks you to
conduct all software tests and then hand over
the product. Will you agree?
IBMMAINFRAMES.com 111
Q-9: Customer complains that while accessing the
Cheque book module from SB transactions, errors
are thrown. But, Transaction module and Cheque
book maintenance are working fine individually.
Can you identify the problem as to which test
could solve this?
Answer:Volume Test.
IBMMAINFRAMES.com 113
Q-11: In the above situation, if the client feels
that Time is a criterion, which test is to be
conducted?
IBMMAINFRAMES.com 114
Q-12: The client requires that if the transactions are
22 at a time against the stipulated 20, the first 20
transactions must run smoothly and a report must
be generated about the excess of 2 transactions
and that the system should not crash. Which test is
to be conducted?
IBMMAINFRAMES.com 115
Q-13: At the end of each working day, Banks indulge
in a process called “Day End Operations”, wherein all
reports (normal, exceptional, seasonal) will be
generated, backup of day’s transactions will be taken
and the date has to smoothly roll over to the next
working day. Client complains that during Backup of
Data at the end of the day, the screen goes blank
leaving them guessing whether the intended
operations are being performed or not. Suggest a
solution.
Answer: Conduct Usability test. Give a Progress
bar or a message saying, “Backup under progress.
Please wait”.
IBMMAINFRAMES.com 116
Q-14: Client complains that ” During long
operations such as Day End activities, when
backup of data and reports are taken, there is no
provision to abort the operation. Suggest a test to
redress the grievance.
IBMMAINFRAMES.com 119
Q-17: There is a complaint from the client that while
the software has been working fine for the first week
of the month, thereafter, a message comes about
“Insufficient Disk space”. They have also recalled
that the same error happened during the first week
of previous month also and that a software engineer
(who has since left the services) fixed it. Identify the
defect and suggest remedy .
IBMMAINFRAMES.com 120
Answer: Obviously, during the first week of any
month, the transactions are heavy but the system
was successfully passing the stress test. Where it
fails is with respect to the Storage test. The reference
to last month’s operation has to be viewed in the
context that, the particular software engineer would
have dumped data and created some free disk
space, which must be done as a systematic
procedure during every month end.
IBMMAINFRAMES.com 121
Q-18: The SB package has been so designed that
any transaction will be successful only after the
transaction Log is printed, giving all details about
the transaction carried out. There have been
frequent complaints that Run time error occurs
whenever the printer is not ready and an update
command is given. Which test will take care of this
situation?
IBMMAINFRAMES.com 123
Q-20: The banking software was running smoothly
till an external “Address Book” package was bought
by the client and installed at the same server /
machine. Which test could have precluded this
problem?
Answer: Compatibility
Test.
IBMMAINFRAMES.com 124
Q-21: While the previous version was working
fine, an updated version of the SB module was
not working properly. Suggest a Test.
IBMMAINFRAMES.com 125
Q-22: Certain modules are behaving in a different
way from the examples given in the user manuals
and documentation. Suggest a Test.
IBMMAINFRAMES.com 126
Q-23: The client was planning to go for a Pentium
IV with 60 GB hard disk and 256 Mb RAM, at the
time of placement of the order and the software
development is proceeding under that assumption.
Client now asks whether he can go for a PIII with 20
GB hard disk and 64 Mb RAM? Which test should
the software pass to accede to this request?
IBMMAINFRAMES.com 127
Q-24: In the menu driven SB module, screens are
displayed in a haphazard manner. For example, if
you click on the Transaction option, the Report
screen is displayed and Cheque Book
Maintenance leads to the Transaction screen.
Which test will the software be failing?
IBMMAINFRAMES.com 128
Q-25: You have completed all the modules in SB
and want the customers’ feedback. Since, banking
is a general product, you may like more than one
Banker to look into that and get back to you, so
that depending on the feedback you expect to
improve on the performance of the product. Is it a
test and if so what is this particular test called?
IBMMAINFRAMES.com 129
Q-26: You invite the customer to your site and
test the product, before it is released. What
types of test are trying to do?
IBMMAINFRAMES.com 130
Copyright: IBMMAINFRAMES.com
IBMMAINFRAMES.com 131