Total Articles 7,215
2011.07.26 15:23:40
8581
Questions to start writing Performance Test Strategy & PlanTable of Contents
1 INTRODUCTION TO SOFTWARE 7
1.1 EVOLUTION OF THE SOFTWARE TESTING DISCIPLINE 7
1.2 THE TESTING PROCESS AND THE SOFTWARE TESTING LIFE CYCLE 7
1.3 BROAD CATEGORIES OF TESTING 8
1.4 WIDELY EMPLOYED TYPES OF TESTING 8
1.5 THE TESTING TECHNIQUES 9
1.6 CHAPTER SUMMARY 9
2 BLACK BOX AND WHITE BOX TESTING 11
2.1 INTRODUCTION 11
2.2 BLACK BOX TESTING 11
2.3 TESTING STRATEGIES/TECHNIQUES 13
2.4 BLACK BOX TESTING METHODS 14
2.5 BLACK BOX (VS) WHITE BOX 16
2.6 WHITE BOX TESTING 18
3 GUI TESTING 23
3.1 SECTION 1 - WINDOWS COMPLIANCE TESTING 23
3.2 SECTION 2 - SCREEN VALIDATION CHECKLIST 25
3.3 SPECIFIC FIELD TESTS 29
3.4 VALIDATION TESTING - STANDARD ACTIONS 30
4 REGRESSION TESTING 33
4.1 WHAT IS REGRESSION TESTING 33
4.2 TEST EXECUTION 34
4.3 CHANGE REQUEST 35
4.4 BUG TRACKING 35
4.5 TRACEABILITY MATRIX 36
5 PHASES OF TESTING 39
5.1 INTRODUCTION 39
5.2 TYPES AND PHASES OF TESTING 39
5.3 THE “V”MODEL 40
6 INTEGRATION TESTING 43
6.1 GENERALIZATION OF MODULE TESTING CRITERIA 44
7 ACCEPTANCE TESTING 49
7.1 INTRODUCTION – ACCEPTANCE TESTING 49
7.2 FACTORS INFLUENCING ACCEPTANCE TESTING 49
7.3 CONCLUSION 50
8 SYSTEM TESTING 51
8.1 INTRODUCTION TO SYSTEM TESTING 51
8.2 NEED FOR SYSTEM TESTING 51
8.3 SYSTEM TESTING TECHNIQUES 52
8.4 FUNCTIONAL TECHNIQUES 53
8.5 CONCLUSION: 53
9 UNIT TESTING 54
9.1 INTRODUCTION TO UNIT TESTING 54
9.2 UNIT TESTING –FLOW: 55
UNIT TESTING – BLACK BOX APPROACH 56
UNIT TESTING – WHITE BOX APPROACH 56
UNIT TESTING – FIELD LEVEL CHECKS 56
UNIT TESTING – FIELD LEVEL VALIDATIONS 56
UNIT TESTING – USER INTERFACE CHECKS 56
9.3 EXECUTION OF UNIT TESTS 57
UNIT TESTING FLOW : 57
DISADVANTAGE OF UNIT TESTING 59
METHOD FOR STATEMENT COVERAGE 59
RACE COVERAGE 60
9.4 CONCLUSION 60
10 TEST STRATEGY 62
10.1 INTRODUCTION 62
10.2 KEY ELEMENTS OF TEST MANAGEMENT: 62
10.3 TEST STRATEGY FLOW : 63
10.4 GENERAL TESTING STRATEGIES 65
10.5 NEED FOR TEST STRATEGY 65
10.6 DEVELOPING A TEST STRATEGY 66
10.7 CONCLUSION: 66
11 TEST PLAN 67
11.1 WHAT IS A TEST PLAN? 67
CONTENTS OF A TEST PLAN 67
11.2 CONTENTS (IN DETAIL) 67
12 TEST DATA PREPARATION - INTRODUCTION 70
12.1 CRITERIA FOR TEST DATA COLLECTION 71
12.2 CLASSIFICATION OF TEST DATA TYPES 78
12.3 ORGANIZING THE DATA 79
12.4 DATA LOAD AND DATA MAINTENANCE 81
12.5 TESTING THE DATA 82
12.6 CONCLUSION 83
13 TEST LOGS - INTRODUCTION 84
13.1 FACTORS DEFINING THE TEST LOG GENERATION 84
13.2 COLLECTING STATUS DATA 85
14 TEST REPORT 91
14.1 EXECUTIVE SUMMARY 91
15 DEFECT MANAGEMENT 94
15.1 DEFECT 94
15.2 DEFECT FUNDAMENTALS 94
15.3 DEFECT TRACKING 95
15.4 DEFECT CLASSIFICATION 96
15.5 DEFECT REPORTING GUIDELINES 97
16 AUTOMATION 100
16.1 WHY AUTOMATE THE TESTING PROCESS? 100
16.2 AUTOMATION LIFE CYCLE 102
16.3 PREPARING THE TEST ENVIRONMENT 104
16.4 AUTOMATION METHODS 107
17 GENERAL AUTOMATION TOOL COMPARISON 110
17.1 FUNCTIONAL TEST TOOL MATRIX 110
17.2 RECORD AND PLAYBACK 110
17.3 WEB TESTING 111
17.4 DATABASE TESTS 111
17.5 DATA FUNCTIONS 111
17.6 OBJECT MAPPING 112
17.7 IMAGE TESTING 113
17.8 TEST/ERROR RECOVERY 113
17.9 OBJECT NAME MAP 113
17.10 OBJECT IDENTITY TOOL 114
17.11 EXTENSIBLE LANGUAGE 114
17.12 ENVIRONMENT SUPPORT 115
17.13 INTEGRATION 115
17.14 COST 115
17.15 EASE OF USE 116
17.16 SUPPORT 116
17.17 OBJECT TESTS 116
17.18 MATRIX 117
17.19 MATRIX SCORE 117
18 SAMPLE TEST AUTOMATION TOOL 118
18.1 RATIONAL SUITE OF TOOLS 118
18.2 RATIONAL ADMINISTRATOR 119
18.3 RATIONAL ROBOT 123
18.4 ROBOT LOGIN WINDOW 124
18.5 RATIONAL ROBOT MAIN WINDOW-GUI SCRIPT 125
18.6 RECORD AND PLAYBACK OPTIONS 126
18.7 VERIFICATION POINTS 128
18.8 ABOUT SQABASIC HEADER FILES 130
18.9 ADDING DECLARATIONS TO THE GLOBAL HEADER FILE 130
18.10 INSERTING A COMMENT INTO A GUI SCRIPT: 130
18.11 ABOUT DATA POOLS 131
18.12 DEBUG MENU 131
18.13 COMPILING THE SCRIPT 132
18.14 COMPILATION ERRORS 133
19 RATIONAL TEST MANAGER 135
19.1 TEST MANAGER-RESULTS SCREEN 136
20 SUPPORTED ENVIRONMENTS 138
20.1 OPERATING SYSTEM 138
20.2 PROTOCOLS 138
20.3 WEB BROWSERS 138
20.4 MARKUP LANGUAGES 138
20.5 DEVELOPMENT ENVIRONMENTS 138
21 PERFORMANCE TESTING 139
21.1 WHAT IS PERFORMANCE TESTING? 139
21.2 WHY PERFORMANCE TESTING? 139
21.3 PERFORMANCE TESTING OBJECTIVES 140
21.4 PRE-REQUISITES FOR PERFORMANCE TESTING 140
21.5 PERFORMANCE REQUIREMENTS 141
22 PERFORMANCE TESTING PROCESS 142
22.1 PHASE 1 – REQUIREMENTS STUDY 143
22.2 PHASE 2 – TEST PLAN 144
22.3 PHASE 3 – TEST DESIGN 144
22.4 PHASE 4 –SCRIPTING 145
22.5 PHASE 5 – TEST EXECUTION 146
22.6 PHASE 6 – TEST ANALYSIS 146
22.7 PHASE 7 – PREPARATION OF REPORTS 147
22.8 COMMON MISTAKES IN PERFORMANCE TESTING 148
22.9 BENCHMARKING LESSONS 148
23 TOOLS 150
23.1 LOADRUNNER 6.5 150
23.2 WEBLOAD 4.5 150
23.3 ARCHITECTURE BENCHMARKING 157
23.4 GENERAL TESTS 158
24 PERFORMANCE METRICS 159
24.1 CLIENT SIDE STATISTICS 159
24.2 SERVER SIDE STATISTICS 160
24.3 NETWORK STATISTICS 160
24.4 CONCLUSION 160
25 LOAD TESTING 162
25.1 WHY IS LOAD TESTING IMPORTANT ? 162
25.2 WHEN SHOULD LOAD TESTING BE DONE? 162
26 LOAD TESTING PROCESS 163
26.1 SYSTEM ANALYSIS 163
26.2 USER SCRIPTS 163
26.3 SETTINGS 163
26.4 PERFORMANCE MONITORING 164
26.5 ANALYZING RESULTS 164
26.6 CONCLUSION 164
27 STRESS TESTING 166
27.1 INTRODUCTION TO STRESS TESTING 166
27.2 BACKGROUND TO AUTOMATED STRESS TESTING 167
27.3 AUTOMATED STRESS TESTING IMPLEMENTATION 169
27.4 PROGRAMMABLE INTERFACES 169
27.5 GRAPHICAL USER INTERFACES 170
27.6 DATA FLOW DIAGRAM 170
27.7 TECHNIQUES USED TO ISOLATE DEFECTS 171
28 TEST CASE COVERAGE 173
28.1 TEST COVERAGE 173
28.2 TEST COVERAGE MEASURES 173
28.3 PROCEDURE-LEVEL TEST COVERAGE 174
28.4 LINE-LEVEL TEST COVERAGE 174
28.5 CONDITION COVERAGE AND OTHER MEASURES 174
28.6 HOW TEST COVERAGE TOOLS WORK 174
28.7 TEST COVERAGE TOOLS AT A GLANCE 176
29 TEST CASE POINTS-TCP 177
29.1 WHAT IS A TEST CASE POINT (TCP) 177
29.2 CALCULATING THE TEST CASE POINTS: 177
29.3 CHAPTER SUMMARY 179
Milan Patel
Sr. Quality Assurance Engineer

 
 




chako
sgarg


good doc