Sunday 13 April 2014

Automation Testing Questionnaire

1 What is your requirement/expectation from Functional Testing Automation? 
2 What percentage of the regression suite do you expect to get automated?
3 What is lacking in the present manual testing process you wish to complement/improve through functional testing automation?(highlight business expectation - for regression scenarios, expected business benefits)
4 What is the frequency of change of business rules of the Application (number of change requests/week or month)?
5 What is the frequency of change of UI of the Application (number of change requests/week or month)?
6 Do you have a manual regression test suite? If Yes:
a. What percentage of application functionality does it cover?
b. How many test cases are there?
c. How well described are the cases? Can a tester having no knowledge of your application execute these cases?
d. How long does it take to run 1 full cycle in terms of person days(8 hrs a day)?
e. Where are the test cases stored? (HPQC or equivalent test management tool, Word or Excel)
f. Can you share a sample test case suite with us?
7 How do you set the test environment? 
8 What are the requirements in terms of Hardware and Software? 
9 Where is the application hosted?
10 How will we access the application? (Over the internet, via a VPN connection, Via a citrix connection, installed locally)
11 Technology / Protocol
12 Any data encryption and / or compression while submitting request
13 Describe Application / Product functionality
14 Number of scenarios and/or transactions to be tested
15 No of Modules
16 Scripts per Module
17 No of Scenarios
18 Low Complexity
19 Medium Complexity
20 High Complexity
21 Any interfaces with external applications to be automated? Give details
22 Document upload / download?
23 Similar testing activities done in the past by any vendor, if so, describe problem statement and solution provided
24 Do you already have tools to support this? Do you have a prefered tool and if yes will you provide licenses?
25 Application Server(highlight RAM, service pack, patch etc)
26 Database Server(highlight RAM, service pack, patch etc)
27 Web Server(highlight RAM, service pack, patch etc)
28 Type of Web server
29 Type of Application server & Version (summarize deployment architecture)
30 Type of Database & Version(summarize deployment architecture)
31 Test Environment setup
- Do you have dedicated test environment hosted on separate LAN network
OR
- Is application available in hosted data center 
32 Any specific information to be captured in Test Report
33 Is application hosted on intranet or internet / Cloud? In case of Internet, pl state the network bandwidth

3 comments: