Running a Web Test and Viewing Results

Once the test is recorded it can be replayed and the reports can be generated for analysis. Following are the details on how a recorded test is replayed.

Overview:

Replaying a Test

You can replay test using one of the following option:

• Toolbar:Clicking the Start button from the toolbar..
• Menu option: Selecting Project -> Run from menubar.

When you replay a test, application launches the default browser configured at Tools -> Options...-> Browsers, JDKs & DBs and first recorded URL is fired. The progress of the Web Test can be seen in the Status tab where the currently executing URL/Event is highlighted. Application replays each step in the browser in the sequence it was recorded.

While the test is replaying, you can pause it for a while by clicking Pause. You can stop the test anytime while replaying by clicking Stop button..

When there are multiple groups in the test, there are a few things to note:

• All groups will be replayed by default.
• You can choose to 'Ignore' a group by selecting the 'Ignore Group' checkbox.
• You can run only the selected group by selecting 'Run Selected' from the Project menu option.

Once the test completes replaying, results of the execution can be seen in the Results tab.

Viewing Test Results

In the Web Test Status tab you can see the progress of replaying of the test through the test tree. Each node in the test tree is visited as and when that particular URL is visited or a particular event is replayed. Once the replay is over, the results can be seen in the Results tab on the navigation frame.

The Results tab shows the results tree. The frame on the right-hand side will show the result at a:

• Project level: You can see the Project Summary which is an overall result for the project including a combined view of all the machines on which test is executed.
  • Machine level: In case you are executing test on multiple machines simultaneously then you can see summary of execution of project on each machine. When running test on single machine application shows machine as localhost.
    • Iteration level: You can see the Iteration Summary which shows the results for the selected Iteration within the project.
      • Group level: You can see the Group Summary which shows the results for the selected Group within an Iteration.
        • Browser level: This is the result for the selected Browser within the selected Group within an Iteration.
          • URL level : This is the result for the selected URL within the selected Browser .. group and iteration.
            • Event level: This is the result for the selected Event.

Project Summary

Project Summary shows the overall results of the test. The right hand side frame shows following :

1. Machine Summary: This section graphically represents the status of all the Machines on which the project was executed. A table also shows the same status data in a table, which is used to draw the pie-chart.
2. Machine Replay Status Table: This section shows details of the Machines. All the Machines on which the project has run, are shown in this table along with their status (whether failed or succeeded or Not Played or Stopped) and the Machine names are hyperlinked to the details of that Machine.

Machine Summary

Machine Summary shows the overall results of execution of test on single machine. The right hand side frame shows following :

1. Iteration Summary: This section graphically represents the status of all the Iterations for which the project has run. A table also shows the same status data in a table, which is used to draw the pie-chart.
2. Iteration Replay Status Table: This section shows details of the Iterations. All the Iterations for which the project has run, are shown in this table along with their status (whether failed or succeeded or Not Played or Stopped) and the Iteration names are hyperlinked to the details of that Iteration.

Iteration Summary

The Iteration Summary shows results for that iteration in terms of the success or failure status of the groups replayed within the iteration. The right hand side frame shows following:

1. Group Summary: A pie chart shows the success or failure status of Groups in the selected Iteration. A table accompanies the pie chart.
2. Group Replay Status Table: This table lists the groups in the iteration. You can click a group name to view its detailed status - the Group Summary.

Group Summary

The Group Summary shows results for the selected Group. The right hand side frame shows following:

1. Group Summary: This section has two pie charts. The URL chart shows the status of the URLs replayed in this group and the Events Chart shows the status of the Events within the URLs of this group.
2. Browser Replay Status table: This table lists the Browsers with their status. You can click a browser Title to access its details - the Browser Summary.

Browser Summary

The Browser Summary shows results for the selected Browser. The right hand side frame shows following:

1. URL Replay Status table: This table lists the URLs with their status. You can click a URL Title to access its details - the URL results.
2. Web Browser Control: This control shows the page loaded in browser during replaying

URL Summary

The URL Summary shows results for the selected URL. The right hand side frame shows following tabs:

1. Status tab: This tab shows details of the URL that was replayed including its Start and End time, its status - successful or failed and reason for failure if failed.
2. URL_Event tab: This tab lists all the Events/Subframes under the URL with status for each. You can click the event/subframe to see its details.
3. Validations tab: If you have validations configured for this URL, you can see the results of the same here. This view will show the validation tree for each type of validation along with the status (Successful or Failed). In case of failed validations you can click on individual Page/Element/Text/Date Validation etc to check its further details.
4. Web Browser Control: The web control at bottom shows the page saved during replaying

Event Summary

The Event Summary shows results for the selected event. The right hand side frame shows following:

1. Status tab: This tab shows details of the Event that was replayed including its status - successful or failed and reason for failure if failed.
2. Web Browser Control: The web control at bottom shows the page saved during replaying