Running App Test and Viewing Results

Once the test is recorded it can be saved without replaying just after the recording is over. The recorded test or any recorded and replayed test that has been saved can be replayed again and the reports generated can be analyzed. Following are the details on how a recorded test is replayed.

Overview:

Replaying a Test

You can replay just-recorded tests as well as saved tests. To replay a saved test, first open it in App Test.

• Toolbar:You can replay a test by clicking the Start button from the toolbar..
• Menu option: From the menu bar you can replay a test like this: Project -> Run

When you replay a test, the target application is launched. When the replay has started it shows Replaying in progress and shows Reports Ready when the replay is over in the right corner of the status bar. The progress of the test replay can be viewed in the status bar as well.

While the test is replaying, you can pause it for a while by clicking Pause. You can stop the test anytime while replaying by clicking Stop..

When there are multiple groups in the test, there are a few things to note:

• All groups will be replayed by default.
• You can choose to 'Ignore' a group by selecting the 'Ignore Group' checkbox.
• You can override the 'Ignore Group' setting by selecting 'Run Selected' from the Project menu item.
• If you ignore all the groups in your project, you will get a message asking you to select at least one group to replay.

Viewing Test Results

In the App Test project area you can see the progress of replaying the test through the test tree. Each node in the test tree is visited as and when that particular Window is visited or a particular event is replayed. Once the replay is over, the results can be seen in the Results tab on the navigation frame.

The Results tab shows the results tree. The frame on the right-hand side will show the result at a:

• Project level: You can see the Project Summary which is an overall result for the project including results of all the Iterations.
  • Machine level: In case you are executing test on multiple machines simultaneously then you can see summary of execution of project on each machine. When running test on single machine application shows machine as localhost.
    • Iteration level: You can see the Iteration Summary which shows the results for the selected Iteration within the project.
      • Group level: You can see the Group Summary which shows the results for the selected Group within an Iteration.
        • Window level : This is the result for the selected window within the selected group and iteration.
          • Event level: This is the result for the selected Event.

Project Summary

Project Summary shows the overall results of the test. The Details frame on the right hand side is divided into two sections:

1. Machine Summary: This section graphically represents the status of all the Machines on which the project was executed. A table also shows the same status data in a table, which is used to draw the pie-chart.
2. Machine Replay Status Table: This section shows details of the Machines. All the Machines on which the project has run, are shown in this table along with their status (whether failed or succeeded or Not Played or Stopped) and the Machine names are hyperlinked to the details of that Machine.

Machine Summary

Machine Summary shows the overall results of execution of test on single machine. The right hand side frame shows following :

1. Iteration Summary: This section graphically represents the status of all the Iterations for which the project has run. A table also shows the same status data in a table, which is used to draw the pie-chart.
2. Iteration Replay Status Table: This section shows details of the Iterations. All the Iterations for which the project has run, are shown in this table along with their status (whether failed or succeeded or Not Played or Stopped) and the Iteration names are hyperlinked to the details of that Iteration.

Iteration Summary

The Iteration Summary shows results for that iteration in terms of the success or failure status of the groups replayed within the iteration. There are two sections in the Details Frame:

1. Group Summary: A pie chart shows the success or failure status of Groups in the selected Iteration. A table accompanies the pie chart.
2. Group Replay Status Table: This table lists the groups in the iteration. You can click a group name to view its detailed status - the Group Summary.

Group Summary

The Group Summary shows results for the selected Group. There are two sections in the Details Frame:

1. Windows Summary: A pie chart shows the success or failure status of Windows in the selected Group for selected Iteration. A table accompanies the pie chart.
2. Window/Event Replay Status table: This table lists the Events with their status. You can click a Event Title to access its details.

Window Summary

You can see three sections in the panel on the right hand side:

1. Event Replay Status table: This table lists the Events with their status. You can click a Event Title to access its details.
2. Component Validations: This table shows the validations added for components for the selected window.
3. Window Image: This section shows the window image captured during replaying.

Event Results

You can see following sections in the panel on the right hand side:

Status

This Result shows details of the Event that was replayed including its status - successful or failed and reason for failure if failed.

Event Image

This section shows the element image captured during replaying.