After the execution of a test script the textual and graphical execution reports are created.
The textual report is generated as a file with .xls extension saved in the current folder; the concise version of the report is also presented on the Report->Report tab.
Let us examine a typical execution report. Henceforward all comments and explanations are in bold:
Report generated by Web Roller v3.5 build 939 |
|||||
Test started at:Sun Mar 31 20:41:26 2002 |
|||||
Test finished at:Sun Mar 31 20:41:26 2002 |
|||||
Project name: Test project |
Project name (Projectname setting) |
||||
Description: Test |
Project desctription (Description parameter) |
||||
Server name: kort |
Server tested (Server parameter) |
||||
Clients: 3 |
Number of virtual clients |
||||
Requests: 5 |
Number of [TestSeq] runs |
||||
Test executed by: Igor |
User name |
||||
Test executed at: kort |
Workstation name |
||||
Clnt/Rqst Req1 Req2 Date and time of request execution (if timestamp=1) |
|||||
C00R00000 5.07 51.06 2002/03/31 20:41:26 2002/03/31 20:41:26 |
C00R00000 – Client0, Request0. First run of [TestSeq] by virtual client #1, processing times for each request from [TestSeq] are listed in milliseconds. |
||||
C00R00001 0.22 125.02 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C00R00002 61.18 89.67 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C00R00003 42.41 112.37 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C00R00004 6.81 69.35 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C01R00000 4.57 89.27 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C01R00001 32.19 90.65 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C01R00002 22.72 79.29 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C01R00003 41.30 114.60 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C01R00004 26.73 81.37 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C02R00000 16.14 68.92 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C02R00001 6.52 80.96 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C02R00002 29.99 99.36 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C02R00003 26.81 61.01 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
C02R00004 18.99 62.73 2002/03/31 20:41:26 2002/03/31 20:41:26 |
|||||
--- Basic statistics --- |
Minimum, average and maximum processing times for each of HTTP requests (Req1, Req2) - milliseconds. |
||||
Min: 0.22 51.06 |
|||||
Avg: 22.78 85.04 |
|||||
Max: 61.18 125.02 |
|||||
--- Network traffic details --- |
|||||
Total bytes sent : 2604 |
Total amount of data sent and received. |
||||
Total bytes received : 25320 |
|||||
--- Summary times --- |
|||||
Virtual Clients statistics: |
Virtual clients statistics: Count – amount of HTTP requests sent; Time – virtual client operation time; AR/S – average amount of HTTP requests per second; AT/R – average time of HTTP request processing. |
||||
Count Time AR/S AT/R |
|||||
10 601 16.64 60.10 |
|||||
10 601 16.64 60.10 |
|||||
10 500 20.00 50.00 |
|||||
Total work time: 631 |
Script operation time |
||||
Total requests made: 30 |
Total amount of HTTP requests made by all virtual clients |
||||
Total average time per request: 21.0333 |
Average HTTP request processing time (using all requests) |
||||
Total average requests per second: 47.5436 |
Average amount of HTTP requests per second |
||||
WARNING: approximation used! |
The warning is displayed if the overall time of the test script operation is lower than required for precise measurement (and calculation) of the “Total average time per request “ and “Total average requests per second” values. In this case the results will be approximated. |
||||
Not enough requests per client for exact timing! |
|||||
--- HTTP response codes details --- |
Statistics on HTTP response codes: |
||||
Code Count |
|||||
200 30 |
If scripting is used, the textual execution report is simplified. Execution of the script below:
[General]
project=Test Project
Description=test
script=$inline.pl
requests=3
clients=2
[script]
$wapt->AddRequest("test1","http://myserver/");
$wapt->AddRequest("test2","http://myserver/");
for($i=0;$i<$wapt->GetOpt("requests");$i++){
$wapt->Request("test1");
$wapt->Request("test2");
}
[/script]
will result in the following report:
Report generated by Web Roller v3.5 build 957 |
|
Test started at:Fri Apr 19 16:28:42 2002 |
|
Test finished at:Fri Apr 19 16:28:43 2002 |
|
Project name: Test Project |
Project name (Projectname setting) |
Description: Test |
Project desctription (Description parameter) |
Server name: myserver |
Server tested (Server parameter) |
Clients: 2 |
Number of virtual clients |
Requests: 3 |
Number of [TestSeq] runs |
Test executed by: Igor |
Computer user name |
Test executed at: Kort |
Computer workstation name |
--- Client 0 --- |
Statistics on processed requests for virtual client “Client 0” |
test1 09.20 |
|
test2 12.10 |
|
test1 11.60 |
|
test2 09.70 |
|
test1 12.10 |
|
test2 11.60 |
|
--- Client 1 --- |
Statistics on processed requests for virtual client “Client 1” |
test1 09.20 |
|
test2 12.10 |
|
test1 11.60 |
|
test2 09.70 |
|
test1 12.10 |
|
test2 11.60 |
|
--- HTTP response codes details --- |
Statistics on HTTP response codes: |
Code Count |
|
200 12 |
If in the [General] section Log=1, all the results of operation are logged to a file. Each virtual client generates a separate log file. The complete log of the Web Roller client operation is written to this file. This includes all requests, responses, redirects and the HTML code returned.
A test script like this:
[General]
clients=1
requests=2
server=kort
log=1
[TestSeq]
Req1
Req2
[Req1]
$uri=/
$method=GET
[Req2]
$uri=/view.pl
$method=GET
will result in the following log file:
----- [TestSeq]: Req1(0) ----- |
Separator line: pass #0 of [TestSeq], request Req1 |
Request: |
Header of the HTTP request sent |
GET / HTTP/1.1 |
|
Host: kort |
|
Connection: close |
|
Response: |
Header of the server response. |
HTTP/1.1 200 OK |
|
Date: Sun, 21 Apr 2002 16:30:45 GMT |
|
Server: Apache/1.3.12 (Win32) |
|
Connection: close |
|
Transfer-Encoding: chunked |
|
Content-Type: text/html |
|
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> |
HTML code of response |
<html> |
|
</body> |
|
.. |
|
.. |
|
</body> |
|
</html> |
|
----- [TestSeq]: Req2 (0) ----- |
Separator line: pass #0 of [TestSeq], request Req2 |
Request: |
|
GET /view.pl HTTP/1.1 |
|
Host: kort |
|
Referrer: http://kort/ |
|
Connection: close |
|
Response: |
|
HTTP/1.1 200 OK |
|
Date: Sun, 21 Apr 2002 16:30:45 GMT |
|
Server: Apache/1.3.12 (Win32) |
|
Connection: close |
|
Transfer-Encoding: chunked |
|
Content-Type: text/plain |
|
<html> |
|
</body> |
|
.. |
|
.. |
|
</body> |
|
</html> |
|
----- [TestSeq]: Req1(1) ----- |
Separator line: pass #1 of [TestSeq], request Req1 |
Request: |
|
GET / HTTP/1.1 |
|
Host: kort |
|
Referrer: http://kort/view.pl |
|
Connection: close |
|
Response: |
|
HTTP/1.1 200 OK |
|
Date: Sun, 21 Apr 2002 16:30:45 GMT |
|
Server: Apache/1.3.12 (Win32) |
|
Connection: close |
|
Transfer-Encoding: chunked |
|
Content-Type: text/html |
|
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN"> |
|
<html> |
|
</body> |
|
.. |
|
.. |
|
</body> |
|
</html> |
|
----- [TestSeq]: Req2(1) ----- |
Separator line: pass #1 of [TestSeq], request Req2 |
Request: |
|
GET /view.pl HTTP/1.1 |
|
Host: kort |
|
Referrer: http://kort/ |
|
Connection: close |
|
Response: |
|
HTTP/1.1 200 OK |
|
Date: Sun, 21 Apr 2002 16:30:45 GMT |
|
Server: Apache/1.3.12 (Win32) |
|
Connection: close |
|
Transfer-Encoding: chunked |
|
Content-Type: text/plain |
|
<html> |
|
</body> |
|
.. |
|
.. |
|
</body> |
|
</html> |