Testing results and assessment

After the execution of a test script the textual and graphical execution reports are created.


Execution report

The textual report is generated as a file with .xls extension saved in the current folder; the concise version of the report is also presented on the Report->Report tab.

Let us examine a typical execution report. Henceforward all comments and explanations are in bold:

Report generated by Web Roller v3.5 build 939

 
   

Test started at:Sun Mar 31 20:41:26 2002

 

Test finished at:Sun Mar 31 20:41:26 2002

 

Project name: Test project

Project name (Projectname setting)

Description: Test

Project desctription (Description parameter)

Server name: kort

Server tested (Server parameter)

Clients: 3

Number of virtual clients

Requests: 5

Number of [TestSeq] runs

Test executed by: Igor

User name

Test executed at: kort

Workstation name

   

Clnt/Rqst Req1 Req2 Date and time of request execution (if timestamp=1)

C00R00000 5.07 51.06 2002/03/31 20:41:26 2002/03/31 20:41:26

C00R00000 – Client0, Request0. First run of [TestSeq] by virtual client #1, processing times for each request from [TestSeq] are listed in milliseconds.

C00R00001 0.22 125.02 2002/03/31 20:41:26 2002/03/31 20:41:26

C00R00002 61.18 89.67 2002/03/31 20:41:26 2002/03/31 20:41:26

C00R00003 42.41 112.37 2002/03/31 20:41:26 2002/03/31 20:41:26

C00R00004 6.81 69.35 2002/03/31 20:41:26 2002/03/31 20:41:26

C01R00000 4.57 89.27 2002/03/31 20:41:26 2002/03/31 20:41:26

C01R00001 32.19 90.65 2002/03/31 20:41:26 2002/03/31 20:41:26

C01R00002 22.72 79.29 2002/03/31 20:41:26 2002/03/31 20:41:26

C01R00003 41.30 114.60 2002/03/31 20:41:26 2002/03/31 20:41:26

C01R00004 26.73 81.37 2002/03/31 20:41:26 2002/03/31 20:41:26

C02R00000 16.14 68.92 2002/03/31 20:41:26 2002/03/31 20:41:26

C02R00001 6.52 80.96 2002/03/31 20:41:26 2002/03/31 20:41:26

C02R00002 29.99 99.36 2002/03/31 20:41:26 2002/03/31 20:41:26

C02R00003 26.81 61.01 2002/03/31 20:41:26 2002/03/31 20:41:26

C02R00004 18.99 62.73 2002/03/31 20:41:26 2002/03/31 20:41:26

   

--- Basic statistics ---

Minimum, average and maximum processing times for each of HTTP requests (Req1, Req2) - milliseconds.

 

Min: 0.22 51.06

Avg: 22.78 85.04

Max: 61.18 125.02

   

--- Network traffic details ---

 
   

Total bytes sent : 2604

Total amount of data sent and received.

Total bytes received : 25320

--- Summary times ---

 
   

Virtual Clients statistics:

Virtual clients statistics:

Count – amount of HTTP requests sent;

Time – virtual client operation time;

AR/S – average amount of HTTP requests per second;

AT/R – average time of HTTP request processing.

Count Time AR/S AT/R

10 601 16.64 60.10

10 601 16.64 60.10

10 500 20.00 50.00

   

Total work time: 631

Script operation time

Total requests made: 30

Total amount of HTTP requests made by all virtual clients

   

Total average time per request: 21.0333

Average HTTP request processing time (using all requests)

Total average requests per second: 47.5436

Average amount of HTTP requests per second

   

WARNING: approximation used!

The warning is displayed if the overall time of the test script operation is lower than required for precise measurement (and calculation) of the “Total average time per request “ and “Total average requests per second” values. In this case the results will be approximated.

Not enough requests per client for exact timing!

   

--- HTTP response codes details ---

Statistics on HTTP response codes:
Code – response code;
Count – amount of responses with this code.

 

Code Count

200 30

 


Execution report (if scripting is used)

If scripting is used, the textual execution report is simplified. Execution of the script below:

[General]
project=Test Project
Description=test
script=$inline.pl
requests=3
clients=2

[script]
$wapt->AddRequest("test1","http://myserver/");
$wapt->AddRequest("test2","http://myserver/");
for($i=0;$i<$wapt->GetOpt("requests");$i++){
$wapt->Request("test1");
$wapt->Request("test2");
}
[/script]

will result in the following report:

Report generated by Web Roller v3.5 build 957

 
   

Test started at:Fri Apr 19 16:28:42 2002

 

Test finished at:Fri Apr 19 16:28:43 2002

 

Project name: Test Project

Project name (Projectname setting)

Description: Test

Project desctription (Description parameter)

Server name: myserver

Server tested (Server parameter)

Clients: 2

Number of virtual clients

Requests: 3

Number of [TestSeq] runs

Test executed by: Igor

Computer user name

Test executed at: Kort

Computer workstation name

   

--- Client 0 ---

Statistics on processed requests for virtual client “Client 0”

test1 09.20

test2 12.10

test1 11.60

test2 09.70

test1 12.10

test2 11.60

   

--- Client 1 ---

Statistics on processed requests for virtual client “Client 1”

test1 09.20

test2 12.10

test1 11.60

test2 09.70

test1 12.10

test2 11.60

   

--- HTTP response codes details ---

Statistics on HTTP response codes:
Code – response code;
Count – amount of responses with this code.

 

Code Count

200 12

 


Execution Log

If in the [General] section Log=1, all the results of operation are logged to a file. Each virtual client generates a separate log file. The complete log of the Web Roller client operation is written to this file. This includes all requests, responses, redirects and the HTML code returned.

A test script like this:

[General]
clients=1
requests=2
server=kort
log=1

[TestSeq]
Req1
Req2

[Req1]
$uri=/
$method=GET

[Req2]
$uri=/view.pl
$method=GET

will result in the following log file:

----- [TestSeq]: Req1(0) -----

Separator line: pass #0 of [TestSeq], request Req1

Request:

Header of the HTTP request sent

GET / HTTP/1.1

Host: kort

Connection: close

   

Response:

Header of the server response.

HTTP/1.1 200 OK

Date: Sun, 21 Apr 2002 16:30:45 GMT

Server: Apache/1.3.12 (Win32)

Connection: close

Transfer-Encoding: chunked

Content-Type: text/html

   

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">

HTML code of response

 

<html>

</body>

..

..

</body>

</html>

   

----- [TestSeq]: Req2 (0) -----

Separator line: pass #0 of [TestSeq], request Req2

Request:

 

GET /view.pl HTTP/1.1

 

Host: kort

 

Referrer: http://kort/

 

Connection: close

 
   

Response:

 

HTTP/1.1 200 OK

 

Date: Sun, 21 Apr 2002 16:30:45 GMT

 

Server: Apache/1.3.12 (Win32)

 

Connection: close

 

Transfer-Encoding: chunked

 

Content-Type: text/plain

 
   

<html>

 

</body>

 

..

 

..

 

</body>

 

</html>

 

----- [TestSeq]: Req1(1) -----

Separator line: pass #1 of [TestSeq], request Req1

Request:

 

GET / HTTP/1.1

 

Host: kort

 

Referrer: http://kort/view.pl

 

Connection: close

 
   

Response:

 

HTTP/1.1 200 OK

 

Date: Sun, 21 Apr 2002 16:30:45 GMT

 

Server: Apache/1.3.12 (Win32)

 

Connection: close

 

Transfer-Encoding: chunked

 

Content-Type: text/html

 
   

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">

 
   

<html>

 

</body>

 

..

 

..

 

</body>

 

</html>

 
   

----- [TestSeq]: Req2(1) -----

Separator line: pass #1 of [TestSeq], request Req2

Request:

 

GET /view.pl HTTP/1.1

 

Host: kort

 

Referrer: http://kort/

 

Connection: close

 
   

Response:

 

HTTP/1.1 200 OK

 

Date: Sun, 21 Apr 2002 16:30:45 GMT

 

Server: Apache/1.3.12 (Win32)

 

Connection: close

 

Transfer-Encoding: chunked

 

Content-Type: text/plain

 
   

<html>

 

</body>

 

..

 

..

 

</body>

 

</html>