MantisBT - TestLink
View Issue Details
0005810TestLinkTest Executepublic2013-07-15 03:262016-02-16 08:56
FelixLin 
 
urgentmajoralways
newopen 
1.9.7 (2013 Q2 - bug fixing) 
 
MySQL
Firefox 22.0
PHP Version 5.3.3
TBD
0005810: The left-tree-list view of TestExecution has poor performance
The left-tree-list view of TestExecution has poor performance, more than 30 seconds to refreshed for 2 assigned cases in project with 4500 cases.
I tried a project with about 4500 test cases.
In "TestSpecification" panel, the left-tree-list view has good performance(3 seconds to be refreshed).

I set :
  $tlCfg->exec_cfg->user_filter_default='logged_user';
  Only 2 cases were assigned to me.

When I click on "TestExecution ",
   the left-tree-list view can only be drawn after 30 seconds.
If I "save execution" for one case,
   the left-tree-list view can only be refreshed after 30 seconds.
TestLink 1.9.6 has no such problem.
No tags attached.
has duplicate 0005816closed fman performance issue to open Test Execution page 
related to 0005819closed fman left plane is blank when click execution for a big test plan 
Issue History
2013-07-15 03:26FelixLinNew Issue
2013-07-15 09:35fmanNote Added: 0019250
2013-07-15 12:01FelixLinNote Added: 0019251
2013-07-16 22:03ansarNote Added: 0019272
2013-07-17 04:52fmanNote Added: 0019273
2013-07-18 08:39fmanRelationship addedhas duplicate 0005816
2013-07-18 09:23FelixLinNote Added: 0019284
2013-07-18 10:44fmanNote Added: 0019288
2013-07-18 13:44fmanRelationship addedrelated to 0005819
2013-07-22 08:30FelixLinNote Added: 0019306
2013-07-22 10:20fmanNote Added: 0019308
2013-07-23 18:51ansarNote Added: 0019323
2013-07-23 19:50fmanNote Added: 0019324
2013-07-24 16:40ansarNote Added: 0019326
2013-07-24 17:41fmanNote Added: 0019327
2013-07-24 18:15fmanNote Added: 0019328
2013-07-24 22:11ansarNote Added: 0019329
2013-11-27 17:34ansarNote Added: 0020128
2014-11-05 14:12fmanNote Added: 0022081

Notes
(0019250)
fman   
2013-07-15 09:35   
Seem this has been explained on forum.

Test Spec tree can be build using 'lazy mode' i.e. info is get only when user click on a folder. This is valid till you do not apply filters.
When filters are applied, complete tree analisys is needed (see below Test Plan Tree).


Test Plan tree has to be build COMPLETELY i.e. lazy can not be used.
This explain why performance can not be the same.



It will be interesting if you can provide same figures for 1.9.6, because do not think (may be I'm wrong) 1.9.7 has implementation on tree side.

If you can provide your db or a similar one, will be great for me to plan some performance tests.
(0019251)
FelixLin   
2013-07-15 12:01   
Thanks.
I just got the performance from my colleague about 1.9.6.
I will check the 1.9.6 comparing to 1.9.7. Then give out the result.
(0019272)
ansar   
2013-07-16 22:03   
I have had the same problem for awhile.

In our main test project, we have about 40,000 test cases. If I select "Execute Tests", "Add / Remove Test Cases", or "Assign Test Case Execution", it will take over 5 minutes for the left TreeView to be displayed.

This has been the case for me in TestLink 1.9.3, 1.9.4, 1.9.5, and now 1.9.7.

I will see if I can get our database randomized so as to give you a way to see what I am seeing. Or at least maybe generate a generic database that you can use to reproduce this issue.

Thanks for your time.
(0019273)
fman   
2013-07-17 04:52   
@ansar
1. having this kind of reports at the right time would be of help, i.e. if you find an issue report ASAP


2. ok if you can send me a db.
as you can understand working on 40000 is not a thing that can be handle in a breeze.
In addition who can analize a test execution report with 40000 test cases ?
Only way to manage this is to forget to tree like view with the folder structure, and provide just test case with parent test suite, this way we remove time to rebuild the tree.
To test if this will be a solution is to have 40000 test cases organized in N test suites but with ONLY one level deep, i,e.

Test project
  TS1 ---> lets say this Test Suite contains 5000 test cases
  TS2
  TS3
  TS4
  ...
  TS8

8 Test Suite with 5K test case each => 40K test cases


will wait for your sample db
(0019284)
FelixLin   
2013-07-18 09:23   
Hi? fman?
?tried the same DB with TestLink 1.9.6, it has the same performance problem.
 
Do you mean, the less the test-suite level, the better performance it has?
(0019288)
fman   
2013-07-18 10:44   
You have written:
>> TestLink 1.9.6 has no such problem.
then is not right OK ?

>> Do you mean, the less the test-suite level, the better performance it has?
IMHO yes, because amount of queries to build tree from leaf to root decrease
(0019306)
FelixLin   
2013-07-22 08:30   
Yes,
TestLink 1.9.6 has the same performance problem.
(0019308)
fman   
2013-07-22 10:20   
Still waiting for a Sample DB
(0019323)
ansar   
2013-07-23 18:51   
Ok, I got one of my guys to randomize all the data. The database is about 150 megs in size. Where is a good place to give it to you?
(0019324)
fman   
2013-07-23 19:50   
before posting it please truncate transactions and events table.
You can put it in a google drive ? an ftp site ?
(0019326)
ansar   
2013-07-24 16:40   
Also, we obviously upped the various timeouts and memory usage limits in order to let the treeview complete. If you need those settings, let me know and I can get them.
(0019327)
fman   
2013-07-24 17:41   
ok, provide me these settings, thanks
(0019328)
fman   
2013-07-24 18:15   
just created db with sample file. I will try to provide some feedback during next weeks
(0019329)
ansar   
2013-07-24 22:11   
Here are the settings we tweaked in php.ini.

max_execution_time = 600
max_input_time = 600
memory_limit = 4096M
(0020128)
ansar   
2013-11-27 17:34   
Any movement on this issue?

I believe a related issue was also submitted:
http://mantis.testlink.org/view.php?id=5751 [^]
(0022081)
fman   
2014-11-05 14:12   
Unfortunately no