Mantis Bugtracker          
testlink.org
Main | My View | View Issues | Change Log | My Account
  

View Issue Details [ Jump to Notes ] [ Issue History ] [ Print ]
IDProjectCategoryView StatusDate SubmittedLast Update
0005810TestLinkTest Executepublic2013-07-15 03:262016-02-16 08:56
ReporterFelixLin 
Assigned To 
PriorityurgentSeveritymajorReproducibilityalways
StatusnewResolutionopen 
PlatformOSOS Version
Product Version1.9.7 (2013 Q2 - bug fixing) 
Fixed in Version 
Summary0005810: The left-tree-list view of TestExecution has poor performance
DescriptionThe left-tree-list view of TestExecution has poor performance, more than 30 seconds to refreshed for 2 assigned cases in project with 4500 cases.
Steps To ReproduceI tried a project with about 4500 test cases.
In "TestSpecification" panel, the left-tree-list view has good performance(3 seconds to be refreshed).

I set :
  $tlCfg->exec_cfg->user_filter_default='logged_user';
  Only 2 cases were assigned to me.

When I click on "TestExecution ",
   the left-tree-list view can only be drawn after 30 seconds.
If I "save execution" for one case,
   the left-tree-list view can only be refreshed after 30 seconds.
Additional InformationTestLink 1.9.6 has no such problem.
TagsNo tags attached.
Database (MySQL,Postgres,etc)MySQL
BrowserFirefox 22.0
PHP VersionPHP Version 5.3.3
TestCaseID
QA Team - Task Workflow StatusTBD
Attached Files

- Relationships
has duplicate 0005816closedfman performance issue to open Test Execution page 
related to 0005819closedfman left plane is blank when click execution for a big test plan 

-  Notes
(0019250)
fman (administrator)
2013-07-15 09:35

 Seem this has been explained on forum.

Test Spec tree can be build using 'lazy mode' i.e. info is get only when user click on a folder. This is valid till you do not apply filters.
When filters are applied, complete tree analisys is needed (see below Test Plan Tree).


Test Plan tree has to be build COMPLETELY i.e. lazy can not be used.
This explain why performance can not be the same.



It will be interesting if you can provide same figures for 1.9.6, because do not think (may be I'm wrong) 1.9.7 has implementation on tree side.

If you can provide your db or a similar one, will be great for me to plan some performance tests.
(0019251)
FelixLin (reporter)
2013-07-15 12:01

 Thanks.
I just got the performance from my colleague about 1.9.6.
I will check the 1.9.6 comparing to 1.9.7. Then give out the result.
(0019272)
ansar (reporter)
2013-07-16 22:03

 I have had the same problem for awhile.

In our main test project, we have about 40,000 test cases. If I select "Execute Tests", "Add / Remove Test Cases", or "Assign Test Case Execution", it will take over 5 minutes for the left TreeView to be displayed.

This has been the case for me in TestLink 1.9.3, 1.9.4, 1.9.5, and now 1.9.7.

I will see if I can get our database randomized so as to give you a way to see what I am seeing. Or at least maybe generate a generic database that you can use to reproduce this issue.

Thanks for your time.
(0019273)
fman (administrator)
2013-07-17 04:52

 @ansar
1. having this kind of reports at the right time would be of help, i.e. if you find an issue report ASAP


2. ok if you can send me a db.
as you can understand working on 40000 is not a thing that can be handle in a breeze.
In addition who can analize a test execution report with 40000 test cases ?
Only way to manage this is to forget to tree like view with the folder structure, and provide just test case with parent test suite, this way we remove time to rebuild the tree.
To test if this will be a solution is to have 40000 test cases organized in N test suites but with ONLY one level deep, i,e.

Test project
  TS1 ---> lets say this Test Suite contains 5000 test cases
  TS2
  TS3
  TS4
  ...
  TS8

8 Test Suite with 5K test case each => 40K test cases


will wait for your sample db
(0019284)
FelixLin (reporter)
2013-07-18 09:23

 Hi? fman?
?tried the same DB with TestLink 1.9.6, it has the same performance problem.
 
Do you mean, the less the test-suite level, the better performance it has?
(0019288)
fman (administrator)
2013-07-18 10:44

 You have written:
>> TestLink 1.9.6 has no such problem.
then is not right OK ?

>> Do you mean, the less the test-suite level, the better performance it has?
IMHO yes, because amount of queries to build tree from leaf to root decrease
(0019306)
FelixLin (reporter)
2013-07-22 08:30

 Yes,
TestLink 1.9.6 has the same performance problem.
(0019308)
fman (administrator)
2013-07-22 10:20

 Still waiting for a Sample DB
(0019323)
ansar (reporter)
2013-07-23 18:51

 Ok, I got one of my guys to randomize all the data. The database is about 150 megs in size. Where is a good place to give it to you?
(0019324)
fman (administrator)
2013-07-23 19:50

 before posting it please truncate transactions and events table.
You can put it in a google drive ? an ftp site ?
(0019326)
ansar (reporter)
2013-07-24 16:40

 Also, we obviously upped the various timeouts and memory usage limits in order to let the treeview complete. If you need those settings, let me know and I can get them.
(0019327)
fman (administrator)
2013-07-24 17:41

 ok, provide me these settings, thanks
(0019328)
fman (administrator)
2013-07-24 18:15

 just created db with sample file. I will try to provide some feedback during next weeks
(0019329)
ansar (reporter)
2013-07-24 22:11

 Here are the settings we tweaked in php.ini.

max_execution_time = 600
max_input_time = 600
memory_limit = 4096M
(0020128)
ansar (reporter)
2013-11-27 17:34

 Any movement on this issue?

I believe a related issue was also submitted:
http://mantis.testlink.org/view.php?id=5751 [^]
(0022081)
fman (administrator)
2014-11-05 14:12

 Unfortunately no

- Issue History
Date Modified Username Field Change
2013-07-15 03:26 FelixLin New Issue
2013-07-15 09:35 fman Note Added: 0019250
2013-07-15 12:01 FelixLin Note Added: 0019251
2013-07-16 22:03 ansar Note Added: 0019272
2013-07-17 04:52 fman Note Added: 0019273
2013-07-18 08:39 fman Relationship added has duplicate 0005816
2013-07-18 09:23 FelixLin Note Added: 0019284
2013-07-18 10:44 fman Note Added: 0019288
2013-07-18 13:44 fman Relationship added related to 0005819
2013-07-22 08:30 FelixLin Note Added: 0019306
2013-07-22 10:20 fman Note Added: 0019308
2013-07-23 18:51 ansar Note Added: 0019323
2013-07-23 19:50 fman Note Added: 0019324
2013-07-24 16:40 ansar Note Added: 0019326
2013-07-24 17:41 fman Note Added: 0019327
2013-07-24 18:15 fman Note Added: 0019328
2013-07-24 22:11 ansar Note Added: 0019329
2013-11-27 17:34 ansar Note Added: 0020128
2014-11-05 14:12 fman Note Added: 0022081


Copyright © 2000 - 2019 MantisBT Team
Powered by Mantis Bugtracker