We are experiencing a massive increase in Integration Test time when testing against Confluence 5.
Our tests are HtmlUnit based (aka Confluence Func-tests) and create/remove a space for each test. Since Confluence 5 running all tests takes TWICE as much time.
We have conducted some experiments to identify the reason.
The graph depicts the ratio of (time to run Integration tests against confluence 5)/(time to run Integration tests against confluence 4)
20 spaces : 1 integration test class that creates and removes a space 20 times over = confluence 5 is 4 times slower
20 spaces, 10 pages each : 1 Integration test class that creates a space, adds 10 pages, removes the space 20 times over = confluence 5 is 3.5 times slower
all plugin integration tests : the average duration of all plugin integration tests = confluence 5 is app 2 times slower
@all = did you experience something similar?
@Atlassian = can you explain/comment?
Thanks for all your thoughts and input.
Cheers - Ulrich
Community moderators have prevented the ability to post new answers.
Thanks for reporting this, guys. We're now tracking it here:
Hi guys,
This kind of performance regression would impact developers(through automatic testing). However it has less of an impact on customers since space deletion is not a very common operation. Hence this problem is not a priority to be fixed in 5.0; we will look into this problem once 5.0 is out.
Also from Uli's investigation the problem is most pronounced with empty spaces and the more pages a space has the less of the time difference when deleting it in 4.3 vs 5.0.
Our general performance tests don't show any slowdowns in other areas so it looks like the described problem only specific to space deletion/creation.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
This issue is killing me, I delete and re-import the same space twice a week, it was taking me 30 minutes, now the process takes almost 60-80 minutes twice a week due to the slow space removal. We just moved to 5.4.2.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Unfortunately it looks like the same problem is still in 5.0-rc1. As an example, to run the full functional test suite on our plugin:
Confluence 4.3: 110 minutes
Confluence 5.0-rc1: 378 minutes
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Atlassian has created an issue https://jira.atlassian.com/browse/CONF-28048
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
I have also noticed increased delete space times with Confluence 5.0-beta4. I don't have any specific comparisons, but it was noticable. But it also seemed that it varied considerably. I remove and create spaces all the time when running tests, but it is usually is only a small portion of the test time.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Thanks for reporting this Ulrich, I haven't tested it myself due to time constraints but I've alerted our Developer Relations team to this question and someone from Atlassian will be along to comment when they get my message. However, please be aware that the bulk of our developers are based in Sydney so it may be a few more hours before we can get you a response from a qualified Atlassian.
All the best,
John
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Community moderators have prevented the ability to post new answers.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.