Page MenuHomePhabricator

selenium flakiness: Edit multiple aliases
Closed, DeclinedPublic

Description

11:28:11   Scenario: Edit multiple aliases                              # features/aliases.feature:130
11:28:20     When I click the header edit button                        # features/step_definitions/header_steps.rb:10
11:28:20     And I enter "alias1", "alias2" as new aliases              # features/step_definitions/aliases_steps.rb:24
11:28:20     And I click the header save button                         # features/step_definitions/header_steps.rb:18
11:28:20     And I click the header edit button                         # features/step_definitions/header_steps.rb:10
11:28:20     And I enter "alias3", "alias4" as new aliases              # features/step_definitions/aliases_steps.rb:24
11:28:20     And I empty the first alias                                # features/step_definitions/aliases_steps.rb:9
11:28:20     And I change the first alias to alias5                     # features/step_definitions/aliases_steps.rb:28
11:28:20     And I click the header save button                         # features/step_definitions/header_steps.rb:18
11:28:20     Then There should be 3 aliases in the list                 # features/step_definitions/aliases_steps.rb:72
11:28:20       expected: == 3
11:28:20            got:    2 (RSpec::Expectations::ExpectationNotMetError)
11:28:20       features/aliases.feature:139:in `Then There should be 3 aliases in the list'
11:28:20     And List of aliases should be "alias5", "alias3", "alias4" # features/step_definitions/aliases_steps.rb:76

e.g. https://integration.wikimedia.org/ci/job/mwselenium-quibble-docker/9699/consoleFull

From the video captured it appears that replacing - then first - "alias2" by "alias5" goes wrong, it rather removes "alias2" as well (like "alias1") and then appends "alias 5" to "alias3"

Event Timeline

Change 496166 had a related patch set uploaded (by Jakob; owner: Jakob):
[mediawiki/extensions/Wikibase@master] Fix broken "Edit multiple aliases" browser test

https://gerrit.wikimedia.org/r/496166

https://gerrit.wikimedia.org/r/496166 could be a work around until we understand the root cause of why this happened. Unfortunately it is currently itself blocked by an error (T218209?) outside our control

17:28:23 13 03 2019 17:28:23.524:DEBUG [launcher]: Process ChromeHeadless exited with code 0
17:28:23 13 03 2019 17:28:23.539:ERROR [launcher]: Cannot start ChromeHeadless
17:28:23 	[0313/172823.457604:ERROR:nss_util.cc(94)] Failed to create /nonexistent/.pki/nssdb directory.
17:28:23 [0313/172823.487559:ERROR:nss_util.cc(94)] Failed to create /nonexistent/.pki/nssdb directory.

https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-hhvm-docker/39443/console

Change 496166 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Fix broken "Edit multiple aliases" browser test

https://gerrit.wikimedia.org/r/496166

T218209 is fixed and https://gerrit.wikimedia.org/r/496166 merged. This is not blocking CI any more. We do still have to understand what caused this problem, however.

Seems we are good for a while and there are no plans to actively develop rb-based browser tests any more so closing this makes sense in my eyes.