From a3865ed525db76eda31780cf6e03574b53e97e11 Mon Sep 17 00:00:00 2001 From: kegsay Date: Fri, 4 Feb 2022 13:04:57 +0000 Subject: [PATCH] Run Complement tests sequentially (#11910) Since #11811 there has been general Complement flakiness around networking. It seems like tests are hitting the wrong containers. In an effort to diagnose the cause of this, as well as reduce its impact on this project, set the parallelsim to 1 (no parallelism) when running tests. If this fixes the flakiness then this indicates the cause and I can diagnose this further. If this doesn't fix the flakiness then that implies some kind of test pollution which also helps to diagnose this further. --- .github/workflows/tests.yml | 2 +- changelog.d/11910.misc | 1 + 2 files changed, 2 insertions(+), 1 deletion(-) create mode 100644 changelog.d/11910.misc diff --git a/.github/workflows/tests.yml b/.github/workflows/tests.yml index e0f80aaaa7..c395f3e1c2 100644 --- a/.github/workflows/tests.yml +++ b/.github/workflows/tests.yml @@ -383,7 +383,7 @@ jobs: # Run Complement - run: | set -o pipefail - go test -v -json -tags synapse_blacklist,msc2403 ./tests/... 2>&1 | gotestfmt + go test -v -json -p 1 -tags synapse_blacklist,msc2403 ./tests/... 2>&1 | gotestfmt shell: bash name: Run Complement Tests env: diff --git a/changelog.d/11910.misc b/changelog.d/11910.misc new file mode 100644 index 0000000000..d05130969f --- /dev/null +++ b/changelog.d/11910.misc @@ -0,0 +1 @@ +Run Complement tests sequentially.