David Heidelberg
05bd55a994
ci/traces: extend no-output timeout by 5 minutes
...
This should help us handling possibly slower downloads of the traces,
which leads into piglit not printing anything on the output.
After Infra will get stabilized again, needs to be reverted.
Acked-by: Helen Koike <helen.koike@collabora.com >
Acked-by: Daniel Stone <daniels@collabora.com >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/25097 >
2023-09-07 23:43:02 +00:00
Eric Engestrom
fd35e59139
ci: avoid running hardware jobs if lint fails - now on LAVA too!
...
I missed this in !23774 .
Fixes: a1c1cce9df ("ci: avoid running hardware jobs if there are already trivial issues")
Signed-off-by: Eric Engestrom <eric@igalia.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/24121 >
2023-07-12 19:31:01 +00:00
Guilherme Gallo
a5ccb4dafb
ci/lava: Use an alpine image for SSH client container
...
Use a lightweight container for ping, ssh, curl and bash support.
Also use an image located at fd.o infrastructure, since we are having
some issues with Collabora's gitlab one lately.
Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23534 >
2023-07-07 14:34:40 +00:00
Guilherme Gallo
db3b5370ec
ci/lava: Add LAVA SSH client container
...
- To keep things organized, create a base hidden jobs for alpine images,
as we have 2 now
- This image will have an SSH client ran by LAVA dispatchers
(x86_64-only) who will serve as a bypass channel of output and dmesg
and an alternative for UART.
Signed-off-by: Guilherme Gallo <guilherme.gallo@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23534 >
2023-07-07 14:34:40 +00:00
David Heidelberg
78aaec836a
ci: remove BUILD_PATH, always use S3_ARTIFACT_NAME
...
Since we use S3 artifacts for LAVA always, keep only one codepath.
Reviewed-by: Guilherme Gallo <guilherme.gallo@collabora.com >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23527 >
2023-06-10 01:31:16 +02:00
David Heidelberg
2af371b3f3
ci: replace MINIO_RESULTS_UPLOAD with S3_RESULTS_UPLOAD
...
Reviewed-by: Guilherme Gallo <guilherme.gallo@collabora.com >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23527 >
2023-06-10 01:31:16 +02:00
David Heidelberg
deba02fddf
ci: rename MINIO_HOST variable to S3_HOST
...
Reviewed-by: Guilherme Gallo <guilherme.gallo@collabora.com >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23527 >
2023-06-10 01:31:16 +02:00
David Heidelberg
fed5a50d0f
ci: missed variable inside the big rename and split ARCH and DEBIAN_ARCH
...
Fixes: 5140ff1948 ("ci: rename x86 and amd64 to x86_64, armhf to arm32, and i386 to x86_32")
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23406 >
2023-06-06 17:28:09 +00:00
David Heidelberg
5140ff1948
ci: rename x86 and amd64 to x86_64, armhf to arm32, and i386 to x86_32
...
Closes: https://gitlab.freedesktop.org/mesa/mesa/-/issues/8049
Reviewed-by: Yonggang Luo <luoyonggang@gmail.com >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/23282 >
2023-06-02 21:30:15 +02:00
David Heidelberg
4286e559cc
ci: remove deqp from lava piglit and traces runs
...
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065 >
2023-03-24 21:58:22 +00:00
David Heidelberg
bc5a48d48b
ci: create lava-test without deqp HWCI_TEST_SCRIPT
...
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065 >
2023-03-24 21:58:22 +00:00
David Heidelberg
2314a0d59b
ci: rename .lava-test to .lava-test-deqp to describe it correctly
...
.lava-test hidden job was setting the HWCI_TEST_SCRIPT variable to deqp
runner. But that is not always the case. When we run piglit traces jobs,
we use piglit-traces.sh instead, for example.
Splitting into:
- .lava-test-deqp (deqp-runner + deqp)
- .lava-traces (deqp-runner + piglit)
- .lava-piglit (piglit-runner + piglit)
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Co-authored-by: Guilherme Gallo <guilherme.gallo@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/22065 >
2023-03-24 21:58:22 +00:00
David Heidelberg
84767a5160
ci/lava: every LAVA job doesn't want to run gles2 deqp, drop it
...
Very annoying when adding new job and not getting failure due to missing
`DEQP_VER: `
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21702 >
2023-03-11 14:48:20 +00:00
Daniel Stone
50378f59a7
ci: Actually run Piglit on LAVA
...
At some point in a refactoring long ago, our 'Piglit' runs on arm64
started actually being dEQP-GLES2 runs. Oh dear.
Surprisingly, there are a number of expectation changes; added every
fail I saw from a long overnight stress test.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/21851 >
2023-03-11 11:58:30 +00:00
David Heidelberg
796686af1b
ci: migrate from wget to curl
...
Better error handling is more reliable.
Options:
-L, follow location
--retry, number of retries
--retry-all-errors, does not fail on ALL errors, that's why there is -f
-f, fail fast with no output at all on server errors
--retry-delay, make curl sleep this amount of time before each retry
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/20788 >
2023-01-19 23:46:44 +00:00
Tomeu Vizoso
ba518a31ac
ci: Report failures to GitLab for LAVA jobs
...
We were uploading the junit.xml to the artifacts, but weren't telling
GitLab about it.
Reviewed-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/18028 >
2022-08-15 11:40:19 +02:00
David Heidelberg
95a7b65c14
ci: replace gzip usage with zstd where posible
...
v2: added missing zstd to arm_build.sh
Reviewed-by: Emma Anholt <emma@anholt.net >
Signed-off-by: David Heidelberg <david.heidelberg@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/17776 >
2022-08-04 11:21:45 +00:00
Emma Anholt
9fdefa6182
ci: Remove .build-rules from core test job definitions.
...
If you accidentally re-included your test job core definition after your
driver-specific ruleset, you'd end up running the driver job on every
source code change. This had happened with a630_gles_asan: it included
.baremetal-test-arm64-asan (and thus .baremetal-test) after including
.a630-test, to override .baremetal-test-arm64's depednencies to use asan
artifacts instead.
Acked-by: Michel Dänzer <mdaenzer@redhat.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/17386 >
2022-07-08 23:44:52 +00:00
Emma Anholt
4ebb1c5ab3
ci: Rename .ci-run-policy rules to .build-rules.
...
... and explain what they're doing, compared to the test rules in
test-source-dep.yml.
Unfortunately, we can't really pull them into test-source-dep.yml with
other source deps, because of various '&'-'*' references.
Acked-by: Michel Dänzer <mdaenzer@redhat.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/17386 >
2022-07-08 23:44:52 +00:00
Tomeu Vizoso
b46000f076
ci: Allow specifying a different kernel in LAVA jobs
...
To make it possible to use a kernel different from that built along with
the rootfs.
This can make it more convenient for other projects to reuse these
scripts.
Signed-off-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Reviewed-by: Emma Anholt <emma@anholt.net >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/15891 >
2022-04-13 07:34:36 +00:00
Tomeu Vizoso
f7713b0af0
ci: Use CI_PROJECT_NAME instead of hardcoding 'mesa'
...
This can make it more convenient for other projects to reuse these
scripts.
Signed-off-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Reviewed-by: Emma Anholt <emma@anholt.net >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/15891 >
2022-04-13 07:34:36 +00:00
Emma Anholt
ad0fcaf1ee
ci/lava: Simplify passthrough of the request to upload results/ to minio.
...
We already have a way to pass env vars around, just use that instead of
packing/unpacking it on the kernel command line.
Cleans up HW runner job log output some more.
Acked-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/15332 >
2022-04-05 21:37:46 +00:00
Tomeu Vizoso
c0695bb473
ci: Allow disabling the whole of the Collabora farm
...
Add a global-level variable that allows disabling all jobs that would
have gone to the Collabora lab, to be used in case of outages.
Signed-off-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/15150 >
2022-02-24 07:33:45 +01:00
Emma Anholt
ccbf16124e
ci/traces: Rename the piglit/run.sh script to piglit-traces.sh.
...
That's the only use of this script that's left.
Reviewed-by: Cristian Ciocaltea <cristian.ciocaltea@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/14604 >
2022-01-27 04:37:16 +00:00
Emma Anholt
9ddfd297e0
ci/deqp-runner: Simplify the --jobs argument setup.
...
We can use the general "how parallel should we go on this runner?" env var
and save a bunch of massaging env var names. Fixes how PIGLIT_PARALLEL
looked like it was useful but actually wasn't passed through to HW
runners.
Reviewed-by: Pierre-Eric Pelloux-Prayer <pierre-eric.pelloux-prayer@amd.com >
Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/13372 >
2021-10-21 07:34:19 +00:00
Erico Nunes
574bff9087
ci: enable CI for lima again
...
Enable CI for lima again on meson-gxl-s805x-libretech-ac boards
with Mali-450.
These boards are managed by a LAVA instance and so follow the LAVA CI
workflow in Mesa.
The goal is to have coverage for deqp-gles2, as lima is a GLES2-only
driver.
Signed-off-by: Erico Nunes <nunes.erico@gmail.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11789 >
2021-08-17 11:22:59 +00:00
Emma Anholt
cd3b6689b2
ci: Save dEQP results on all tests.
...
Everyone can get artifacts now. Let's make those artifacts useful.
Acked-by: Alyssa Rosenzweig <alyssa.rosenzweig@collabora.com >
Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/12110 >
2021-08-03 18:32:01 +00:00
Michel Dänzer
f5e6674f98
ci: Rename Debian based build jobs from meson-* to debian-*
...
meson has been the only build system in tree for some time, so the
meson- prefix was a bit meaningless.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11412 >
2021-07-09 10:24:41 +00:00
Michel Dänzer
df185ae030
ci: Add debian/ prefix to job names for Debian based docker images
...
And move the image build scripts to a subdirectory correspondingly.
Preparation for adding images based on other OSs.
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11412 >
2021-07-09 10:24:41 +00:00
Daniel Stone
d237f5ab56
ci/lava: Make kernel image type a normal argument
...
Just pass the actual parameter, rather than bare YAML.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Acked-by: Martin Peres <martin.peres@mupuf.org >
Acked-by: Emma Anholt <emma@anholt.net >
Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11337 >
2021-06-15 14:02:44 +02:00
Daniel Stone
a1e734a874
ci: Unify {BARE_METAL,LAVA}_TEST_SCRIPT environment
...
Should also probably never have been different.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Acked-by: Martin Peres <martin.peres@mupuf.org >
Acked-by: Emma Anholt <emma@anholt.net >
Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11337 >
2021-06-15 14:02:44 +02:00
Daniel Stone
4e581b0202
ci/lava: Set PIGLIT_NO_WINDOW
...
This got lost in the move away from hardcoded environment variables, and
fixes the Iris EGL tests.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Acked-by: Martin Peres <martin.peres@mupuf.org >
Acked-by: Emma Anholt <emma@anholt.net >
Reviewed-by: Tomeu Vizoso <tomeu.vizoso@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11337 >
2021-06-15 14:02:44 +02:00
Daniel Stone
d0e5203855
ci/lava: Use per-job rootfs overlay for environment
...
Trying to get arbitrary strings suitably quoted for shell, embedded in a
YAML file, processed by Python templating, is like seven bad ideas all
embedded into one big can of bees.
Reuse the same script we use for bare-metal to generate the environment,
tar that up into a per-job overlay which is added to the
inter-pipeline-reusable rootfs built by the container jobs and the
intra-pipeline-reusable overlay built by the build jobs.
@anholt wrote a chunk of this - replacing the $ENV_VARS GitLab CI
variable with a Python loop across the POSIX job environment - in
!11192 , but this still had YAML quoting nightmares, and was more
needless duplication between LAVA and bare-metal.
The diff is large and annoying, but is mostly a sed job to get
ENV_VARS="FOO=bar BAZ=quux" into FOO: bar\nBAZ: quux.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Co-authored-by: Emma Anholt <emma@anholt.net >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11309 >
2021-06-11 12:13:00 +00:00
Daniel Stone
d5d3dd7d97
ci: Add JOB_ARTIFACTS_BASE variable
...
Used for both LAVA (uploading results to MinIO because we don't yet have
non-ephemeral NFS storage) and Piglit (for the Tracie dashboard).
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11309 >
2021-06-11 12:13:00 +00:00
Daniel Stone
79a0220d28
ci: Make PIPELINE_ARTIFACTS_BASE a common variable
...
$minio/artifacts/$project/$pipeline/ is common between all our CI.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11309 >
2021-06-11 12:13:00 +00:00
Daniel Stone
0fd2320c94
ci/lava: Clean up variable naming, document them
...
Our variable names haven't aged very well. Rename them to make them more
clear and straightforward, especially when we bring in a third rootfs
element to download.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11309 >
2021-06-11 12:13:00 +00:00
Daniel Stone
561a1a9ad9
ci/lava: Wrap submission in a shell script
...
Just do what we're already doing but in a shell script, which will make
it less tedious to expand out later.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11309 >
2021-06-11 12:13:00 +00:00
Daniel Stone
f3d69923a1
ci/lava: Pass JWT separately from environment variables
...
As the JWT is sensitive, we don't want to record or leak it anywhere.
Doing this lets us run --dump-yaml in normal execution so we can
artifact the result, as well as bringing us into line with bare-metal.
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11309 >
2021-06-11 12:13:00 +00:00
Daniel Stone
5793cefff8
ci/lava: Move LAVA files to lava/
...
Signed-off-by: Daniel Stone <daniels@collabora.com >
Part-of: <https://gitlab.freedesktop.org/mesa/mesa/-/merge_requests/11309 >
2021-06-11 12:13:00 +00:00