Investigate OpenQA

[castrojo]

From voice discussion:

Jordan says that Bart deployed this for GNOME OS:

https://gitlab.gnome.org/Infrastructure/openshift-images/openqa

We'd need to look at the resources required, like we could do some things with cloudflare runners if need be. Then if it's looking good we can open a new issue with a plan to move forward.

cc @alatiera @ahmedadan

[alatiera]

The GNOME OS setup is a bit convoluted cause we run the OpenQA worker in a disposable container rather than a dedicated machine.

The setup is and workflow is somewhat documented here, though a bit outdated and we will be moving it soon.

It consists of:

• A webserver deployed on openshift: https://gitlab.gnome.org/Infrastructure/openshift-images/openqa
• A CI job that builds a disk image
• Worker jobs that pull the image and run execute the openqa worker
• The needles repository that has the reference screenshots
• The gnome-build-meta/tests/openqa directory that defines how to execute the tests

[hanthor]

we should completely steal GNOME's setup