Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Upload failed screendump tests #14771

Closed
wants to merge 1 commit into from

Conversation

chrisbra
Copy link
Member

It's a bit of a pain to debug failing screendump tests without knowing exactly what went wrong. Therefore include actions/upload-artifact for the Github CI runners and have them uploaded those failing screen dump tests.

Let's add this step to each of the Linux/MacOS/Windows workflows..

Example:
https://github.com/chrisbra/vim/actions/runs/9085493619

@github-actions github-actions bot added the CI Travis, AppVeyor, GHA, ... label May 14, 2024
dundargoc

This comment was marked as resolved.

@zzzyxwvut
Copy link
Contributor

A few suggestions:

  • Since all kinds of failed tests will be collected, their
    archive suffixes better be generic, e.g. -failed-tests;
    also these descriptions: - name: Upload failed tests.

  • matrix.runner is only defined for the macos jobs; but
    e.g. ${{ matrix.toolchain }}-${{ matrix.features }}- and
    linux-${{ matrix.compiler }}-${{ matrix.features }}- can
    be used elsewhere.

@chrisbra
Copy link
Member Author

You could use a local action to deduplicate the code if you wanna

Thanks, even so it may not work because of the issue mentioned by @zzzyxwvut how would one do that?

@dundargoc
Copy link
Contributor

dundargoc commented May 15, 2024

@chrisbra dundargoc@8ff9394
CI: https://github.com/dundargoc/vim/actions/runs/9095363350

${{ github.workflow }}-${{ github.job }}-${{ join(matrix.*, '-') }} should be unique for all jobs.

@chrisbra
Copy link
Member Author

Ah thank you that is clever

@zzzyxwvut
Copy link
Contributor

Yep, but wouldn't any fork pushed claim the same name for
every job and, when there are common failures, the last one
takes it all unless there is additional disambiguation with
${{ github.workflow_sha }}-${{ github.run_attempt }}?

@zzzyxwvut
Copy link
Contributor

Let me contextualise it:

Uploading to the same named Artifact multiple times.

Due to how Artifacts are created in this new version, it is no longer possible
to upload to the same named Artifact multiple times. You must either split the
uploads into multiple Artifacts with different names, or only upload once.
Otherwise you will encounter an error.

@dundargoc
Copy link
Contributor

They are talking about same name in the same workflow, not the same name in the entire repository: https://github.com/actions/upload-artifact/blob/main/docs/MIGRATION.md#multiple-uploads-to-the-same-named-artifact

@zzzyxwvut
Copy link
Contributor

All right, it seems that a dedicated namespace is allotted
for each workflow and github.workflow_sha would indeed be
superfluous (unless you want provenance written in the name
of the archive). Is there a need for github.run_attemptto
allow for manual Re-run jobs functionality?

Also, are there file name length limits to consider for any
popular file systems?

@dundargoc
Copy link
Contributor

I don't know. I will leave that as an exercise for the reader.

It's a bit of a pain to debug failing screendump tests without knowing
exactly what went wrong. Therefore include actions/upload-artifact for
the Github CI runners and have them uploaded those failing screen dump
tests.

Let's add this step to each of the Linux/MacOS/Windows workflows..

Example:
https://github.com/chrisbra/vim/actions/runs/9085493619

Co-authored-by: dundargoc <gocdundar@gmail.com>
Co-authored-by: Aliaksei Budavei <0x000c70@gmail.com>
Signed-off-by: Christian Brabandt <cb@256bit.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CI Travis, AppVeyor, GHA, ...
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants