Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ideally the downlevel tests would be a matrix of supported versions. #3424

Open
shankarseal opened this issue Apr 3, 2024 · 2 comments
Open
Assignees
Labels
enhancement New feature or request P3 tests triaged Discussed in a triage meeting
Milestone

Comments

@shankarseal
Copy link
Collaborator

          Ideally the downlevel tests would be a matrix of supported versions.

Originally posted by @mtfriesen in #3421 (comment)

@dthaler dthaler added the tests label Apr 8, 2024
@dahavey dahavey added the enhancement New feature or request label Apr 8, 2024
@saxena-anurag
Copy link
Contributor

saxena-anurag commented Apr 13, 2024

Since the selfhosted runners are limited, should we instead use github runners to run kernel regression / downlevel tests? The only drawback will be that we will not get kernel dumps though, but will allow us to scale.

@dahavey dahavey added the triaged Discussed in a triage meeting label Apr 15, 2024
@dahavey dahavey added this to the 2405 milestone Apr 15, 2024
@shankarseal shankarseal modified the milestones: 2405, 2406 May 1, 2024
@saxena-anurag
Copy link
Contributor

Along with the matrix of down-level versions, we can also add permutations of tests for each version:

  1. both extensions and native modules from older version -- tested in selfhosted runners.
  2. only extensions from older version -- tested in GitHub runner.
  3. only native modules from older version -- tested in GitHub runner.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request P3 tests triaged Discussed in a triage meeting
Projects
None yet
Development

No branches or pull requests

4 participants