Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Count skipped tests with rackunit/log? #81

Open
jackfirth opened this issue Nov 11, 2017 · 2 comments
Open

Count skipped tests with rackunit/log? #81

jackfirth opened this issue Nov 11, 2017 · 2 comments

Comments

@jackfirth
Copy link
Sponsor Collaborator

This would allow raco test to know when not all tests were run for whatever reason. Tests that are skipped in the package build server (e.g. tests requiring an internet connection) could cause the package catalog entry to say "succeeds, some tests skipped" instead of just "succeeds".

@bennn
Copy link
Contributor

bennn commented Nov 12, 2017

Is the idea here that testing code can opt-in to saying "this test was skipped and I want you to know"? If so then yes I want this.

Example:

;; Issue a warning if we skip this test
(if (eq? (system-type) 'windows)
  (check-true ....)
  (test-log "Skipped test because Windows"))

;; Don't care if we skip this test
(if (today-is-tuesday?)
  (check-true ....)
  (void))

@jackfirth
Copy link
Sponsor Collaborator Author

Yes, that's exactly it. I'm not sure what the correct way to show a message about a skipped test is though. All I know for certain is I want rackunit/log to support counting skipped tests, and I want there to be a way for custom checks and user test cases to skip tests for arbitrary reasons while incrementing the counter.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants