Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmark dataset versioning #49

Open
yetinam opened this issue Oct 6, 2021 · 2 comments
Open

Add benchmark dataset versioning #49

yetinam opened this issue Oct 6, 2021 · 2 comments
Labels
enhancement New feature or request

Comments

@yetinam
Copy link
Member

yetinam commented Oct 6, 2021

Currently, benchmark datasets are considered stable and immutable over time. However, in the future we might want to publish new versions of dataset, i.e., add more events/traces or further features. For this, SeisBench should be able to provide different versions of datasets.

This issues is mostly here as a reminder and is only be intended to be addressed, once actually a new version of a dataset is supposed to be published.

@yetinam yetinam added the enhancement New feature or request label Oct 6, 2021
@jawooll
Copy link
Contributor

jawooll commented Oct 6, 2021

The only add-on comment to this would be - from an implementation perspective - if the old versions of datasets are to be kept available to allow for backward compatibility with users implemented workflows, we may also just need to check what the storage limits are on dCache, and whether we can extend them.

@yetinam
Copy link
Member Author

yetinam commented Oct 6, 2021

Good point! I think it's very relevant to keep old versions available to ensure reproducibility. For now, I think we shouldn't have any issues with dCache, as compared to their particle physics data, the size of our data is negligible.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants