Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Harvester crashes with missing title #254

Open
jze opened this issue Jul 31, 2023 · 1 comment
Open

Harvester crashes with missing title #254

jze opened this issue Jul 31, 2023 · 1 comment

Comments

@jze
Copy link
Contributor

jze commented Jul 31, 2023

I had a harvester run abort today with the following error message:

[ckanext.harvest.model] Error when processsing dataset: KeyError('title') / Traceback (most recent call last):
  File "/usr/lib/ckan/default/src/ckanext-dcat/ckanext/dcat/harvesters/rdf.py", line 218, in gather_stage
    dataset['name'] = self._gen_new_name(dataset['title'])
KeyError: 'title'

I have not yet figured out which record contains the error and what it looks like. However, the harvest run should not crash completely due to a single incorrect dataset.

@seitenbau-govdata
Copy link
Member

Thanks @jze . Yes, of course. I agree. Having a try/except around each dataset or checking for an existent title and creating a gather_error would be the better way in this case. Would you mind submitting a PR with the changes needed?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants