Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BigQuery issue: Tables with unapplied upsert data cannot be queried through prefix. #10465

Open
lethanhduong opened this issue May 9, 2024 · 0 comments
Labels
bug Bug report

Comments

@lethanhduong
Copy link

Describe the bug
We're using Datastream to ingest the data to BigQuery. After that, we collect the BigQuery metadata to Datahub.
However, The ingestion job got a issue when it try to query partition information of Datasets using DataStream flow.

Error Log
400 Tables with unapplied upsert data cannot be queried through prefix. First table with upsert data

Script Called
The template query is executed in this case
https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/bigquery_v2/queries.py#L72

@lethanhduong lethanhduong added the bug Bug report label May 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Bug report
Projects
None yet
Development

No branches or pull requests

1 participant