Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-48300][SQL] Codegen Support for from_xml #46609

Closed
wants to merge 7 commits into from

Conversation

panbingkun
Copy link
Contributor

@panbingkun panbingkun commented May 16, 2024

What changes were proposed in this pull request?

The PR aims to add Codegen Support for from_xml

Why are the changes needed?

  • Improve codegen coverage.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

  • Add new UT & existed UT.
  • Pass GA.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the SQL label May 16, 2024
@panbingkun panbingkun marked this pull request as ready for review May 16, 2024 12:08
@@ -104,7 +103,7 @@ case class XmlToStructs(
if (mode != PermissiveMode && mode != FailFastMode) {
throw QueryCompilationErrors.parseModeUnsupportedError("from_xml", mode)
}
val (parserSchema, actualSchema) = nullableSchema match {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The variable actualSchema is not used anywhere

@panbingkun panbingkun marked this pull request as draft May 17, 2024 11:39
@panbingkun panbingkun marked this pull request as ready for review May 20, 2024 02:25
@panbingkun
Copy link
Contributor Author

@panbingkun panbingkun changed the title [SPARK-48300][SQL] Codegen Support for from_xml [SPARK-48300][SQL] Codegen Support for from_xml & remove some redundant codes May 20, 2024
@sandip-db
Copy link
Contributor

@panbingkun Thanks for submitting the PR. Can you please separate the codegen support and the cleanup in separate PRs?

@panbingkun
Copy link
Contributor Author

@panbingkun Thanks for submitting the PR. Can you please separate the codegen support and the cleanup in separate PRs?
Sure,
A new separate PR for cleanup: #46674

@panbingkun
Copy link
Contributor Author

After the PR above is merged, I will rebase the PR again just for codegen
Thanks.

@panbingkun panbingkun changed the title [SPARK-48300][SQL] Codegen Support for from_xml & remove some redundant codes [SPARK-48300][SQL] Codegen Support for from_xml May 21, 2024
@panbingkun
Copy link
Contributor Author

It has rebase the master. At present, this PR is only for codegen support for from_xml
@sandip-db @HyukjinKwon @yaooqinn @cloud-fan

@yaooqinn yaooqinn closed this in 6213fa6 May 21, 2024
@yaooqinn
Copy link
Member

Merged to master.

Thank you @panbingkun

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
3 participants