Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: Fix SparseFloatVector data parse error for parquet #33187

Merged

Conversation

cydrain
Copy link
Contributor

@cydrain cydrain commented May 20, 2024

Issue: #22837 #33162

@sre-ci-robot sre-ci-robot added the size/L Denotes a PR that changes 100-499 lines. label May 20, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/bug Issues or changes related a bug labels May 20, 2024
Copy link
Contributor

mergify bot commented May 20, 2024

@cydrain E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

@cydrain
Copy link
Contributor Author

cydrain commented May 20, 2024

/run-cpu-e2e

@cydrain cydrain force-pushed the caiyd_fix_sparse_parse_err_for_parquet branch 2 times, most recently from 20caca7 to 75b9351 Compare May 21, 2024 03:14
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
@cydrain cydrain force-pushed the caiyd_fix_sparse_parse_err_for_parquet branch from 75b9351 to d24a4ba Compare May 21, 2024 03:32
@zhengbuqian
Copy link
Collaborator

/lgtm

Copy link
Contributor

@congqixia congqixia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/approve

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, cydrain

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Copy link

codecov bot commented May 21, 2024

Codecov Report

Attention: Patch coverage is 84.21053% with 3 lines in your changes are missing coverage. Please review.

Project coverage is 82.19%. Comparing base (a9c7ce7) to head (d24a4ba).
Report is 29 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #33187      +/-   ##
==========================================
+ Coverage   82.15%   82.19%   +0.03%     
==========================================
  Files        1006     1009       +3     
  Lines      128449   128835     +386     
==========================================
+ Hits       105529   105895     +366     
- Misses      18939    18949      +10     
- Partials     3981     3991      +10     
Files Coverage Δ
internal/util/importutilv2/parquet/field_reader.go 73.97% <100.00%> (-0.36%) ⬇️
pkg/util/typeutil/schema.go 86.21% <83.33%> (+0.17%) ⬆️

... and 70 files with indirect coverage changes

@sre-ci-robot sre-ci-robot merged commit cb480d1 into milvus-io:master May 21, 2024
15 checks passed
@cydrain cydrain deleted the caiyd_fix_sparse_parse_err_for_parquet branch May 21, 2024 07:09
cydrain added a commit to cydrain/milvus that referenced this pull request May 27, 2024
…ilvus 2.4

  milvus-io#33064 Support readable JSON file import for Float16/BFloat16/SparseFloat
  milvus-io#33101 Store SparseFloatVector into parquet as JSON string
  milvus-io#33187 Fix SparseFloatVector data parse error for parquet
  milvus-io#33259 Fix SparseFloatVector data parse error for json
  milvus-io#33224 Optimize bulk insert unittest

Issue: milvus-io#22837

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request May 30, 2024
…ilvus2.4 (#33391)

Cherry pick from master
pr: #33064 #33101 #33187 #33259 #33224
#33064 Support readable JSON file import for
Float16/BFloat16/SparseFloat
  #33101 Store SparseFloatVector into parquet as JSON string
  #33187 Fix SparseFloatVector data parse error for parquet
  #33259 Fix SparseFloatVector data parse error for json
  #33224 Optimize bulk insert unittest

Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/bug Issues or changes related a bug lgtm size/L Denotes a PR that changes 100-499 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants