Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: MetaNode support rocksdb store mode #3350

Open
1 task done
NaturalSelect opened this issue Apr 24, 2024 · 1 comment · May be fixed by #3397
Open
1 task done

[Feature]: MetaNode support rocksdb store mode #3350

NaturalSelect opened this issue Apr 24, 2024 · 1 comment · May be fixed by #3397
Assignees
Labels
enhancement New feature or request

Comments

@NaturalSelect
Copy link
Collaborator

Contact Details

huangzhibin1@oppo.com

Is there an existing issue for this?

  • I have searched all the existing issues

Is your feature request related to a problem? Please describe.

Rocksdb is a popular key-value database, and has been widely used in many fields.

Supports rocksdb storage mode, so we can place metadata on disk and reduce the cost of the metadata subsystem.

Describe the solution you'd like.

  • Each disk own a rocksdb instance, so we can share block cahce and write buffer. Using prefix key to isolate different meta partitions.
  • Support migrate a memory meta partition(replica) to rocksdb meta partition.
  • Refactor behavior of extent deletion, use a new kind of tree to store deleted extent data.
  • Monitor available space of each disk and report it to master, adjust our node and nodeset selector to support disk space based meta partition placement.
  • Support configurate default meta partition store mode of volume.

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

@leonrayang
Copy link
Member

be include in 2024 roadmap

@NaturalSelect NaturalSelect linked a pull request May 23, 2024 that will close this issue
28 tasks
@NaturalSelect NaturalSelect linked a pull request May 29, 2024 that will close this issue
28 tasks
@NaturalSelect NaturalSelect linked a pull request May 29, 2024 that will close this issue
28 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
3 participants