Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FR] Median aggregation #968

Open
2 of 4 tasks
loomlike opened this issue Jan 14, 2023 · 0 comments
Open
2 of 4 tasks

[FR] Median aggregation #968

loomlike opened this issue Jan 14, 2023 · 0 comments
Labels
feature New feature or request

Comments

@loomlike
Copy link
Collaborator

Willingness to contribute

No. I cannot contribute a bug fix at this time.

Feature Request Proposal

Median is a statistically important value and oftentimes it makes more sense to use Med over Avg.
In spark, you can compute that via F.expr('percentile_approx(val, 0.5)').

It would be nice to support MED in addition to the existing aggregation methods Feathr supports like SUM, COUNT, MAX, MIN, AVG.

Motivation

What is the use case for this feature?

Example: last week's purchase amount (per day): [$1, $1, $1, $1, $1, $1, $100]
Avg = $15.14
Med = $1

Details

No response

What component(s) does this feature request affect?

  • Python Client: This is the client users use to interact with most of our API. Mostly written in Python.
  • Computation Engine: The computation engine that execute the actual feature join and generation work. Mostly in Scala and Spark.
  • Feature Registry API: The frontend API layer supports SQL, Purview(Atlas) as storage. The API layer is in Python(FAST API)
  • Feature Registry Web UI: The Web UI for feature registry. Written in React
@loomlike loomlike added the feature New feature or request label Jan 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant