Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] AI video prototype #2959

Draft
wants to merge 131 commits into
base: master
Choose a base branch
from
Draft

[WIP] AI video prototype #2959

wants to merge 131 commits into from

Commits on Mar 25, 2024

  1. Configuration menu
    Copy the full SHA
    3ede48f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    6f29698 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e2735cd View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    8883824 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    92bfa74 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    be72c37 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    7cd7913 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    abe1b5a View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    7ec59b3 View commit details
    Browse the repository at this point in the history
  10. mod: Bump go-tools to v0.3.5

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    1822db5 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    52785b2 View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    332ecbd View commit details
    Browse the repository at this point in the history
  13. Configuration menu
    Copy the full SHA
    14deb6a View commit details
    Browse the repository at this point in the history
  14. Configuration menu
    Copy the full SHA
    289cb49 View commit details
    Browse the repository at this point in the history
  15. temp disable CI tests

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    48f560c View commit details
    Browse the repository at this point in the history
  16. ci+docker: Use go1.21.5

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    24c1623 View commit details
    Browse the repository at this point in the history
  17. docker: Install zlib

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    d60b801 View commit details
    Browse the repository at this point in the history
  18. temp disable CI arm64 builds

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    b49d503 View commit details
    Browse the repository at this point in the history
  19. Configuration menu
    Copy the full SHA
    27c8da1 View commit details
    Browse the repository at this point in the history
  20. Configuration menu
    Copy the full SHA
    0adf0b6 View commit details
    Browse the repository at this point in the history
  21. cmd: Add -aiModelsDir flag

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    d894ee8 View commit details
    Browse the repository at this point in the history
  22. Configuration menu
    Copy the full SHA
    d1af6e2 View commit details
    Browse the repository at this point in the history
  23. Configuration menu
    Copy the full SHA
    1759f35 View commit details
    Browse the repository at this point in the history
  24. mod+cmd: Bump ai-worker

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    e089c10 View commit details
    Browse the repository at this point in the history
  25. server: Check JSON200 from O

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    857ee5f View commit details
    Browse the repository at this point in the history
  26. Configuration menu
    Copy the full SHA
    3fcc300 View commit details
    Browse the repository at this point in the history
  27. mod: Bump ai-worker

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    d6d4261 View commit details
    Browse the repository at this point in the history
  28. Configuration menu
    Copy the full SHA
    19da59d View commit details
    Browse the repository at this point in the history
  29. Configuration menu
    Copy the full SHA
    7d765d6 View commit details
    Browse the repository at this point in the history
  30. Configuration menu
    Copy the full SHA
    9985d5f View commit details
    Browse the repository at this point in the history
  31. mod: Bump ai-worker

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    2ecaaab View commit details
    Browse the repository at this point in the history
  32. Configuration menu
    Copy the full SHA
    dafefd1 View commit details
    Browse the repository at this point in the history
  33. Configuration menu
    Copy the full SHA
    c35735c View commit details
    Browse the repository at this point in the history
  34. mod: Bump ai-worker

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    9521fcb View commit details
    Browse the repository at this point in the history
  35. Configuration menu
    Copy the full SHA
    9f5792a View commit details
    Browse the repository at this point in the history
  36. Configuration menu
    Copy the full SHA
    924c712 View commit details
    Browse the repository at this point in the history
  37. Configuration menu
    Copy the full SHA
    209ec48 View commit details
    Browse the repository at this point in the history
  38. Configuration menu
    Copy the full SHA
    04c751c View commit details
    Browse the repository at this point in the history
  39. Configuration menu
    Copy the full SHA
    9f47d4e View commit details
    Browse the repository at this point in the history
  40. mod: Bump livepeer/ai-worker

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    0b31700 View commit details
    Browse the repository at this point in the history
  41. mod: Bump livepeer/ai-worker

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    c5427d7 View commit details
    Browse the repository at this point in the history
  42. Configuration menu
    Copy the full SHA
    5e73dcb View commit details
    Browse the repository at this point in the history
  43. Configuration menu
    Copy the full SHA
    c22f398 View commit details
    Browse the repository at this point in the history
  44. Configuration menu
    Copy the full SHA
    579a31d View commit details
    Browse the repository at this point in the history
  45. mod: Bump livepeer/ai-worker

    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    f82c014 View commit details
    Browse the repository at this point in the history
  46. Configuration menu
    Copy the full SHA
    a61818b View commit details
    Browse the repository at this point in the history
  47. Configuration menu
    Copy the full SHA
    3d77eed View commit details
    Browse the repository at this point in the history
  48. core: Use software transcoder for image-to-video

    Temp fix for sporadic CUDA operation not permitted errors with nvidia
    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    f2bc443 View commit details
    Browse the repository at this point in the history
  49. Configuration menu
    Copy the full SHA
    8cc7430 View commit details
    Browse the repository at this point in the history
  50. server: Add AISessionManager

    For managing the sessions per AI capability + model ID in a way that is compatible with existing broadcast session code
    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    f583d93 View commit details
    Browse the repository at this point in the history
  51. Configuration menu
    Copy the full SHA
    e122757 View commit details
    Browse the repository at this point in the history
  52. server: Remove check for deprecated seg data profiles

    This should no longer be needed because the field is deprecated
    yondonfu committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    a2b194e View commit details
    Browse the repository at this point in the history
  53. Configuration menu
    Copy the full SHA
    13f5637 View commit details
    Browse the repository at this point in the history
  54. Configuration menu
    Copy the full SHA
    a77f0a0 View commit details
    Browse the repository at this point in the history
  55. Configuration menu
    Copy the full SHA
    f8ef935 View commit details
    Browse the repository at this point in the history
  56. Configuration menu
    Copy the full SHA
    0e4d35a View commit details
    Browse the repository at this point in the history
  57. Configuration menu
    Copy the full SHA
    f698708 View commit details
    Browse the repository at this point in the history
  58. Configuration menu
    Copy the full SHA
    bd12e99 View commit details
    Browse the repository at this point in the history
  59. docs(ai): add AI subnet orch setup guide

    This commit adds detailed instructions for setting up an
    orchestrator on the AI Subnet.
    rickstaa committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    a818a61 View commit details
    Browse the repository at this point in the history
  60. docs(ai): add ai subnet broadcaster instructions

    This commit adds detailed instructions for setting up an
    broadcaster on the AI Subnet.
    rickstaa committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    b3fdf31 View commit details
    Browse the repository at this point in the history
  61. docs(ai): enhance AI Subnet documentation with binary installation guide

    This commit refines the AI Subnet documentation and introduces instructions for
    utilizing the prebuilt AI Subnet binaries.
    rickstaa committed Mar 25, 2024
    Configuration menu
    Copy the full SHA
    f13b8b0 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. docs(ai): improve ai subnet documentation

    This commit improves the AI subnet documentation by adding some missing
    steps and improved unclear steps. Special thanks to @Pon-node for
    walking through the documentation as I could code along and improve it.
    
    Co-authored-by: Pon <94224680+Pon-node@users.noreply.github.com>
    rickstaa and Pon-node committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    43f4166 View commit details
    Browse the repository at this point in the history
  2. docs(ai): fix broken huggingface documentation link

    This commit fixes a broken huggingface documentation link.
    
    Co-authored-by: papabear99 <89408276+papabear99@users.noreply.github.com>
    rickstaa and papabear99 committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    be3afe8 View commit details
    Browse the repository at this point in the history
  3. docs(ai): fix broken 'dl_checkpoint' command

    This commit fixes the broken `dl_checkpoints.sh` run command found in
    the documentation.
    
    Co-authored-by: papabear99 <89408276+papabear99@users.noreply.github.com>
    rickstaa and papabear99 committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    c7130b4 View commit details
    Browse the repository at this point in the history

Commits on Mar 28, 2024

  1. docs(ai): enhance clarity and accuracy of AI subnet docs

    This commit refines the AI subnet documentation to address ambiguities
    and inaccuracies identified during our initial pilot with **pre-alpha**
    participants. The improvements aim to provide clearer instructions and
    correct information for a smoother user experience.
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    732bf36 View commit details
    Browse the repository at this point in the history
  2. docs(ai): improve model configuration documentation

    This commit explaines the parameters found in the `aiModels.json` file.
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    6895dca View commit details
    Browse the repository at this point in the history
  3. docs(ai): add instructions for on-chain configuration of AI Subnet Or…

    …chestrator
    
    This commit introduces comprehensive instructions for setting up the AI
    Subnet Orchestrator for on-chain operation. It includes both binary and
    Docker setup methods.
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    a8346e4 View commit details
    Browse the repository at this point in the history
  4. docs(ai): improve AI on-chain instructions

    This commit restructures the AI on-chain instructions to make them
    easier to follow.
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    f5bb8c2 View commit details
    Browse the repository at this point in the history
  5. docs(ai): improve ai docs syntax

    This commit applies some small syntax changes to the ai documentation to
    improve readability.
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    16edc6e View commit details
    Browse the repository at this point in the history
  6. Merge pull request #2987 from livepeer/improve_ai_docs_text

    docs(ai): improve ai docs syntax
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    3a14fb1 View commit details
    Browse the repository at this point in the history
  7. docs(ai): add promtail metrics sending docs

    This commit adds some documentation on how people can **opt-in** to send
    us data about their AI Subnet Orchestrator.
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    07ec545 View commit details
    Browse the repository at this point in the history
  8. docs(ai): update volume mount config for promtail

    This update modifies the volume mount for the promptail docker container
    to remove the ai_subnet_promtail.yml file, addressing issues reported by
    several users with the previous promtail docker configuration.
    rickstaa committed Mar 28, 2024
    Configuration menu
    Copy the full SHA
    bced6be View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. docs(ai): name docker containers

    This commit ensures that people use named docker containers. This will
    help us monitor their metrics when they decide to share them.
    rickstaa committed Mar 29, 2024
    Configuration menu
    Copy the full SHA
    5e26f41 View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2024

  1. Configuration menu
    Copy the full SHA
    77b9a48 View commit details
    Browse the repository at this point in the history
  2. docs(ai): improve models config descriptiona and add ticketEV param

    This commit improves the description of the `warm` configuration value
    and add the `ticketEV` flag to the Livepeer command line arguments to
    prevent the `too many values` error from occuring. This error is thrown
    because the current software does not allow sending more than 150
    tickets in one batch.
    rickstaa committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    ab40d04 View commit details
    Browse the repository at this point in the history
  3. docs(ai): improve cli description and remove redeemer method

    This commit ensures it is clear that the redeemer is not recommended
    when setting up a AI subnet orchestrator. It also explains that the
    `pricePerUnit` flag is not needed for the AI subnet orchestrator.
    rickstaa committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    aa706dc View commit details
    Browse the repository at this point in the history
  4. docs(ai): add command outputs

    This commit ensures that users know which output to expect when they run
    the commands in the documentation:
    rickstaa committed Apr 5, 2024
    Configuration menu
    Copy the full SHA
    0e6be96 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2024

  1. docs(ai): add AI subnet orch setup guide

    This commit adds the initial draft for the AI subnet onboarding documentation.
    rickstaa committed Apr 8, 2024
    Configuration menu
    Copy the full SHA
    9db7a1b View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. ci(ai): add AI issue templates

    This commit introduces two new AI-specific issue templates, aiming to streamline
    the routing of AI subnet-related issues and feature requests to the appropriate team.
    rickstaa committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    0ed61b8 View commit details
    Browse the repository at this point in the history
  2. ci(ai): add AI pull request labeler

    This commit adds a pull request labeler action that automatically
    attaches the `ai` label when a pull request is created to the `ai-video`
    branch.
    rickstaa committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    f76726d View commit details
    Browse the repository at this point in the history
  3. ci: change issue template order

    This commit ensures that the main branch issue templates are put above
    the AI related issue templates.
    rickstaa committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    065edbc View commit details
    Browse the repository at this point in the history
  4. ci(ai): add PR labeler config file

    This commmit adds a https://github.com/actions/labeler configuration
    file so that all PRs on the `ai-video` branch will be correctly labeled
    with the `ai` label.
    rickstaa committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    1019d42 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. ci(ai): fix incorrect labels

    This commit fixed the labels that were specified in the Issue Templates
    to the one found in the repository.
    rickstaa committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    af6186f View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    51406be View commit details
    Browse the repository at this point in the history
  3. feat(ai): add pipelines optimization flags (#3013)

    * feat(ai): add pipelines optimization flags
    
    This commit adds a new `OptimizationFlags` field to the `aiModels`
    config so that users can forward optimization environment variables to
    the [ai-worker](git@github.com:livepeer/ai-worker.git) for more
    information see livepeer/ai-worker#61.
    
    * chore: update ai-worker to latest commit
    
    This commit ensures that the https://github.com/livepeer/ai-worker
    dependency is on the latest commit that includes the new optimization
    flags feature (see livepeer/ai-worker#61).
    
    * refactor: improve OptFlags logging
    
    This commit ensures that the `optimzation flag not supported` warning
    is shown for each model that is not loaded warm.
    rickstaa committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    9502ea0 View commit details
    Browse the repository at this point in the history
  4. docs(ai): add optimization flags to docs (#3014)

    This commit adds a new section explaining the new `optimization_flags` that were enabled
    #3013.
    rickstaa committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    cea4e94 View commit details
    Browse the repository at this point in the history
  5. ci(ai): temporary change build action branch to ai-video

    This commit temporary changes the push branch of the `build.yml` to the
    `ai-video` branch since the `ai-video` branch has conflicts with the
    `master` branch preventing the containers to be build.
    rickstaa committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    bc629b7 View commit details
    Browse the repository at this point in the history
  6. ci(ai): temporary change docker action branch to ai-video

    This commit temporary changes the push branch of the `docker.yml` to the
    `ai-video` branch since the `ai-video` branch has conflicts with the
    `master` branch preventing the containers to be build.
    rickstaa committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    6aa0b00 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. ci(ai): fix pull request config warning (#3018)

    This commit gets rid of the Pull request labeler configuration file
    warning.
    rickstaa committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    cecd3a5 View commit details
    Browse the repository at this point in the history
  2. fix: flush writer when encoding AI results (fix invalid PNG) (#3020)

    This commit flushes the data in the image writer to ensure that all data gets written to the PNG.
    stronk-dev committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    2a782ed View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    e1db239 View commit details
    Browse the repository at this point in the history
  4. ci(ai): run labeler also on 'pull_request_target'

    This commit ensures that the labeler action also runs on a
    'pull_request_target' to ensure pull requests from forks are correctly
    labeled.
    rickstaa committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    1643a1e View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    5bb92fa View commit details
    Browse the repository at this point in the history
  6. ci(ai): auto assign AI issues and feature requests

    This commit ensures that all AI related issues and feature requests are
    assigned to the AI team.
    rickstaa committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    23fdfcb View commit details
    Browse the repository at this point in the history
  7. feat(ai): enable AI orchestrator discovery (#3004)

    * feat(ai): enable AI orchestrator discovery
    
    This commit incorporates the AIServiceRegistry contract address,
    superseding the conventional ServiceRegistry contract address. This
    strategic alteration streamlines the discovery process of AI Orchestrators
    within the AI Subnet, thereby bolstering network accessibility and interaction.
    While this approach serves as a swift workaround to enable the feature without
    extensive code modification, it's important to note that it may disrupt the
    existing transcoding discovery mechanism. We have to fix this if we want to
    merge the two networks in the future.
    
    * docs(ai): improve discovery documentation
    
    This commit ensures that people are aware that they have to interact
    with the `AIServiceRegistry` using their main Orch wallet.
    
    * fix: fix 'AIServiceRegistry' devnet and testnet issue
    
    This commit ensure that the hardcoded `AIServiceRegistry` contract
    doesn't break the go-livepeer binary on local devnets or testnets.
    rickstaa committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    e9258f3 View commit details
    Browse the repository at this point in the history

Commits on Apr 20, 2024

  1. refactor(ai): add extra devtool input arguments (#3026)

    This commit adds extra devtool input arguments allowing developers to
    spin up multiple Os on the ETH devnet.
    rickstaa committed Apr 20, 2024
    Configuration menu
    Copy the full SHA
    bfccbc4 View commit details
    Browse the repository at this point in the history
  2. chore: improve devtool documentation and add scripts

    This commit improves the devtool documentation and adds a helpful script
    if developers want to create multiple Os at the same time.
    rickstaa committed Apr 20, 2024
    Configuration menu
    Copy the full SHA
    865314d View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2024

  1. refactor: log advertised capabilities and price on startup (#3031)

    This commit logs the advertised capabilities and price on startup if users have their logging verbosity level set to 6 or higher.
    eliteprox committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    ea82cde View commit details
    Browse the repository at this point in the history
  2. feat(ai): enforce 'aiModels' flag requirement (#3032)

    This commit ensures that an error is thrown when users don't specify
    the 'aiModels' flag but have the 'aiWorker' flag set.
    rickstaa committed Apr 24, 2024
    Configuration menu
    Copy the full SHA
    93caa3b View commit details
    Browse the repository at this point in the history

Commits on May 2, 2024

  1. fix(ai): improve AI selection algorithm (#3030)

    * fix(ai): improve selection algorithm
    
    This commit modifies the selection algorithm to continue retrying for a
    duration of one second instead of stopping after four attempts. This
    change addresses issues encountered with the current algorithm's
    performance in environments with 15 nodes on the network, ensuring more
    robust and reliable operation until further optimizations can be
    implemented.
    
    * refactor(ai): enhance selection algorithm retry logic
    
    This commit replaces the time-based for-loop in the selection
    algorithm's retry logic with a more context-aware approach.
    rickstaa committed May 2, 2024
    Configuration menu
    Copy the full SHA
    bbda633 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2024

  1. refactor(ai): improve orch select retry ctx logic (#3039)

    This commit refines context handling in the orchestrator selection loop for
    idiomatic Go and enhanced propagation of parent cancellations.
    rickstaa committed May 3, 2024
    Configuration menu
    Copy the full SHA
    72dced7 View commit details
    Browse the repository at this point in the history
  2. refactor(ai): improve orch retry timeout msg

    This commit improves the orchestrator selection retry ctx timeout msg.
    rickstaa committed May 3, 2024
    Configuration menu
    Copy the full SHA
    6fc1afd View commit details
    Browse the repository at this point in the history
  3. fix(ai): prevent insufficient capacity payments (#3035)

    * fix(ai): handle insufficient capacity payments
    
    This commit enhances the Orchestrator's capacity handling by returning
    an error prior to processing payments when capacity is insufficient.
    This prevents that the Gateway overpays for requests.
    
    * chore(ai): update ai-worker dependency
    
    This commit updates the ai-worker dependency to the latest version.
    rickstaa committed May 3, 2024
    Configuration menu
    Copy the full SHA
    a0448d4 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2024

  1. ci(ai): add temporary ai-video latest binary url upload

    This commit ensures that the `upload_build.sh` script uploads the latest
    binary that is deployed to the `ai-video` branch under one url. This is
    done to simplify binary installation.
    rickstaa committed May 4, 2024
    Configuration menu
    Copy the full SHA
    fb9764b View commit details
    Browse the repository at this point in the history
  2. chore(ai): remove temporary AI subnet docs

    This commit removes the tempoary AI subnet docs now that the final docs
    have been deployed on https://docs.livepeer.ai/ai/introduction.
    rickstaa committed May 4, 2024
    Configuration menu
    Copy the full SHA
    40a40a5 View commit details
    Browse the repository at this point in the history
  3. fix(ai): fix infinite loop when no Os are found (#3042)

    This commit prevents the orchestrator selection go routine from staying in a infinite loop when no Orchestrators can be found.
    rickstaa committed May 4, 2024
    Configuration menu
    Copy the full SHA
    ebd5045 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2024

  1. feat(ai): Enhance orchestrator selection by incorporating latency (#3043

    )
    
    This commit introduces latency consideration into the orchestrator
    selection process, addressing two key issues. Firstly, it resolves a
    minor bug where the algorithm consistently selected known orchestrators
    due to a condition that never evaluated to true (see [this
    condition](https://github.com/livepeer/go-livepeer/blob/1239b4e56133003fe6a98a863cce6bdd6b5f2532/server/selection.go#L110)).
    Secondly, this change ensures that, once all orchestrators have been
    evaluated, the one with the fastest response time for a specific job is
    chosen. While the current method for calculating latency is somewhat
    basic, it sets the foundation for more sophisticated enhancements in the
    future.
    
    Co-authored-by: Brad P <0xb79orch@gmail.com>
    rickstaa and ad-astra-video committed May 6, 2024
    Configuration menu
    Copy the full SHA
    dfb4320 View commit details
    Browse the repository at this point in the history

Commits on May 13, 2024

  1. chore(ai): update 'ai-worker' dependency

    This commit updates the 'ai-worker' dependency to the latest commit.
    rickstaa committed May 13, 2024
    Configuration menu
    Copy the full SHA
    45cf167 View commit details
    Browse the repository at this point in the history
  2. feat: add '-gateway' and deprecate '-broadcaster' (#3048)

    This commit adds the `gateway` flag and deprecates the `broadcaster` flag per core team decision (details: https://discord.com/channels/423160867534929930/1051963444598943784/1210356864643109004).
    eliteprox committed May 13, 2024
    Configuration menu
    Copy the full SHA
    180041d View commit details
    Browse the repository at this point in the history
  3. feat: remove -pricePerUnit requirement for -aiWorker flag (#3047)

    * Remove -pricePerUnit requirement for orchestrator with -AIWorker flag
    
    * refactor: add PricePerUnit comment
    
    This commit reintroduces the previously omitted comment for the
    PricePerUnit variable, improving code readability and maintainability.
    
    * refactor: simplify PricePerUnit flag check condition
    
    This commit simplifies the conditional check used to check if the
    `PricePerUnit` flag is needed.
    
    ---------
    
    Co-authored-by: Rick Staa <rick.staa@outlook.com>
    eliteprox and rickstaa committed May 13, 2024
    Configuration menu
    Copy the full SHA
    c18d325 View commit details
    Browse the repository at this point in the history

Commits on May 14, 2024

  1. perf(ai): update ai-worker to enable DEEPCACHE optimization

    This commit updates the https://github.com/livepeer/ai-worker to the
    latest version so that Orchestrators can enable the
    [DeepCache](https://github.com/horseee/DeepCache) optimization. This
    optimization will provide a 50% speedup for multi-step inference
    requests.
    rickstaa committed May 14, 2024
    Configuration menu
    Copy the full SHA
    ee787ea View commit details
    Browse the repository at this point in the history

Commits on May 15, 2024

  1. chore: fix Mockgen dependency error

    This commit ensures that the global
    https://pkg.go.dev/github.com/golang/mock/Mockgen package is correctly
    found when the binary is built using the makescript.
    rickstaa committed May 15, 2024
    Configuration menu
    Copy the full SHA
    d5f5e1c View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    62acd4a View commit details
    Browse the repository at this point in the history
  3. feat(ai): enable NSFW safety filter (#3054)

    This commit enables the NSFW filter on the AI Subnet that has been
    implement at the runner side in
    livepeer/ai-worker#76.
    
    BREAKING CHANGE: Depending on how dApps interact with the subnet this
    could be a breaking change given that we return an extra `nsfw`
    property.
    rickstaa committed May 15, 2024
    Configuration menu
    Copy the full SHA
    816920a View commit details
    Browse the repository at this point in the history

Commits on May 17, 2024

  1. chore(ai): update ai-worker version

    This commit updates the ai-worker so that the right go bindings are
    available and no nil errors are thrown.
    rickstaa committed May 17, 2024
    Configuration menu
    Copy the full SHA
    fc51f04 View commit details
    Browse the repository at this point in the history
  2. ci(ai): ensure livepeer builder builds on AI version tags

    This commit ensures that the livepeer builder is triggered when AI-version tags
    are used (e.g., `v0.7.2-ai-video-1`).
    rickstaa committed May 17, 2024
    Configuration menu
    Copy the full SHA
    f9aa0c1 View commit details
    Browse the repository at this point in the history
  3. fix: apply runner nil error fix (#3058)

    This commit ensures that the ai-worker is up to date so that no `nil`
    pointer runtime error is thrown when the runner container returns a
    empty response.
    rickstaa committed May 17, 2024
    Configuration menu
    Copy the full SHA
    9584c3c View commit details
    Browse the repository at this point in the history

Commits on May 20, 2024

  1. refactor(census): rename Broadcaster metrics to Gateway (#3055)

    * refactor(census): rename Broadcaster metrics to Gateway
    
    This commit renames the metrics related to Broadcaster to Gateway, following
    a team decision. More details can be found in the discussion
    here:
    [Team Discussion Link](.com/channels/423160867534929930/1051963444598943784/1210356864643109004).
    
    * chore: update pending changelog
    rickstaa committed May 20, 2024
    Configuration menu
    Copy the full SHA
    add7368 View commit details
    Browse the repository at this point in the history
  2. refactor: add -pricePerGateway and deprecate -pricePerBroadcaster (#3061

    )
    
    This commit adds the `pricePerGateway` flag and deprecates the
    `pricePerBroadcaster` flag
    per core team decision (details:
    https://discord.com/channels/423160867534929930/1051963444598943784/1210356864643109004).
    rickstaa committed May 20, 2024
    Configuration menu
    Copy the full SHA
    35db3f2 View commit details
    Browse the repository at this point in the history
  3. ci: Protect Docker 'stable' tag

    This commit introduces a safeguard to ensure that the Docker image
    tagged
    as 'stable' is only pushed when a new tag is created on the stable
    branch.
    This prevents unintended updates to the stable Docker image, ensuring
    consistency and reliability for users relying on the stable tag.
    rickstaa committed May 20, 2024
    Configuration menu
    Copy the full SHA
    55185db View commit details
    Browse the repository at this point in the history
  4. ci: fix syntax error in Docker action tags

    This commit addresses a syntax error in the Docker image tag creation
    step.
    rickstaa committed May 20, 2024
    Configuration menu
    Copy the full SHA
    2b8478d View commit details
    Browse the repository at this point in the history
  5. fix(ai): fix runtime error in aiWorker when pricePerUnit is unset (#3059

    )
    
    * Fix nil baseprice when pricePerUnit is unused in aiWorker
    
    * fix: fix priceInfo 'nil' error on discovery
    
    This commit ensures that when the `transcodePrice` is not set by the AI
    orchestrator no `nil` error is thrown when a Gateway requests the
    orchestrators OrchInfo.
    
    * fix(ai): fix incorrect transcodePrice condition
    
    This commit fixes the check that is performed to check if transcodePrice
    is set.
    
    ---------
    
    Co-authored-by: Rick Staa <rick.staa@outlook.com>
    eliteprox and rickstaa committed May 20, 2024
    Configuration menu
    Copy the full SHA
    03b64fb View commit details
    Browse the repository at this point in the history
  6. fix(ai): fix cli prices nil error (#3063)

    This commit ensures that the livepeer_cli does not throw a `nil` error
    when it tries to retrieve the orchestrator base price.
    rickstaa committed May 20, 2024
    Configuration menu
    Copy the full SHA
    b7a9fb7 View commit details
    Browse the repository at this point in the history

Commits on May 21, 2024

  1. feat: add -aiRunnerImage flag to pin docker image ver (#3064)

    This commit allows orchestrators to pin the https://hub.docker.com/r/livepeer/ai-runner image, preventing disruptions from breaking changes in the latest tag.
    eliteprox committed May 21, 2024
    Configuration menu
    Copy the full SHA
    6843eda View commit details
    Browse the repository at this point in the history
  2. chore(ai): update ai-worker dependency

    This commit updates the https://github.com/livepeer/ai-worker to the
    latest commit.
    rickstaa committed May 21, 2024
    Configuration menu
    Copy the full SHA
    4382fbe View commit details
    Browse the repository at this point in the history

Commits on May 29, 2024

  1. ci(docker): ensure stable tag is created on master branch

    This commit ensures that the stable tag is created on the master branch.
    rickstaa committed May 29, 2024
    Configuration menu
    Copy the full SHA
    570a00b View commit details
    Browse the repository at this point in the history

Commits on May 31, 2024

  1. feat: ai video add safety check to image to video 2 (#3071)

    * add safety check to image-to-video input image
    
    * refactor(ai): improve code syntax
    
    This commit improves the code syntax by making the output format
    generation step consistent between pipelines. It also updates the
    ai-worker to the latest version.
    
    ---------
    
    Co-authored-by: Brad P <0xb79orch@gmail.com>
    rickstaa and ad-astra-video committed May 31, 2024
    Configuration menu
    Copy the full SHA
    aa8ae45 View commit details
    Browse the repository at this point in the history

Commits on Jun 4, 2024

  1. chore(ai): update ai-worker version

    This commit updates the ai-worker dependency to the latest version (i.e.
    v0.0.4).
    rickstaa committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    6159a84 View commit details
    Browse the repository at this point in the history
  2. chore(ai): update ai-worker to v0.0.5

    This commit updates the AI worker to v0.0.5 so that people can use the
    new I2I pix2pix model.
    rickstaa committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    bd34a1d View commit details
    Browse the repository at this point in the history
  3. chore(ai): update ai-worker to latest version

    This commit updates the ai-worker to the latest version (i.e. v0.0.6) in
    order to fix a syntax error that was introduced due to an upstream
    dependency in v0.0.4 and v0.0.5.
    rickstaa committed Jun 4, 2024
    Configuration menu
    Copy the full SHA
    6f9426b View commit details
    Browse the repository at this point in the history

Commits on Jun 5, 2024

  1. feat(ai): account for num_inference_steps inT2I latency inference sco…

    …re calculation (#3074)
    
    * fix(ai): Fix accuracy of T2I latency score when num_inference_steps provided
    
    * refactor(ai): update numInferenceSteps default
    
    This commit ensures that the same numInferenceSteps default value is
    used as the one set in
    https://github.com/livepeer/ai-worker/blob/31fe460a45e1d9e908d3a1bdcfdd8822c3889214/runner/app/routes/text_to_image.py#L28.
    
    ---------
    
    Co-authored-by: Elite Encoder <john@eliteencoder.net>
    rickstaa and eliteprox committed Jun 5, 2024
    Configuration menu
    Copy the full SHA
    6535844 View commit details
    Browse the repository at this point in the history