Bounty: 2,500,000 kudos for ipadapter and new controlnets

[Efreak]

Conditions for getting bounty:

• Get a PR(s) adding ipadapter and new controlnet features to both the API and the worker. This probably requires working with Tazlin and/or db0 when they're available for things like code quality, how it works with api (is it a controlnet model? That might depend on whether it can be used alongside other controller models. Probably not, as it can take multiple images for input), etc
• Tazlin or db0 signs off that you deserve the bounty (I'm trying not to give them extra work while they're working on other stuff)
• includes necessary tests and other functionality deemed necessary by the developers

Required features:

• new official controlnet1.1 models
• Either the regular or lightweight ipadapter models for both SDXL and sd15
• the API routes requests properly
• the worker deals with requests properly
• worker configuration key
• see project 15 to track across the different horde repos.

Desired features (not required):

• consider controlnet-lllite and other community controlnet models (I have no idea how well they work)
• all 8 sd15/SDXL ipadapter models.
• don't download controlnet models that aren't needed. Eg. If you're only loading SDXL models, sd15 controlnet wouldn't be downloaded.
• make it easier to get future controlnet models on Horde. (Assuming this actually means something)

Bounty:

• 150k from Efreak
• 150k from ResidentChiefNZ (via efreak)
• 200k from Bluefish
• 50k from dreamy
• 500k kudos(!) from TheUnamusedFox
• 100k from superintendent
• 100k from kenupCF
• bigblue is matching everything
• ??? Kudos from you?

Related: #297 Haidra-Org/AI-Horde-Worker#202

Discussion on Horde Discord is here. The discord post and this thread may not be in sync; if you want to increase bounty, please ensure we have your Horde Username (eg I'm Anonymous Derpling#11915, you should be able to get this from most UIs, including ArtBot, Stable-UI or the discord bot)