Client-side LLM selection, multi-model support

[Aurelius-Huang]

Self Checks

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing?

Yes, our users hope that the client interface can support choosing the LLM they want to use.

2. Describe the feature you'd like to see

It is expected to add the function of selecting LLM next to the input box similar to the chat bar.

3. How will this feature improve your workflow or experience?

We can experience the differences of multiple LLM versions in one Agent and choose the most appropriate LLM for use according to different scenarios.

4. Additional context or comments

No response

5. Can you help us with this feature?

• I am interested in contributing to this feature.

[omesh845]

This is great, 😃 and It would be awesome if we had the same feature via api also.

[perzeuss]

Basic Chatbots are designed to only have one LLM configured. In most cases you'll want it this way because every LLM behaves different and you would have to write and test different instructions.

If you're looking for a ChatGPT alternative with Dify assistants, this would be a different feature. This might come in the future but I think it is a different kind of product.

[Aurelius-Huang]

When using mainstream LLMs such as GPT-3.5, GPT-4, and Cloude-3, we may want to give users multiple choices by providing a single Agent. This is not just for testing, but sometimes for effects and reasons. Considering factors such as cost, you will need to choose the most appropriate model independently.
If each LLM configures an Agent, we will need to configure multiple identical Agents (only the LLM is different).