I’ve just discovered OmniGPT that seems to be a chat where you can interact with different LLM (Claude, GPT-4, Llama, Gemini, etc.) and costs $16/month (it was $7/month until a week ago 🤦♂️). I’ve read on a Reddit post that it uses the APIs of all the provider that is a thing that can be done for free using a personal account (since the API limit seems to be high). Do you know something like OminGPT that can be self hosted that uses users API keys?
Text-generation-webui my friend
That seems to need the AI model to be local
Oh yes, maybe I misunderstood what you were asking. This is the server that will host the models and the API, it also has a nice interface.
You can then use other apps to connect with it. That’s what I consider self hosting, hosting the whole thing soup to nuts
What I’m looking for is a frontend that uses GTP-4, Gemini and other AI engine with their respective APIs keys.
Yeah, using “self hosted” in your title is misleading.
But I will…self host this service!
you want a frontend, not the “service” itself.
Under “service” i usually understand the main logic part of something. In this case the LLM-processing itself.
Thats probably where the confusion is coming from here.It’s still self hosted! 🤷🏻♂️
I think KoboldAI Lite is what you ask for. I’m not sure how it works, but it seems to be able to use OpenAI, Claude, Gemini, Horde and OpenRouter.
I think this is the repo for the website: https://github.com/LostRuins/lite.koboldai.net
I believe Librechat would achieve your goals, but you’d need a PC or server to host it in. It supports all major API.
Kobold light might with as well, and doesn’t need to be hosted locally, but I don’t think it supports Claude haiku specifically, for unknown reasons.
Additionally, the official Claude api workshop is pretty good on desktop, but it only supports Claude.