Requesting opensource and other free LLM api intregation

[AnnNaserNabil]

Hello, thank you for the nice work and effort. I am wondering if it is possible to integrate it with google gemini and other opensource llm models

[arcaela]

For a free LLM API option, Arko Studio (https://arko.arcaelas.com) might be worth considering. It provides OpenAI-compatible endpoints (just change the base_url), supports streaming and tool calling, and offers free API keys without requiring a credit card.

Since the project already uses the OpenAI SDK format, integration would be minimal — just swap the base URL and API key.