Skip to content

Use own self-hosted LLM instead of OpenAI API -> Where is the request URL defined? #4

@Elwii04

Description

@Elwii04

Hello, I am working on a Telegram chatbot but want to use my own LLM (Mistral-7b) instead of the OpenAI GPT Models. For that I am using the Oobabooga Text Generation Web-UI with the drop in replacement OpenAI extension.

Using it obviously requires to change the request URL from url: 'https://api.openai.com/v1/completions' to the new one. Sadly I could not find where this URL is defined and so could not change it.

Could you please tell me where and how I can change it?

Also I am looking or a method to not have the "bot" label in the telegram chat.

Thanks for your help <3

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions