Skip to content

Add support for specifying custom OpenAI uri base#29

Open
dbreunig wants to merge 2 commits intoobie:mainfrom
dbreunig:openai_uri_base
Open

Add support for specifying custom OpenAI uri base#29
dbreunig wants to merge 2 commits intoobie:mainfrom
dbreunig:openai_uri_base

Conversation

@dbreunig
Copy link

This PR adds support for passing a custom endpoint to the OpenAI model class.

Desiru::Models::OpenAI.new(api_key: ENV['OPENAI_API_KEY'], uri_base: "http://127.0.0.1:1234")

This allows for users to call OpenAI compatible endpoints (OpenRouter, TogetherAI, LM Studio).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant