Skip to content

add serve cmd #4

@d0w

Description

@d0w

Add a cobra command to start the serving runtime (vllm in this case) instead of having it automatically be started when the binary is run. The use should be able to run edgellm serve vllm and start the server and edgellm stop vllm to stop the server. This also involves moving over all the flags users can input to the new command. look at the runner internal package to see how the backend server starts.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions