Skip to content

docs: add modal-gpu-ez integration#2935

Open
algocean (algocean1204) wants to merge 2 commits intolangchain-ai:mainfrom
algocean1204:docs/add-modal-gpu-ez-integration
Open

docs: add modal-gpu-ez integration#2935
algocean (algocean1204) wants to merge 2 commits intolangchain-ai:mainfrom
algocean1204:docs/add-modal-gpu-ez-integration

Conversation

@algocean1204
Copy link

Summary

Add documentation for langchain-modal-gpu-ez, a LangChain integration that wraps modal-gpu-ez for running HuggingFace models on Modal serverless GPUs.

Note: This is different from the existing langchain-modal (sandbox). langchain-modal-gpu-ez provides LLM and Embeddings interfaces for direct model inference.

What's added

  • Provider page (providers/modal_gpu_ez.mdx): Overview, installation, setup
  • LLM page (llms/modal_gpu_ez.mdx): ModalGpuEzLLM usage with GPU selection guide
  • Embeddings page (text_embedding/modal_gpu_ez.mdx): ModalGpuEzEmbeddings usage with vector store example

Package features

  • One-liner inference: llm.invoke("Hello") on T4/A100/H100 GPUs
  • Auto GPU selection based on model size
  • Local fallback (CUDA/MPS/CPU) at no cost
  • Built-in cost tracking and budget management

Links

Add documentation for langchain-modal-gpu-ez, a LangChain integration
that provides LLM and Embeddings interfaces for running HuggingFace
models on Modal serverless GPUs.

- Provider overview page
- LLM integration page (ModalGpuEzLLM)
- Embeddings integration page (ModalGpuEzEmbeddings)

PyPI: https://pypi.org/project/langchain-modal-gpu-ez/
@github-actions github-actions bot added external User is not a member of langchain-ai langchain For docs changes to LangChain oss python For content related to the Python version of LangChain projects labels Mar 5, 2026
@algocean1204
Copy link
Author

Hi maintainers! 👋

This is my very first open-source PR, and as a university student, I'm super excited to contribute to the LangChain ecosystem.

Since I'm still learning, I would highly appreciate any direct, realistic, and strict feedback regarding the code structure, conventions, or the overall integration approach. Please don't hold back—I really want to learn and improve this to perfectly match LangChain's standards!

Thank you so much for your time reviewing this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

external User is not a member of langchain-ai langchain For docs changes to LangChain oss python For content related to the Python version of LangChain projects

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant