Python: [Sample Request] Production Chat API with Azure Functions, Cosmos DB & Agent Framework

[vj-msft]

Issue Description

Summary

I'd like to contribute a production-ready chat API sample using Azure Functions, Cosmos DB, and Agent Framework. This complements the existing ChatKit sample by providing a backend microservice instead of UI integration.

Why This Sample?

The ChatKit sample focuses on frontend widgets. This sample shows enterprise teams how to build a scalable backend API that any frontend can consume.

Key Features

• Thread-based conversation management
• Cosmos DB persistence with multi-tenant isolation
• RAG integration with Azure AI Search
• OpenTelemetry + Azure Monitor observability
• REST endpoints consumable by web, mobile, Teams, etc.
• Azure deployment patterns (Azure Functions, azure.yaml)

API Endpoints

`
POST /api/chat/threads # Create thread
GET /api/chat/threads # List threads
POST /api/chat/threads/{id}/messages # Send message (with RAG)
GET /api/chat/threads/{id}/messages # Get history

Sample Structure

chat-service/
├── function_app.py # Azure Functions with blueprints
├── api/ # REST endpoints
├── services/ # Agent service, thread/message logic
├── tools/ # RAG search tools
├── models/ # Thread & message models
└── docs/ # Architecture & deployment guide

Next Steps

If accepted, I can submit a PR with:

• Complete working code
• Setup and deployment documentation
• Configuration templates
• Observability guidance

---

Labels: sample, enhancement, azure, python

[markwallace-microsoft]

Hi @vj-msft, we'd be happy to take this contribution. Having more complex samples is one of the main asks we are receiving.

[eavanvalkenburg]

@vj-msft once #4271 merges, you should have all the pieces to build what you described, we also have the 05-end-to-end samples folder for these kinds of things.