Aug 1 Friday HackHour: Integrating LLMs into Python applications

[eeholmes]

@nmfs-openscapes/2024-science-teams

If you have not registered for the Zoom link, do so here (you only need to do once) Register here for video links. Open to non-NOAA folks too. If you already registered, the Zoom is the same as for previous sessions.

For our last HackHour this session, guest Boris Shapkin will give an overview of integrating LLMs into applications with a focus on Python applications

Introduction to LLMs

• What is a Large Language Model (LLM)?
• How do LLMs work?

Retrieval-Augmented Generation (RAG)

• What is RAG?
• Benefits of using RAG with LLMs

Open Source vs. Paid LLMs

• Key differences and examples
• Choosing the right LLM for your project

Practical Implementation (the actual tutorial)

• Setting up your environment (Python, LangChain)
• Building an LLM-based chatbot with RAG (hands-on)

Advanced Topics

• Integrating tools and agents
• Using Python REPL tool for executing Python commands
• Designing a User Interface (UI) with Streamlit

[N-DucharmeBarth-NOAA]

Will a recording or tutorial materials be made available after the fact for asynchronous participation?

[noaaroland]

The repo is here: https://github.com/boryasbora/llm_tutorial/tree/main
The talk was recorded and it should appear here: https://nmfs-opensci.github.io/NMFSHackDays-2025/ when it's available, but everybody is busy so the updates are running a bit behind it seems.