agent-smith

Simple crawler, finding an answer for a given query, powered by LLM (OpenAI/Together.ai) for decision making. Think of a grep, but for website.

Usage

./webgrep <searchquery> <url>

All the related magic is in train_together.py

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
dataloader.py		dataloader.py
llm.py		llm.py
prepare_data.py		prepare_data.py
prompts.py		prompts.py
requirements.txt		requirements.txt
train_together.py		train_together.py
webgrep		webgrep