llama-cpp-agent logo

llama-cpp-agent

The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.

Maintained by Maximilian-Winter

Project Information

GitHub Stars
552
Language
Python
Last Updated
April 18, 2025 at 08:42 PM

Topics

agents
llamacpp
llm
llms
function-calling
parallel-function-call
llm-agent
llm-framework

Explore More

Discover similar projects or browse the full catalog.