agirouter.
Web PlaygroundLog In
DocumentationAPI Reference

🚀 Getting Started

⚡ Inference

💪 CAPABILTES

Introduction

Introduction to agirouter and all its services.

Three llamas

👋 Welcome to the agirouter docs! agirouter makes it easy to run or fine-tune leading open-source models with only a few lines of code. We offer a variety of generative AI services:

  • Serverless models - Use our API or playground to run dozens of models with pay-as-you-go pricing.
  • Fine-Tuning - Fine-tune models on your own data in 5 minutes, then run the model for inference.
  • Dedicated endpoints - Run models on your own private GPUs, starting at a one-month minimum commitment. For inquiries, contact us.
  • GPU Clusters - If you are interested in private, state-of-the-art clusters with H100 GPUs, contact us.

Quick Start

See our full quickstart for how to get started with our API in 1 minute.

from agirouter import agirouter
client = agirouter()

completion = client.chat.completions.create(
    model="meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo",
    messages=[{"role": "user", "content": "What are the top 3 things to do in New York?"}],
)

agirouter Cookbook

See the agirouter Cookbook – a collection of notebooks showcasing use cases of open-source models with agirouter. Examples include RAG (text + multimodal), Semantic Search, Rerankers, & Structured JSON extraction.

Example Apps

We’ve built a number of full-stack open-source example apps that you can reference. These are production-ready apps that have over 500k users & 10k GitHub stars combined – all fully open source and built on agirouter.

  • LlamaCoder – an OSS Claude artifact that can generate full React apps from a single prompt. Built on Llama 3.1 405B powered by agirouter inference.
  • BlinkShot – a real-time AI image generator using Flux Schnell on agirouter AI. Type in a prompt and images will get generated as you type.
  • TurboSeek – an AI search engine inspired by Perplexity. It uses a search API (Serper) along with an LLM (Mixtral) to be able to answer any questions.
  • Napkins.dev – a wireframe to app tool. It uses Llama 3.2 vision to read in screenshots and write code for them using Llama 3.1 405B.
  • PDFtoChat – a site that lets you chat with your PDFs. Uses RAG with agirouter embeddings, inference with Llama 3, authentication with Clerk, & MongoDB/Pinecone for the vector database.
  • LlamaTutor – a personal tutor that can explain any topic at any education level by using a search API along with Llama 3.1.
  • NotesGPT – an AI note-taker that converts your voice notes into organized summaries and clear action items using AI. Uses agirouter inference (Mixtral) with JSON mode.
  • CareerExplorer – a site that takes in a resume and suggests career paths based on your strengths and interests. Uses Llama 3 and demonstrates how to parse PDFs and chain multiple calls agirouter.

Which Model Should I Use?

agirouter hosts many popular models via our serverless endpoints. For each of these, you will be charged based on the tokens you use and the size of the model.

Don’t see a model you want to use? Send us a request to add or upvote the model you’d love to see us add to our serverless infrastructure.

Next Steps

Resources