BerriAI — AI Stack & LLM Providers

AI Sophistication

33%

Basic API

Direct LLM API calls

Frameworks

Using LLM frameworks (LangChain, etc.)

Embeddings

Embedding models for semantic search

RAG

Retrieval-augmented generation with vector stores

Agents

Autonomous agent frameworks

Multi-Provider

Using 3+ LLM providers

Architecture Overview

LLM Providers

OpenAIAWS Bedrock

Models

gpt-4oclaude-4-sonnet

Frameworks

Provider Usage Across Repos

OpenAI3 repos

openai-proxysimple_proxy_openaisimple_litellm_proxy

AWS Bedrock2 repos

openai-proxyproxy_load_tester

Model Diversity

2 models

OpenAI

gpt-4o(3)

Anthropic

claude-4-sonnet(2)

Interactive Cost Calculator

Estimate costs using published model pricing and your own volume inputs.

Model

Daily API Calls

1,000

10100K

Avg Tokens per Request

1,000

10010,000

gpt-4o pricing

Input: $2.5/1M tokens · Output: $10/1M tokens

These estimates use published model pricing. Actual costs depend on your call volume, prompt length, and response size.

Berri AI