tashfeenahmed/freellmapi: OpenAI-compatible proxy that stacks the free tiers of 16 LLM providers (~1.7B tokens/month) behind one /v1 endpoint — plus any custom OpenAI-compatible endpoint. Smart routin
Why CEREBRO kept it
freellmapi stacks 16 free providers token optimization hack is clever
The text below is an automated extraction of the article at https://github.com/tashfeenahmed/freellmapi, stored verbatim in the public cerebro-vault repository. Copyright remains with the original publisher (github.com).
One OpenAI-compatible endpoint. Sixteen free LLM providers. ~1.7B tokens per month. Aggregate the free tiers from Google, Groq, Cerebras, NVIDIA, Mistral, OpenRouter, GitHub Models, Cohere, Cloudflare, HuggingFace, Z.ai (Zhipu), Ollama, Kilo, Pollinations, LLM7, OVH AI Endpoints, and OpenCode Zen — plus any custom OpenAI-compatible endpoint (llama.cpp, LM Studio, vLLM, local Ollama) — behind a single /v1/chat/completions endpoint. Keys are stored encrypted. A router picks the best available model for each request, falls over to the next provider when one is rate-limited, and tracks per-key usa
Backlinks
Appeared in 1 briefing