AI gateway & models

All AI in Coco CRM — the chat assistant and every custom AI feature — routes through Cocolevio's AI gateway, a LiteLLM-based proxy operated by Cocolevio. This page explains what the gateway is and why it matters; for the hands-on setup, see AI configuration.

Why a gateway?

Rather than wiring each feature to a specific AI vendor, everything talks to one gateway that fronts the providers behind it.

BenefitWhat it means
One endpoint, 100+ modelsA single API endpoint and key gives access to models from many providers (OpenAI, Anthropic, Google, and more)
Central cost trackingEvery AI request across the platform is metered in one place, so usage and spend are visible
Automatic model switchingThe gateway reads each request and routes it: simple tasks go to fast, cheap models; complex coding and reasoning tasks go to stronger models
App simplicityFeatures never need to know which real model served their request — routing happens transparently

Which features use it

  • AI assistant — the built-in chat panel. Model names you pick (e.g. GPT-4o mini) are served through the gateway.
  • LinkedIn Leads — the Search, Validate, and Research steps all call the gateway. See LinkedIn leads.
  • Google Places analysis — company research, opportunity scoring, and pitch writing. See Google Places leads.

Provider fallback chain

The AI features inside the Email Campaigns app resolve their provider with a fallback chain, so a temporary gateway issue doesn't stop work:

  1. AI gateway (primary) — used whenever the gateway endpoint and key are configured.
  2. Direct OpenAI — used if an OpenAI API key is configured and the gateway is not.
  3. OpenRouter — final fallback via an OpenRouter API key.

The LinkedIn Leads page also exposes a per-search provider and model dropdown, so users can override the chain for a single search.

Getting access

The gateway endpoint URL and API keys are not published in these docs. Workspace admins receive them from their Cocolevio administrator and enter them in Settings → Apps → Email Campaigns — see AI configuration.

What this means for you

  • You don't choose infrastructure — you just use AI features.
  • Model quality adapts to the task automatically.
  • If an AI feature reports a key or model error, it is a configuration issue for your admin, not something you can fix from the UI. See Troubleshooting.