Neon AI Gateway is an LLM gateway built into your Postgres branch. Point your existing OpenAI SDK at the branch endpoint and call many models with one credential, and AI requests scope to a branch the same way your data does.
- One credential across all providers. Call models like GPT-6 Astra, Grok 4.6, Kimi K3, and Gemini 3.6 Flash with no separate account for each.
- Keep your SDK. Point your existing AI SDK at the branch endpoint, with no new client to learn.
- Scoped to your branch. Each branch has its own gateway endpoint.
- Streaming built in. Stream responses with no extra setup.
- Familiar paths. The same short paths OpenAI and OpenRouter use, plus native provider paths when you need them. See Shorter paths.
Model access
Neon AI Gateway serves open-weight and foundation models. Any paid project with prepaid credits can use every model in the catalog.
See every supported model in the model catalog. See AI Gateway prepaid credits to add credits.
Get started
Quickstart
Get a credential and make your first inference request in minutes.
Models
Browse the full model catalog and learn how to specify models in requests.
Chat completions
Use the OpenAI-compatible endpoint with any model in the catalog.
Embeddings
Turn text into vectors for search with the OpenAI-compatible embeddings endpoint.
Authentication
Understand how Neon credentials work with AI Gateway.
Overview
Neon AI Gateway is the LLM inference layer built into the Neon backend. It lets you call models from OpenAI, Google, and other providers using your Neon credential, without setting up separate provider accounts. Your existing OpenAI SDK works without code changes. Just point it at your branch endpoint.
AI Gateway is currently available in AWS US East (Ohio) (
aws-us-east-2), AWS US East (N. Virginia) (aws-us-east-1), AWS Europe (Frankfurt) (aws-eu-central-1), and AWS Asia Pacific (Singapore) (aws-ap-southeast-1). Create your project in one of these regions to use it. Support is expanding toward all regions. It requires a paid Neon plan. See Pricing for details.
important
Use of AI Gateway is subject to our Terms of Service. Access is not available to users, organizations, or entities located in or operating from regions restricted by Anthropic's Supported Regions Policy. This restriction also applies to entities that are majority owned, directly or indirectly, by companies headquartered in unsupported regions.
Pricing
AI Gateway usage draws down a prepaid credit balance. Here's how pricing works:
- Paid plans only. AI Gateway is available on Neon's Launch and Scale plans, with no difference in pricing or model access between the two. Any paid customer with prepaid credits can use every model in the catalog. See Model access for details.
- No markup. Neon charges the same per-token rate as the model provider. Published provider prices are passed on to users with no additional markup.
- Prepaid credits. Inference draws down a prepaid credit balance. 1 credit equals $1 USD, with a $5 minimum purchase, and credits are valid for 12 months from purchase. You buy credits from the Billing page in the Neon Console.
See the model catalog for per-model rates, and AI Gateway prepaid credits for how to buy credits and manage your balance.
Starter templates
Browse working examples at build-on-neon.vercel.app. Two templates use AI Gateway:
ai-sdk: An image-generation agent that routes model calls through AI Gateway, stores results in Neon Object Storage, and writes metadata to Postgres on a Neon Function.
neon bootstrap --template ai-sdkmastra: A personal assistant that uses AI Gateway for LLM calls with Postgres-backed memory on a Neon Function.
neon bootstrap --template mastraNeed help?
Join our Discord Server to ask questions or see what others are doing with Neon. For paid plan support options, see Support.