Skip to content
agentgateway has joined the Agentic AI Foundation — Learn more

For the complete documentation index, see llms.txt. Markdown versions of all docs pages are available by appending .md to any docs URL.

VS Code Continue

Page as Markdown

Configure Continue extension for VS Code to use agentgateway

Configure Continue, the open-source AI code assistant for VS Code, to route requests through agentgateway.

Before you begin

  1. Install the agentgateway binary.
  2. Install VS Code with the Continue extension.

Example agentgateway configuration

You can configure agentgateway in the UI or in your configuration file.

To create the same configuration in the UI, follow these steps.

  1. Set your OpenAI API key, create a configuration file with an empty llm section, and start agentgateway. The UI checks that the OPENAI_API_KEY environment variable exists when you save the model.

    export OPENAI_API_KEY='<your-api-key>'
    cat > config.yaml <<'EOF'
    llm:
      models: []
    EOF
    agentgateway -f config.yaml
  2. Add the model.

    1. Open LLM > Models, such as http://localhost:15000/ui/llm/models, and click Add model.

    2. From the Provider dropdown, select OpenAI.

    3. In the Incoming model match field, replace the default openai/* with *.

    4. For the Provider API key, select Env var, and enter OPENAI_API_KEY.

      Add model drawer with the OpenAI provider, * as the incoming model match, and the provider API key read from the OPENAI_API_KEY environment variable
      Add model drawer with the OpenAI provider, * as the incoming model match, and the provider API key read from the OPENAI_API_KEY environment variable
    5. Click Save model.

  3. Serve LLM traffic on port 3000.

    1. Open the Gateway Overview page, such as http://localhost:15000/ui/.

    2. On the LLM row, click Settings.

    3. Enter 3000 for the Port, and click Save settings.

      LLM Settings drawer with the Gateway binding port set to 3000 and a Save settings button
      LLM Settings drawer with the Gateway binding port set to 3000 and a Save settings button

The UI writes the same deprecated llm.port field as the Config file tab, plus an empty llm.gateways list. If your configuration defines gateways, the Settings drawer shows a Gateway dropdown instead of Port, and binds LLM traffic to the gateway that you select. The UI also writes the provider as openai instead of openAI. Agentgateway accepts both values.

Whether the UI can save depends on your storage mode. For more information, see Save changes from the UI.

Configure Continue

  1. Edit the ~/.continue/config.yaml file to add your agentgateway endpoint. If the file already has a models list, add the model to that list.
  2. Save the file and reload Continue in VS Code.
name: agentgateway
version: 0.0.1
schema: v1
models:
  - name: agentgateway
    provider: openai
    model: gpt-4o-mini
    apiBase: http://localhost:3000/v1

Review the following table to understand this configuration.

FieldDescription
nameAt the top level, a name for the configuration. In the models list, the display name shown in the Continue model selector.
version, schemaRequired by the Continue config.yaml format. Keep schema: v1.
providerSet to openai for any OpenAI-compatible endpoint.
modelThe model name from your agentgateway backend configuration.
apiBaseYour agentgateway URL with the /v1 path.

Verify the connection

  1. Open the Continue sidebar in VS Code (Cmd + L on macOS, Ctrl + L on Windows/Linux).
  2. Select agentgateway from the model dropdown.
  3. Send a test message: “Hello, are you working?”
Was this page helpful?
Agentgateway assistant

Ask me anything about agentgateway configuration, features, or usage.

Note: AI-generated content might contain errors; please verify and test all returned information.

Tip: one topic per conversation gives the best results. Use the + button in the chat header to start a new conversation.

Switching topics? Starting a new conversation improves accuracy.
↑↓ navigate ↵ select esc dismiss

What could be improved?

Your feedback helps us improve assistant answers and identify docs gaps we should fix.

Need more help? Join us on Discord: https://discord.gg/y9efgEmppm

Want to use your own agent? Add the Solo MCP server to query our docs directly. Get started here: https://search.solo.io/.