1
0
mirror of synced 2025-12-19 18:10:59 -05:00
Files
docs/content/copilot/reference/ai-models/model-hosting.md

5.4 KiB

title, shortTitle, allowTitleToDifferFromFilename, intro, versions, topics, redirect_from, contentType
title shortTitle allowTitleToDifferFromFilename intro versions topics redirect_from contentType
Hosting of models for GitHub Copilot Chat Model hosting true Learn how different AI models are hosted for {% data variables.copilot.copilot_chat_short %}.
feature
copilot
Copilot
/copilot/reference/ai-models/how-copilot-serves-ai-models
reference

{% data variables.product.prodname_copilot %} can use a variety of AI models. This article explains how these models are hosted and served.

OpenAI models

Used for:

  • {% data variables.copilot.copilot_gpt_41 %}
  • {% data variables.copilot.copilot_gpt_5 %}
  • {% data variables.copilot.copilot_o3 %}
  • {% data variables.copilot.copilot_o4_mini %}

{% data variables.copilot.copilot_gpt_41 %} is hosted by {% data variables.product.github %}'s Azure tenant when used in {% data variables.product.prodname_copilot %}.

{% data variables.copilot.copilot_gpt_5 %}, {% data variables.copilot.copilot_o3 %} and {% data variables.copilot.copilot_o4_mini %} models are hosted by OpenAI and {% data variables.product.github %}'s Azure tenant. OpenAI makes the following data commitment: We [OpenAI] do not train our models on your business data by default. {% data variables.product.github %} maintains a zero data retention agreement with OpenAI.

When using OpenAI's models, input requests and output responses continue to run through {% data variables.product.prodname_copilot %}'s content filters for public code matching, when applied, along with those for harmful or offensive content.

Anthropic models

Used for:

  • {% data variables.copilot.copilot_claude_opus_41 %}
  • {% data variables.copilot.copilot_claude_opus %}
  • {% data variables.copilot.copilot_claude_sonnet_35 %}
  • {% data variables.copilot.copilot_claude_sonnet_37 %}
  • {% data variables.copilot.copilot_claude_sonnet_37 %} Thinking
  • {% data variables.copilot.copilot_claude_sonnet_40 %}

{% data variables.copilot.copilot_claude_opus_41 %} is hosted by Anthropic PBC. {% data variables.copilot.copilot_claude_opus %} and {% data variables.copilot.copilot_claude_sonnet_40 %} are hosted by Anthropic PBC and Google Cloud Platform. {% data variables.copilot.copilot_claude_sonnet_37 %} is hosted by Amazon Web Services, Anthropic PBC, and Google Cloud Platform. {% data variables.copilot.copilot_claude_sonnet_35 %} is hosted exclusively by Amazon Web Services. {% data variables.product.github %} has provider agreements in place to ensure data is not used for training. Additional details for each provider are included below:

To provide better service quality and reduce latency, {% data variables.product.github %} uses prompt caching. You can read more about prompt caching on Anthropic PBC, Amazon Bedrock, and Google Cloud.

When using {% data variables.copilot.copilot_claude %}, input prompts and output completions continue to run through {% data variables.product.prodname_copilot %}'s content filters for public code matching, when applied, along with those for harmful or offensive content.

Google models

Used for:

  • {% data variables.copilot.copilot_gemini_25_pro %}
  • {% data variables.copilot.copilot_gemini_flash %}

{% data variables.product.prodname_copilot %} uses {% data variables.copilot.copilot_gemini_flash %} and {% data variables.copilot.copilot_gemini_25_pro %} hosted on Google Cloud Platform (GCP). When using {% data variables.copilot.copilot_gemini %} models, prompts and metadata are sent to GCP, which makes the following data commitment: {% data variables.copilot.copilot_gemini %} doesn't use your prompts, or its responses, as data to train its models.

To provide better service quality and reduce latency, {% data variables.product.github %} uses prompt caching.

When using {% data variables.copilot.copilot_gemini %} models, input prompts and output completions continue to run through {% data variables.product.prodname_copilot %}'s content filters for public code matching, when applied, along with those for harmful or offensive content.