Skip to content

CORS support #22914

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

CORS support #22914

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
0acc7d2
add CORS configuration
ArthurFlag Jun 25, 2025
967f88f
fix deny
ArthurFlag Jun 25, 2025
e9ca4b0
update settings ref
ArthurFlag Jun 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 17 additions & 6 deletions content/manuals/ai/model-runner/_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,20 +39,25 @@ Models are pulled from Docker Hub the first time they're used and stored locally

### Enable DMR in Docker Desktop

1. Navigate to the **Beta features** tab in settings.
2. Tick the **Enable Docker Model Runner** setting.
3. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
1. In the settings view, navigate to the **Beta features** tab.
1. Tick the **Enable Docker Model Runner** setting.
1. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
1. Optional: If you want to enable TCP support, select the **Enable host-side TCP support**
1. In the **Port** field, type the port of your choice.
1. If you are interacting with Model Runner from a local frontend web app,
in **CORS Allows Origins**, select the origins that Model Runner should accept requests from.
An origin is the URL where your web app is running, for example `http://localhost:3131`.

You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.

> [!IMPORTANT]
>
> For Docker Desktop versions 4.41 and earlier, this settings lived under the **Experimental features** tab on the **Features in development** page.
> For Docker Desktop versions 4.41 and earlier, this setting lived under the **Experimental features** tab on the **Features in development** page.

### Enable DMR in Docker Engine

1. Ensure you have installed [Docker Engine](/engine/install/).
2. DMR is available as a package. To install it, run:
1. DMR is available as a package. To install it, run:

{{< tabs >}}
{{< tab name="Ubuntu/Debian">}}
Expand All @@ -73,13 +78,19 @@ You can now use the `docker model` command in the CLI and view and interact with
{{< /tab >}}
{{< /tabs >}}

3. Test the installation:
1. Test the installation:

```console
$ docker model version
$ docker model run ai/smollm2
```

1. Optional: To enable TCP support, set the port with the `DMR_RUNNER_PORT` environment variable.
1. Optional: If you enabled TCP support, you can configure CORS allowed origins with the `DMR_ORIGINS` environment variable. Possible values are:
- `*`: Allow all origins
- Comma-separated list of allowed origins
- When unspecified, all origins are denied.

## Pull a model

Models are cached locally.
Expand Down
18 changes: 10 additions & 8 deletions ...security/for-admins/hardened-desktop/settings-management/configure-json-file.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -312,14 +312,16 @@ For more information, see [Networking](/manuals/desktop/features/networking.md#n
>
> For Docker Desktop versions 4.41 and earlier, some of these settings lived under the **Experimental features** tab on the **Features in development** page.

| Parameter | OS | Description | Version |
|:----------------------------|----|:--------------------------------------------------------------------------------------------------------------------------------------------------------------|---------|
| `allowBetaFeatures` | | If `value` is set to `true`, beta features are enabled. | |
| `enableDockerAI` | | If `allowBetaFeatures` is true, setting `enableDockerAI` to `true` enables [Docker AI (Ask Gordon)](/manuals/ai/gordon/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | |
| `enableInference` | | If `allowBetaFeatures` is true, setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | |
| &nbsp; &nbsp; &nbsp; &nbsp; `enableInferenceTCP` | | Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. | |
| `enableDockerMCPToolkit` | | If `allowBetaFeatures` is true, setting `enableDockerMCPToolkit` to `true` enables the [MCP toolkit feature](/manuals/ai/mcp-catalog-and-toolkit/toolkit.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | |
| `allowExperimentalFeatures` | | If `value` is set to `true`, experimental features are enabled. | Docker Desktop version 4.41 and earlier |
| Parameter | OS | Description | Version |
|:-----------------------------------------------------|----|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------|
| `allowBetaFeatures` | | If `value` is set to `true`, beta features are enabled. | |
| `enableDockerAI` | | If `allowBetaFeatures` is true, setting `enableDockerAI` to `true` enables [Docker AI (Ask Gordon)](/manuals/ai/gordon/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | |
| `enableInference` | | If `allowBetaFeatures` is true, setting `enableInference` to `true` enables [Docker Model Runner](/manuals/ai/model-runner/_index.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | |
| &nbsp; &nbsp; &nbsp; &nbsp; `enableInferenceTCP` | | Enable host-side TCP support. This setting requires Docker Model Runner setting to be enabled first. | |
| &nbsp; &nbsp; &nbsp; &nbsp; `enableInferenceTCPPort` | | Specifies the exposed TCP port. This setting requires Docker Model Runner setting to be enabled first. | |
| &nbsp; &nbsp; &nbsp; &nbsp; `enableInferenceCORS` | | Specifies the allowed CORS origins. Empty string to deny all,`*` to accept all, or a list of comma-separated values. This setting requires Docker Model Runner setting to be enabled first. | |
| `enableDockerMCPToolkit` | | If `allowBetaFeatures` is true, setting `enableDockerMCPToolkit` to `true` enables the [MCP toolkit feature](/manuals/ai/mcp-catalog-and-toolkit/toolkit.md) by default. You can independently control this setting from the `allowBetaFeatures` setting. | |
| `allowExperimentalFeatures` | | If `value` is set to `true`, experimental features are enabled. | Docker Desktop version 4.41 and earlier |

### Enhanced Container Isolation

Expand Down
31 changes: 28 additions & 3 deletions .../security/for-admins/hardened-desktop/settings-management/settings-reference.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -795,7 +795,7 @@ third-party or unvetted plugins from being installed.
- **Beta** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
- Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)

### Enable host-side TCP support
#### Enable host-side TCP support

| Default value | Accepted values | Format |
|---------------|-----------------|----------|
Expand All @@ -808,11 +808,36 @@ third-party or unvetted plugins from being installed.
- **Beta** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
- Settings Management: `enableDockerAI` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)


> [!NOTE]
>
> This setting requires Docker Model Runner setting to be enabled first.

##### Port

| Default value | Accepted values | Format |
|---------------|-----------------|---------|
| 12434 | Integer | Integer |

- **Description:** Specifies the exposed TCP port.
- **OS:** {{< badge color=blue text="All" >}}
- **Use case:** Connect to the Model Runner via TCP.
- **Configure this setting with:**
- **Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
- Settings Management: `enableInferenceTCP` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)

##### CORS Allowed Origins

| Default value | Accepted values | Format |
|---------------|---------------------------------------------------------------------------------|--------|
| Empty string | Empty string to deny all,`*` to accept all, or a list of comma-separated values | String |

- **Description:** Specifies the allowed CORS origins.
- **OS:** {{< badge color=blue text="All" >}}
- **Use case:** Integration with a web app.
- **Configure this setting with:**
- **Beta features** settings in [Docker Desktop GUI](/manuals/desktop/settings-and-maintenance/settings.md)
- Settings Management: `enableInferenceCORS` setting in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)

### Enable Docker MCP Toolkit

| Default value | Accepted values | Format |
Expand Down Expand Up @@ -1127,4 +1152,4 @@ overrides are possible.
- **OS:** {{< badge color=blue text="All" >}}
- **Use case:** Allow users to authenticate with enterprise proxy servers that require Kerberos or NTLM.
- **Configure this setting with:**
- Settings Management: `proxy.enableKerberosNtlm` in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)
- Settings Management: `proxy.enableKerberosNtlm` in the [`admin-settings.json` file](/manuals/security/for-admins/hardened-desktop/settings-management/configure-json-file.md)