Skip to content

CORS support #22914

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jul 3, 2025
Merged

CORS support #22914

Changes from 1 commit
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
0acc7d2
add CORS configuration
ArthurFlag Jun 25, 2025
967f88f
fix deny
ArthurFlag Jun 25, 2025
e9ca4b0
update settings ref
ArthurFlag Jun 27, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
23 changes: 17 additions & 6 deletions content/manuals/ai/model-runner/_index.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -39,20 +39,25 @@

### Enable DMR in Docker Desktop

1. Navigate to the **Beta features** tab in settings.
2. Tick the **Enable Docker Model Runner** setting.
3. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
1. In the settings view, navigate to the **Beta features** tab.
1. Tick the **Enable Docker Model Runner** setting.
1. If you are running on Windows with a supported NVIDIA GPU, you should also see and be able to tick the **Enable GPU-backed inference** setting.
1. Optional: If you want to enable TCP support, select the **Enable host-side TCP support**
1. In the **Port** field, type the port of your choice.
1. If you are interacting with Model Runner from a local frontend web app,
in **CORS Allows Origins**, select the origins that Model Runner should accept requests from.
An origin is the URL where your web app is running, for example `http://localhost:3131`.

You can now use the `docker model` command in the CLI and view and interact with your local models in the **Models** tab in the Docker Desktop Dashboard.

> [!IMPORTANT]
>
> For Docker Desktop versions 4.41 and earlier, this settings lived under the **Experimental features** tab on the **Features in development** page.
> For Docker Desktop versions 4.41 and earlier, this setting lived under the **Experimental features** tab on the **Features in development** page.

### Enable DMR in Docker Engine

1. Ensure you have installed [Docker Engine](/engine/install/).
2. DMR is available as a package. To install it, run:
1. DMR is available as a package. To install it, run:

{{< tabs >}}
{{< tab name="Ubuntu/Debian">}}
Expand All @@ -73,13 +78,19 @@
{{< /tab >}}
{{< /tabs >}}

3. Test the installation:
1. Test the installation:

```console
$ docker model version
$ docker model run ai/smollm2
```

1. Optional: To enable TCP support, set the port with the `DMR_RUNNER_PORT` environment variable.
1. Optional: If you enabled TCP support, you can configure CORS allowed origins with the `DMR_ORIGINS` environment variable. Possible values are:
- `*`: Allow all origins

Check warning on line 90 in content/manuals/ai/model-runner/_index.md

View workflow job for this annotation

GitHub Actions / vale 

[vale] reported by reviewdog 🐶
[Docker.RecommendedWords] Consider using 'let' instead of 'Allow'

Raw Output:
{"message": "[Docker.RecommendedWords] Consider using 'let' instead of 'Allow'", "location": {"path": "content/manuals/ai/model-runner/_index.md", "range": {"start": {"line": 90, "column": 11}}}, "severity": "INFO"}
- `-`: Deny all origins
- Comma-separated list of allowed origins

## Pull a model

Models are cached locally.
Expand Down