Docker Model Runner: Running Machine Learning Models with Docker
98%
A Better User Experience with OpenWebUI
In this section, we'll see how to use OpenWebUI, a web-based interface for managing and interacting with your locally hosted models. It provides a user-friendly dashboard to start a conversation with your models.
To do this, we'll need to use Docker Compose to set up the tool. Create a docker-compose.yml file with the following content:
cat < docker-compose.yml && \
docker compose up -d
services:
open-webui:
image: ghcr.io/open-webui/open-webui:main
ports:
- "3000:8080"
environment:
- OPENAI_API_BASE_URL=http://host.docker.internal:12434/engines/v1
- OPENAI_API_KEY=none
- ENABLE_SIGNUP=true
extra_hosts:
- "host.docker.internal:host-gateway"
volumes:
- open-webui:/app/backend/data
volumesPainless Docker - 2nd Edition
A Comprehensive Guide to Mastering Docker and its EcosystemEnroll now to unlock all content and receive all future updates for free.
Unlock now  $31.99$25.59Learn More
Hurry! This limited time offer ends in:
To redeem this offer, copy the coupon code below and apply it at checkout:
