Docker

Use Docker when

Docker is the simplest path when the customer already has a local runtime on the host and you want the agent isolated in one container.

Ollama example

docker run --rm \
  -e FALLBAKIT_RUNNER_ID=runner_from_dashboard \
  -e FALLBAKIT_RUNNER_API_KEY=rr_from_dashboard \
  -e FALLBAKIT_BASE_URL=https://api.fallbakit.com \
  -e FALLBAKIT_LOCAL_PROVIDER=ollama \
  -e FALLBAKIT_LOCAL_BASE_URL=http://host.docker.internal:11434 \
  -e FALLBAKIT_METRICS_ADDR=:9093 \
  -p 9093:9093 \
  --add-host=host.docker.internal:host-gateway \
  ghcr.io/fallbakit/fallbakit-agent:latest

oMLX example

docker run --rm \
  -e FALLBAKIT_RUNNER_ID=runner_from_dashboard \
  -e FALLBAKIT_RUNNER_API_KEY=rr_from_dashboard \
  -e FALLBAKIT_BASE_URL=https://api.fallbakit.com \
  -e FALLBAKIT_LOCAL_PROVIDER=omlx \
  -e FALLBAKIT_LOCAL_BASE_URL=http://host.docker.internal:8000 \
  -e FALLBAKIT_METRICS_ADDR=:9093 \
  -p 9093:9093 \
  --add-host=host.docker.internal:host-gateway \
  ghcr.io/fallbakit/fallbakit-agent:latest

vLLM example

docker run --rm \
  -e FALLBAKIT_RUNNER_ID=runner_from_dashboard \
  -e FALLBAKIT_RUNNER_API_KEY=rr_from_dashboard \
  -e FALLBAKIT_BASE_URL=https://api.fallbakit.com \
  -e FALLBAKIT_LOCAL_PROVIDER=vllm \
  -e FALLBAKIT_LOCAL_BASE_URL=http://host.docker.internal:8000 \
  -e FALLBAKIT_LOCAL_API_KEY=optional_vllm_api_key \
  -e FALLBAKIT_METRICS_ADDR=:9093 \
  -p 9093:9093 \
  --add-host=host.docker.internal:host-gateway \
  ghcr.io/fallbakit/fallbakit-agent:latest

Direct OpenAI clients use vLLM with http://localhost:8000/v1. The Fallbakit agent should use the runtime origin, such as http://host.docker.internal:8000, without /v1.

Networking notes

Use host.docker.internal on Docker Desktop.
On Linux, add --add-host=host.docker.internal:host-gateway when the runtime stays on the host.
If the runtime lives on another machine or service, point FALLBAKIT_LOCAL_BASE_URL directly at that reachable address.

Verify

After the container starts, check http://localhost:9093/readyz and confirm the runner appears in Dashboard -> Runners.