Fallbakit Tunnel

Docker Compose

Run the Fallbakit tunnel agent with Docker Compose.

Agent-only Compose

services:
  fallbakit-agent:
    image: ghcr.io/fallbakit/fallbakit-agent:latest
    restart: unless-stopped
    environment:
      FALLBAKIT_RUNNER_ID: ${FALLBAKIT_RUNNER_ID}
      FALLBAKIT_RUNNER_API_KEY: ${FALLBAKIT_RUNNER_API_KEY}
      FALLBAKIT_BASE_URL: ${FALLBAKIT_BASE_URL:-https://api.fallbakit.com}
      FALLBAKIT_LOCAL_PROVIDER: ${FALLBAKIT_LOCAL_PROVIDER:-ollama}
      FALLBAKIT_LOCAL_BASE_URL: ${FALLBAKIT_LOCAL_BASE_URL:-http://host.docker.internal:11434}
      FALLBAKIT_LOCAL_API_KEY: ${FALLBAKIT_LOCAL_API_KEY:-}
      FALLBAKIT_METRICS_ADDR: :9093
    ports:
      - "9093:9093"
    extra_hosts:
      - "host.docker.internal:host-gateway"

Compose with Ollama

The repository includes an Ollama-ready profile in docker-compose.yml.

Use:

export FALLBAKIT_RUNNER_ID=runner_from_dashboard
export FALLBAKIT_RUNNER_API_KEY=rr_from_dashboard
export FALLBAKIT_LOCAL_PROVIDER=ollama
export FALLBAKIT_LOCAL_BASE_URL=http://ollama:11434
docker compose --profile with-ollama up -d

Compose with oMLX

This repo does not ship an oMLX Compose service. Keep the same fallbakit-agent service and point FALLBAKIT_LOCAL_BASE_URL at the reachable oMLX host or service URL, for example:

export FALLBAKIT_RUNNER_ID=runner_from_dashboard
export FALLBAKIT_RUNNER_API_KEY=rr_from_dashboard
export FALLBAKIT_LOCAL_PROVIDER=omlx
export FALLBAKIT_LOCAL_BASE_URL=http://host.docker.internal:8000
docker compose up -d

Compose with vLLM

Keep the same fallbakit-agent service and point FALLBAKIT_LOCAL_BASE_URL at the vLLM origin without /v1:

export FALLBAKIT_RUNNER_ID=runner_from_dashboard
export FALLBAKIT_RUNNER_API_KEY=rr_from_dashboard
export FALLBAKIT_LOCAL_PROVIDER=vllm
export FALLBAKIT_LOCAL_BASE_URL=http://host.docker.internal:8000
export FALLBAKIT_LOCAL_API_KEY=optional_vllm_api_key
docker compose up -d

Verify

Check docker compose logs fallbakit-agent, then confirm http://localhost:9093/readyz returns ready.

Docker Compose | Fallbakit Docs | Fallbakit