Setup Guide
Prerequisites
- Node.js 20+
- Bun 1.3+
- Docker + Docker Compose
git
Local setup
- Install dependencies:
cd controller && bun install
cd ../frontend && npm ci
- Configure environment:
- create local
.envvalues for API keys, backend URLs, and optional model/runtime settings - keep secrets out of git
- Run controller:
cd controller
bun src/main.ts
- Run frontend:
cd frontend
npm run dev
Validation checklist
Run before release:
cd controller
npx tsc --noEmit
bun test
cd ../frontend
npm run test
npm run lint
npm run build
Docker deployment
Local/remote compose deployment
docker compose up -d --build controller frontend
docker compose ps controller frontend
Verify services
curl -sS http://localhost:8080/health
curl -I http://localhost:3000
Remote host example (SSH + deploy)
ssh -i ~/.ssh/linux-ai ser@192.168.1.70
cd /home/ser/workspace/projects/lmvllm
docker compose up -d --build controller frontend
docker compose ps controller frontend
Persistence
Services are configured with restart policy:
vllm-studio-controller:unless-stoppedvllm-studio-frontend:unless-stopped
Troubleshooting
- Controller restart loop:
- inspect logs:
docker logs --tail 200 vllm-studio-controller - verify module/file sync if deployment was partial
- Frontend can’t reach backend:
- check
BACKEND_URLin compose env - verify
http://localhost:8080/health
- Slow rebuilds:
- ensure
.dockerignoreis present and excludes heavy local directories