vLLM Studio

Unified local AI workstation for model lifecycle, chat/agent workflows, orchestration, observability, and remote deployment.

Release: v1.12.0

This release consolidates major repo changes currently in the tree, including:

• controller module reorganization and typed module boundaries
• chat send/stream reliability fixes (done-state detection, attachment/send flow, rollback behavior)
• SSE/run queue hardening to reduce stuck/incomplete UI states
• frontend input and toolbar refinements
• Dockerized controller runtime and compose wiring for persistent frontend+backend services
• repository cleanup and docs reset

Repository layout

• controller/: Bun/Hono backend, orchestration, chat runtime, lifecycle, metrics
• frontend/: Next.js app, chat UI, proxy endpoints, client state
• shared/: shared types/contracts
• config/: runtime and integration configs
• scripts/: operational scripts

Quick start

1. Controller:

cd controller
npx tsc --noEmit
bun test
bun src/main.ts

2. Frontend:

cd frontend
npm run test
npm run lint
npm run build
npm run dev

3. Full stack with Docker:

docker compose up -d --build controller frontend

Health checks

curl -sS http://localhost:8080/health
curl -I http://localhost:3000

Setup guide

See setup/README.md for complete setup, deployment, and verification instructions.

Branching and release workflow

• Development branch: dev
• Production integration branch: main
• Release tags: vX.Y.Z

For this release:

• merge release work into main and dev
• tag v1.12.0
• create a new post-release working branch