Skip to content

README.md

Latest commit

 

History

History
88 lines (57 loc) · 2.63 KB

README.md

File metadata and controls

88 lines (57 loc) · 2.63 KB

Unified CUA Template

A multi-provider Computer Use Agent (CUA) template for Kernel. Supports Anthropic, OpenAI, and Google Gemini as interchangeable backends with automatic fallback.

Quick start

1. Install dependencies

uv sync

2. Configure environment

Copy the example env file and add your API keys:

cp .env.example .env

Set CUA_PROVIDER to your preferred provider and add the matching API key:

Provider Env var for key Model used
anthropic ANTHROPIC_API_KEY claude-sonnet-4-6
openai OPENAI_API_KEY gpt-5.4
gemini GOOGLE_API_KEY gemini-2.5-computer-use-preview-10-2025

3. Deploy to Kernel

kernel deploy main.py --env-file .env

4. Invoke

kernel invoke python-cua cua-task --payload '{"query": "Go to https://news.ycombinator.com and get the top 5 stories"}'

Multi-provider fallback

Set CUA_FALLBACK_PROVIDERS to automatically try another provider if the primary fails:

CUA_PROVIDER=anthropic
CUA_FALLBACK_PROVIDERS=openai,gemini

This will try Anthropic first, then OpenAI, then Gemini. Only providers with valid API keys are used.

Replay recording

Pass record_replay: true in the payload to capture a video replay of the browser session:

kernel invoke python-cua cua-task --payload '{"query": "Navigate to example.com", "record_replay": true}'

The response will include a replay_url you can open in your browser.

Project structure

main.py               — Kernel app entrypoint
session.py            — Browser session lifecycle with replay support
providers/
  __init__.py         — Provider factory and fallback logic
  anthropic.py        — Anthropic Claude adapter
  openai.py           — OpenAI GPT adapter
  gemini.py           — Google Gemini adapter

Customization

Each provider adapter is self-contained. To customize a provider's behavior (system prompt, model, tool handling), edit the corresponding file in providers/.

To add a new provider, create a new file that implements the CuaProvider protocol and register it in providers/__init__.py.

Resources