🚧 feat: Mycal — in-app AI agent chat (dev preview, do not merge) by thelg4 · Pull Request #1176 · remoteit/desktop

thelg4 · 2026-08-05T19:34:04Z

Important

Do not merge. This PR exists to spin up a preview/staging build so people can try the feature. Opened as a draft to keep it un-mergeable.

What this is

Mycal: an AI chat panel embedded in the desktop app, backed by the sibling ai-agent service. Always on in local dev builds; in deployed builds it soft-launches behind the hidden Test UI.

Trying it on the preview build

Hold shift+option (alt) and click your avatar (bottom-left) → choose Test UI
The robot icon appears in the header — that's the chat toggle
Go to Settings → Test Settings → enable "Override agent service":
- Agent service URL: https://dev-ai-agent.remote.it
- Agent MCP audience: https://mcp.demo.remote.it/mcp
Open the chat, sign in to the agent when prompted, and talk to it

What's in the branch

Chat panel — docked column beside the app panels with streaming replies, tool-call display, and write-action approval prompts
Agent sign-in — separate Hydra OAuth session (PKCE + dynamic client registration); tears down with app sign-out
Org scoping — the chat follows the app's active org (sidebar selector) and sends it with each turn so the agent scopes org queries without hunting; shown as a read-only "Current Org" label
Popout window — the chat pops out to its own window (native window in Electron) and hands the conversation back on pop-in/close
Test Settings overrides — point the chat at any deployed agent (URL + MCP audience), no env changes
UX polish — user-facing unavailable/sign-in states, app-standard styling, themed scrollbars

Known blockers for a real reply

The deployed agent's Anthropic API key secret needs re-saving as plaintext + a service redeploy (chat turns currently return an upstream auth error)
ai-agent main is missing the tool-discipline prompt changes (stranded on feature/chat-org-scope); a rebuild after that lands improves org-scoped behavior

aws-amplify-us-west-1 · 2026-08-05T19:39:21Z

This pull request is automatically being deployed by Amplify Hosting (learn more).

Access this pull request here: https://pr-1176.d20k671nqqv4kl.amplifyapp.com

Docked right-column chat talking to the ai-agent service over SSE: - ChatPanel/ChatMessages/ChatToolCalls/ChatApproval/ChatInput components - Persisted chat model (transcript, streaming, write-tool confirmations) - Panel width folds into sidePanelWidth so all panel layouts reflow - Expand toggle (400px/640px), full-screen overlay below single-panel width - Vite dev proxy /agent -> :3001 (CSP-safe); VITE_AGENT_URL for deploys - react-markdown + remark-gfm for assistant replies - Dev-gated: header robot toggle and panel render only in dev builds

Stage A of agent auth: attach Authorization from a locally stored token (pasted from the ai-agent dev harness) on chat/confirm/health calls, surface 401 reauth_required and mid-turn auth failures as a sign-in notice with a token paste field. The in-app PKCE flow replaces the paste field as the token writer in a later stage.

Replaces the pasted-token stopgap: a Sign in button self-registers an OAuth client (Dynamic Client Registration), redirects to the Hydra login/consent pages, exchanges the code on return (PKCE), and silently refreshes the 30m access token before each turn. Register/token calls ride the new dev-only /hydra vite proxy so no CORS setup is needed; packaged builds need the origin allow-listed or a main-process exchange.

Amplify's OAuth listener consumes and strips ?code/state on page load for the Cognito flow; the Hydra callback uses the same params on the same origin, so the agent exchange never ran and sign-in looped. Capture the params at module-evaluation time (before Amplify configures), claim them only when this tab started an agent sign-in, and strip the URL immediately so neither flow double-handles the code.

App sign-out now clears the stored Hydra access/refresh tokens, resets the chat transcript, and best-effort revokes the refresh token at Hydra so the otherwise never-expiring refresh chain dies server-side. Local credentials are cleared synchronously so a sign-out-triggered reload cannot race the revoke call.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Fall back to membership.name in ChatOrgSelect and chat.ts send() when organization.accounts is unloaded, so org scope never silently degrades to personal; guard against a whitespace-only name so the client never sends one the server's non-empty-after-trim validation would reject. Force-adopt the app's active org on the first syncOrg after load so orgId (redux-persisted) doesn't survive page reloads, per the "not persisted" spec decision, while preserving intra-session divergence across panel close/open.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Matches the ai-agent service's move off mcp.evan.remote.it (older build without org-scoped list_scripts). The client cache key includes the audience, so a fresh sign-in re-registers automatically. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

…ning

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

… the proxy

AGENT_PROXY_TARGET in frontend/.env points the same-origin /agent proxy at a deployed agent (e.g. http://dev-ai-agent.remote.it) instead of the local dev service — the proxy hop keeps CSP satisfied while the ALB is HTTP-only.

Replaces the dev-facing ':3001' banner: zero-state layout (matching the sign-in state) when the chat is empty, compact notice above an existing transcript, and the input disabled while Mycal is unreachable.

The org sidebar (bottom-left avatar stack) is now the single org selector: the chat mirrors accounts.activeId and shows a read-only 'Current Org' label where the dropdown was. The popout window keeps the org handed off with its conversation. The request to the agent is unchanged (org { id, name }, omitted for Personal).

Test Settings gains an 'Override agent service' toggle with agent URL and MCP audience fields (persisted like the existing API overrides). agentURL() and mcpAudience() resolve per request: the override wins when enabled (https only — CSP blocks plain http), otherwise dev rides the vite proxy and builds use VITE_AGENT_URL. Changing the audience busts the OAuth client cache, so a fresh agent sign-in just works.

MODE === 'development' gates become useChatEnabled(): always on in local dev, and on in deployed builds when the hidden Test UI is enabled (shift+option on the avatar menu). Also documents the dev-ai-agent/demo-audience pairing in Test Settings for staging testers, whose build default is the beta audience.

The /hydra vite proxy only exists in dev; staging/preview builds 404'd the agent sign-in's register and token calls. Hydra's public CORS allows any origin, so builds can hit the issuer directly.

login.dev.remote.it answers CORS preflights without an allow-origin header, so direct browser calls from deployed previews are blocked. The /hydra path is served by the vite proxy in dev and an Amplify rewrite rule on previews.

…ontract

…coping

…nd i18n

github-advanced-security Bot found potential problems Aug 5, 2026

View reviewed changes

Comment thread frontend/src/services/agent.ts Fixed

Comment thread frontend/src/services/hydra.ts Fixed

JamieRuderman changed the title ~~feat: Mycal — in-app AI agent chat (dev preview, do not merge)~~ 🚧 feat: Mycal — in-app AI agent chat (dev preview, do not merge) Aug 5, 2026

thelg4 and others added 27 commits August 10, 2026 15:19

docs(chat): design spec for chat panel org selector

080acd1

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

docs(chat): implementation plan for chat panel org selector

368768a

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

feat(chat): optional org field on the agent chat request

c70ee3a

feat(chat): org selection state scoped to the chat panel

723e41e

feat(chat): org selector dropdown in the chat panel

c692c24

style(chat): taller org selector and themed scrollbars

5f77b2a

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

docs(chat): design spec for chat popout window

5167a16

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

docs(chat): implementation plan for chat popout window

1d44888

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

refactor(chat): extract ChatBody shared by panel and popout

99d2ae0

feat(chat): standalone chat window behind ?chatPopout boot flag

8a93e02

feat(chat): pop the chat out to its own window with transcript hand-off

62027bc

feat(electron): open the chat popout as a native window

7909fcc

fix(chat): final review — popout stream, sign-in, and lifecycle harde…

202506a

…ning

feat(chat): name the chat Mycal and heighten the org selector

51eb339

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

feat(chat): builds resolve the agent via VITE_AGENT_URL, dev stays on…

60f5827

… the proxy

feat(chat): zero-state sign-in prompt matching app empty-state pattern

bc39422

style(chat): match the org dropdown to the app's filled select pattern

62793bc

feat(chat): user-friendly unavailable state

617275d

Replaces the dev-facing ':3001' banner: zero-state layout (matching the sign-in state) when the chat is empty, compact notice above an existing transcript, and the input disabled while Mycal is unreachable.

thelg4 added 4 commits August 10, 2026 15:21

fix(chat): call the Hydra issuer directly in non-dev builds

3fd2d8b

The /hydra vite proxy only exists in dev; staging/preview builds 404'd the agent sign-in's register and token calls. Hydra's public CORS allows any origin, so builds can hit the issuer directly.

thelg4 force-pushed the feature/agent-chat-interface branch from 918c246 to 33dd524 Compare August 10, 2026 20:47

JamieRuderman and others added 8 commits August 19, 2026 15:40

Merge branch 'main' into feature/agent-chat-interface

b3ee8cd

feat(common): add chat popout window contract constants

806b613

fix(electron): guard chat popout child windows and share the popout c…

9817e42

…ontract

fix(chat): harden agent auth, popout protocol, persistence, and org s…

74151da

…coping

refactor(chat): display-only components, docked layout, safe areas, a…

dca6c29

…nd i18n

fix(chat): encrypt agent tokens at rest with a non-extractable key

77d1215

fix(deps): sync package-lock with the frontend react-markdown deps

633aab6

fix(chat): encrypt the PKCE flow secrets at rest

e761c12

Navigation Menu

Uh oh!

🚧 feat: Mycal — in-app AI agent chat (dev preview, do not merge) - #1176

🚧 feat: Mycal — in-app AI agent chat (dev preview, do not merge)#1176
thelg4 wants to merge 39 commits into
mainfrom
feature/agent-chat-interface

thelg4 commented Aug 5, 2026 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

aws-amplify-us-west-1 Bot commented Aug 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

thelg4 commented Aug 5, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What this is

Trying it on the preview build

What's in the branch

Known blockers for a real reply

Uh oh!

Uh oh!

Uh oh!

aws-amplify-us-west-1 Bot commented Aug 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

thelg4 commented Aug 5, 2026 •

edited

Loading