feat(inference): add browser point suggestions to the editor - #875

Merged

JArmandoAnaya merged 42 commits into

mainfrom

feat/browser-suggestion-integration

Sep 17, 2026

Commits on Sep 17, 2026

feat(ui-core): add browser asset-source, acquisition and active-target types
JArmandoAnaya
committed
f3a5e62
feat(ui-core): compute suggest blockers per active target, not per connection
JArmandoAnaya
committed
5c7d699
feat(ui-core): add refusal prose for browser negative-point requests
JArmandoAnaya
committed
d957ca8
feat(ui-core): feed the displayed asset to the browser inference runtime
JArmandoAnaya
committed
ee5d0b9
feat(ui-core): route suggestions through the active target, server or browser
JArmandoAnaya
committed
7fa1d27
fix(ui-core): fall back to Server silently for a stale stored browser target
JArmandoAnaya
committed
911f94f
feat(ui-core): add a This device section to the suggest chooser
JArmandoAnaya
committed
8839e06
feat(app): fetch and verify EfficientSAM-Ti artifacts against pinned SHA-256
JArmandoAnaya
committed
0fd7c6a
feat(app): add the race-safe browser suggestion executor
JArmandoAnaya
committed
0c4f688
fix(app): retry the encode after a failed prepareImage instead of caching the rejection
JArmandoAnaya
committed
64ec4ba
fix(app): hold one embedding slot, and pin the prompt and tolerance with discriminating fixtures
JArmandoAnaya
committed
6f95ba0
feat(app): add the concrete browser inference runtime and acquisition state
JArmandoAnaya
committed
74be52d
feat(app): inject the browser inference runtime into the OSS session
JArmandoAnaya
committed
e7b837d
test(scripts): ban @visionset/browser-inference and CDN literals from ui-core
JArmandoAnaya
committed
e07405c
test(scripts): add missing CDN violation examples for cloudfront, amazonaws, and r2
JArmandoAnaya
committed
18f0494
test(scripts): ban CDN/vendor literals from annotator and browser-inference
JArmandoAnaya
committed
48e49d1
test(app): extract serveApi/openJob into a shared _wireApiStub
JArmandoAnaya
committed
a9ccb4a
test(app): add hermetic Playwright coverage for browser suggestion
JArmandoAnaya
committed
a057346
fix(ui-core): let a browser target's chooser survive its own not-ready blocker
JArmandoAnaya
committed
53f19eb
fix(ui-core): dedupe the runtime-wired check and give the blocked server tab its own tone/icon
JArmandoAnaya
committed
7da9256
test(app): fix browser suggestion e2e review findings
JArmandoAnaya
committed
663e92f
fix(ui-core): don't call executorFor on a browser target that isn't ready yet
JArmandoAnaya
committed
128c189
fix(ui-core): derive executor readiness from blocker, and make the regression test discriminate
JArmandoAnaya
committed
4fa0181
ci: run the browser suggestion e2e suite in the browser-models job
JArmandoAnaya
committed
c3b9328
test(app): assert the acquired target's modelRef carries the pinned revision
JArmandoAnaya
committed
79bd155
fix(app): match the real manifest's nested artifacts schema
JArmandoAnaya
committed
d46ff0a
test(app): match browserSuggestion's CDN fixture to the real manifest shape
JArmandoAnaya
committed
6f2e4be
fix(app): dedupe the CDN URL prefix, validate manifest shape, and guard artifact paths
JArmandoAnaya
committed
be7bd7a
fix(browser-inference): make the ORT wasm asset path survive bundler URL rewriting
JArmandoAnaya
committed
27553b2
fix(app): build browser-inference before serving the e2e suite
JArmandoAnaya
committed
5e05107
test(app): serve a real correctly-sized asset image in browserSuggestion
JArmandoAnaya
committed
de961d0
fix(browser-inference): move the asset-resolution doc-comment to the function it describes
JArmandoAnaya
committed
1e10937
fix(app): serve browser-inference's ORT assets in production builds
JArmandoAnaya
committed
efb2d7c
test(packaging): guard that the ORT runtime travels inside the wheel
JArmandoAnaya
committed
38cefdd
docs(packaging): correct MAX_WHEEL_BYTES' stated numbers
JArmandoAnaya
committed
8aa1623
fix(app): hold one executor, and wait for the ORT session before claiming ready
JArmandoAnaya
committed
3eccb12
fix(app): stop reporting browser-local failures as "the server could not be reached"
JArmandoAnaya
committed
1d63104
ci: wake the browser-models job for everything its e2e suite exercises
JArmandoAnaya
committed
34ae80d
refactor(ui-core): unpublish computeSuggestBlocker, and stop inviting a dead click
JArmandoAnaya
committed
89b196f
docs: catch up with a browser inference port that now has a host
JArmandoAnaya
committed
890b497
ci(app): build browser-inference before the clean-clone cycle suite
JArmandoAnaya
committed
3dbb98d
fix(ui-core): hand the browser executor the descriptor's frame, not the decode's
JArmandoAnaya
committed
c49ea85