Skip to content

Commit 7fe835a

Browse files
author
Mark Saroufim
committed
Remove uvicorn concurrency limit causing 503s
The limit_concurrency=10 was causing widespread 503 Service Unavailable errors during the AMD hackathon. SSE connections from CLI submissions hold a slot for the entire GitHub Actions run (10+ minutes), so a handful of concurrent users would exhaust all 10 slots and block everything else including web UI requests.
1 parent fa70358 commit 7fe835a

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

src/kernelbot/main.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ def create_uvicorn_server() -> uvicorn.Server:
3939
host="0.0.0.0",
4040
port=int(os.environ.get("PORT") or 8000),
4141
log_level="info",
42-
limit_concurrency=10,
42+
limit_concurrency=None,
4343
)
4444
return uvicorn.Server(config)
4545

0 commit comments

Comments
 (0)