GPU (RTX 3060) and CUDA 12.8 runtime are present and detected by foundry status, but foundry model list --variants shows CPU-only for every model. CUDA EP files exist under .foundry_local_samples\ep\cuda-ep\ but no GPU variants are ever offered by the catalog. Logs show a 400 Bad Request from the Azure Foundry catalog API on 7/29, followed by fallback to cached model info.
Problem
Diagnostics
System
- OS: Microsoft Windows 10.0.26200
- Architecture: X64
- CPU: Intel(R) Core(TM) i7-8700K CPU @ 3.70GHz (12 logical cores)
- GPU: NVIDIA NVIDIA GeForce RTX 3060 (4.0 GB)
- RAM: 16.7 GB available / 31.9 GB total
- Disk: 3.5 TB free / 7.3 TB total (C:)
- .NET: .NET 9.0.18
Service
Models
- Available variants: 46
- Loaded: 1
- Cached: 3
Connectivity
- Local service: Reachable
- Model registry: Reachable
Warnings
GPU (RTX 3060) and CUDA 12.8 runtime are present and detected by foundry status, but foundry model list --variants shows CPU-only for every model. CUDA EP files exist under .foundry_local_samples\ep\cuda-ep\ but no GPU variants are ever offered by the catalog. Logs show a 400 Bad Request from the Azure Foundry catalog API on 7/29, followed by fallback to cached model info.
Problem
Diagnostics
System
Service
Models
Connectivity
Warnings