Skip to content

Model catalog - Add LM Studio model #218

Description

LM Studio is a powerful, user-friendly desktop application that allows you to run large language models (LLMs) locally on your own machine.

Currently, the AI Toolkit has a quick way to add models from Ollama, however adding LM Studio models is not as easy.

To add a model (phi-4) from LM Studio you need to follow these steps:

  1. Add custom model
  2. Endpoint URL: http://127.0.0.1:1234/v1/chat/completions
  3. API model name: microsoft/phi-4
  4. Model display name: microsoft/phi-4
  5. Auth header: Leave empty
  6. Open in Playground

It would be great if Add LM Studio model was included as a another option alongside Add Ollama model to shorten these steps.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

feature requestThe issue is a feature requestneeds attentionThe issue needs contributor's attention

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions