LMStudio

A kind of IDE for running LanguageModels

https://lmstudio.ai/

Has built-in server which clones the OpenAI API so LanguageModelApps that can connect to OpenAI over http can also talk to locally hosted.