ollama

Ollama Setup:

1. Install Ollama:
   → https://ollama.com/
   (Mac/Linux/Windows — one-click installer)

2. Download a model:

   ollama pull llama3

    

3. Run it:

   ollama run llama3

    

4. Use via API (optional): 

   curl http://localhost:11434/api/generate -d '{
   
   "model": "llama3",
   
   "prompt": "Why is the sky blue?"
   
   }'

    

Done. Local LLM running in seconds.

Hi ashish,
This article may help you. https://www.c-sharpcorner.com/article/setup-ollama-with-openwebui-with-docker-in-local-windows/