Skip to main content
Connect Your AI

Run models locally with Ollama

Connect Vinaa to Ollama to chat with downloaded models on your Mac or models on an Ollama server.

Written By Sujeevan Nagarajah

Last updated 22 days ago

Ollama runs AI models on your computer and makes them available to apps such as Vinaa. A local model is an AI downloaded to your Mac; larger models need more memory and storage.

Install Ollama and download a model

  1. Download the Mac version from Ollama.

  2. Open the downloaded disk image.

  3. Drag Ollama to your Applications folder.

  4. Open Ollama.

  5. Complete its setup, allowing it to install its Terminal command if asked.

  6. Open Terminal on your Mac.

  7. Enter ollama pull llama3.2:3b and press Return.

  8. Wait for the download to finish.

This example downloads Llama 3.2 3B. You can use another model from Ollama's library by replacing llama3.2:3b with its name. See Ollama's Mac installation guide and command reference for more help.

Connect Ollama to Vinaa

  1. Choose Vinaa → Settings → AI Models.

  2. Click Add Connection in the toolbar.

  3. Choose Ollama under On This Mac & Local Servers.

  4. Leave Server set to This Mac.

  5. Check that Base URL is http://localhost:11434, unless you changed Ollama's address.

  6. Click Continue.

  7. Select the downloaded models you want in Choose Models.

  8. Click Add Connection.

In a chat, press ⌘L to choose one of your Ollama models. Keep Ollama running while you chat. Vinaa does not install Ollama or download models for you.

Use Ollama Cloud or another server

The Server menu also offers:

Choice

What to enter

Ollama Cloud

The preset Base URL is https://ollama.com. Enter an API Key from your Ollama key settings.

Custom

Enter the Ollama server's Base URL. Enter an API Key only if that server requires one.

An API key is a secret credential that lets Vinaa use your account. Direct Ollama Cloud access requires a key but does not require Ollama installed on your Mac. Cloud requests run on Ollama's servers; check Ollama Cloud for current plans and usage limits. See Ollama authentication for the difference between local and cloud access.

To change an existing connection, open it in AI Models, click Edit…, then click Save after your changes. After downloading another model, click Refresh in the connection's Models section.

Related articles

  • Run models locally with LM Studio

  • Use Apple's on-device model

  • Fix AI connection problems