TopCoderCloud
My programming blog
πŸ“° TRENDING
Uncategorized

How to AI Ollama Remotely as if It Were Local Using SSH

How to AI Ollama Remotely as if It Were Locally Available on your computer using SSH

This will serve ollama ai llms as if they were locally available on your computer from a server, the 11434 is the usual ollama port that serves it AI LLMs.

Plain Text
ssh -L 11434:localhost:11434 -i /home/path/pub_key [username]@[remote_ip_address]

Though on the local computer, you then need to do the following. You need to indicate the variable OLLAMA_HOST of the information of its new server utilizing the ssh connection. Run this statement before doing a ollama list or running OpenCode.

Bash
export OLLAMA_HOST=http://localhost:11434

0 Comments

Leave a Comment