FiveTech Support Forums

FiveWin / Harbour / xBase community
Board index latest AI news ollama increasing the context window
Posts: 44158
Joined: Thu Oct 06, 2005 05:47 PM
ollama increasing the context window
Posted: Fri Jan 31, 2025 06:20 AM

Ollama defaults to 2k context window. To increase it:

ollama run deepseek-r1:32b

/set parameter num_ctx 8192

/save deepseek-r1:32b-8k

ollama serve

regards, saludos

Antonio Linares
www.fivetechsoft.com
Posts: 44158
Joined: Thu Oct 06, 2005 05:47 PM
Re: ollama increasing the context window
Posted: Sat Feb 01, 2025 11:02 AM

Access this from your web browser to check if Ollama server is running:

localhost:11434

and you will get:

"Ollama is running"

regards, saludos

Antonio Linares
www.fivetechsoft.com
Posts: 44158
Joined: Thu Oct 06, 2005 05:47 PM
Re: ollama increasing the context window
Posted: Sat Feb 01, 2025 11:09 AM
on Mac need to run this command:

launchctl setenv OLLAMA_HOST "0.0.0.0"

and restart the ollama

Our good friend Lailton is testing from his Mac M1 Pro :D
regards, saludos

Antonio Linares
www.fivetechsoft.com

Continue the discussion