Customise, run and save LLMs utilizing OLLAMA and the Modelfile

On this article, I’ll present you the right way to use the Modelfile in Ollama to vary how an current LLM (Llama2) behaves when interacting with it. I’ll additionally present you the right way to save your newly personalized mannequin to your private namespace on the Ollama server.

I do know it could actually get a bit complicated with all of the completely different ”llamas” flying round. Simply keep in mind, Ollama is the corporate that allows you to obtain and domestically run many various LLMs. Whereas, Llama2 is a specific LLM created by Meta the proprietor of Fb. Other than this relationship, they aren’t linked in some other manner.

For those who’ve by no means heard of Ollama earlier than I like to recommend that you simply try my article under the place I’m going into depth on what Ollama is and the right way to set up it in your system.

What’s a modelfile?

In Ollama, a modelfile refers to a configuration file that defines the blueprint to create and share fashions with Ollama.