Using GPUs with Reor

How to use NVIDIA & AMD GPUs with Reor


Reor uses Ollama to run LLMs. However, right now we don't package GPU support with the app. You will need to download Ollama and run it alongside Reor to ensure that local LLMs you use through Reor can use your GPU.

On MacOS, you typically don't need to change anything: Apple Silicon should have GPU enabled by default and for Intel Macs GPU should be disabled.

For more info on using GPUs see the Ollama documentation.