Running LLMs on Fedora 42 Kinoite with an AMD GPU using Ollama
This is a short guide to getting Ollama working with an AMD GPU on a Fedora 42 Kinoite system. In practice, the methods discussed should work on any Fedora 42 immutable variant, including but not limited to Fedora 42 Silverblue. When attempting to install ROCm on Fedora 42 Kinoite (I’ll be referring to this as F42K from now on), I encountered several issues: The installation guide for ROCm does not include a Fedora version. Attempting to install the RHEL version leads to an error message stating it does not support the current distribution. Fedora packages does have a rocm meta package, however, it is currently only supported on Rawhide or EPEL 10.1 (which isn’t recommended on Fedora systems). Rebasing from F42K to Fedora Kinoite Rawhide is not feasible due to some layered packages having dependency issues due to missing packages in the Rawhide package repository. Therefore, we need a workaround for installing ROCm: containers! ...