Introduction: Unlock the Power of Ollama Serve In an era where artificial intelligence is democratized, Ollama Serve emerges as a revolutionary platform offering access to large language models (LLMs) locally. This guide walks you through every step—from installation to utilization—ensuring you harness its full potential. What is Ollama Serve? Ollama Serve is more than just […]
Category: How-To
Perhaps not the best way to handle this but for a quick and dirty fix this might work for you. Edit /etc/docker/daemon.json Restart the docker daemon for those changes to take effect: Now when you start a container, docker will populate /etc/resolv.conf with the values from daemon.json Why did I do this? I wanted my […]
Running large language models (LLMs) on home hardware can be a challenging task due to the significant computational resources required by these models. However, with the right setup and configuration, it is possible to train and run LLMs on your personal computer or laptop. The first step in running an LLM on your home hardware […]
There are several ways you can run Ollama as a service, but one of the most popular options is using Google Cloud Run. This platform allows you to deploy and run containerized applications on-demand without managing infrastructure. You can use Docker containers to package and deploy your Ollama model, and then use Cloud Run to […]
Why is this needed If your system supports SMP (Symmetric multiprocessing) with some combination of multiple physical CPUs, CPU cores, and logical CPUs, you can achieve increased performance in some cases by assigning Docker Containers to specific CPU resources. This process is known as CPU affinity (or processor affinity). Gather Required Information To assign a […]
This image is built from the latest released .deb packages and should be identical to a standard OpenWebRX+ installation on Debian. All receivers and demodulators available in this image. Install Blacklisting device drivers on host You should disable the kernel drivers for RTL, SDRPlay and HackRF devices on the host linux (where docker runs) before […]