If you’ve ever used yt-dlp or gallery-dl from the command line to save videos, images, or media from around the web you already know how powerful these tools are. But running them manually, remembering the flags, managing cookies for authenticated sites, and keeping track of what you’ve downloaded gets tedious fast. That’s why I built […]
Category: How-To
Introduction: Unlock the Power of Ollama Serve In an era where artificial intelligence is democratized, Ollama Serve emerges as a revolutionary platform offering access to large language models (LLMs) locally. This guide walks you through every step—from installation to utilization—ensuring you harness its full potential. What is Ollama Serve? Ollama Serve is more than just […]
Perhaps not the best way to handle this but for a quick and dirty fix this might work for you. Edit /etc/docker/daemon.json Restart the docker daemon for those changes to take effect: Now when you start a container, docker will populate /etc/resolv.conf with the values from daemon.json Why did I do this? I wanted my […]
Running large language models (LLMs) on home hardware can be a challenging task due to the significant computational resources required by these models. However, with the right setup and configuration, it is possible to train and run LLMs on your personal computer or laptop. The first step in running an LLM on your home hardware […]
There are several ways you can run Ollama as a service, but one of the most popular options is using Google Cloud Run. This platform allows you to deploy and run containerized applications on-demand without managing infrastructure. You can use Docker containers to package and deploy your Ollama model, and then use Cloud Run to […]
Why is this needed If your system supports SMP (Symmetric multiprocessing) with some combination of multiple physical CPUs, CPU cores, and logical CPUs, you can achieve increased performance in some cases by assigning Docker Containers to specific CPU resources. This process is known as CPU affinity (or processor affinity). Gather Required Information To assign a […]