Media Summary: This video was originally sponsored by ITProTV. We've since launched NetworkChuck Academy, our own place to learn IT: ... I bought this motherboard because it was only Dave tests llama3.1 and llama3.2 using Ollama on a Raspberry Pi, a Herk Orion Mini PC, a 3970X, an M2 Mac Pro, and a ...
Local Ai Server For 150 Budget - Detailed Analysis & Overview
This video was originally sponsored by ITProTV. We've since launched NetworkChuck Academy, our own place to learn IT: ... I bought this motherboard because it was only Dave tests llama3.1 and llama3.2 using Ollama on a Raspberry Pi, a Herk Orion Mini PC, a 3970X, an M2 Mac Pro, and a ... I spent over a year building Project Nomad, a completely free and open source offline knowledge Hosting your own LLMs like Llama 3.1 requires INSANELY good hardware - often times making running your own LLMs ... Set up your own Learning Model that isn't in the cloud or owned by anyone but you! Check out the forum here: ...
This is the stack that gets me over 4000 tokens per second I put a tiny MacBook Air between me and some ridiculously large
