Tom Fenton moves from local AI concepts to hands-on tools for matching LLMs to hardware, running local chatbots with Ollama and benchmarking AI performance.
Before diving into the internals of an LLM, it’s a good idea to first understand what an LLM actually is. In this blog, we will learn about BPE (Byte Pair Encoding) - the tokenization algorithm used ...