AMD has provided some instructions on how to run DeepSeek’s exciting new R1 distilled “reasoning” model on AMD Ryzen AI and Radeon products… yeah, you can run a local DeepSeek R1 model on your PC at home.
AMD explains: “Reasoning models add a “thinking” stage before the final output – which you can see by expanding the “thinking” window before the model gives its final answer. Unlike conventional LLMs, which one-shot the response, CoT LLMs perform extensive reasoning before answering. The assumptions and self-reflection the LLM performs are visible to the user and this improves the reasoning and analytical capability of the model – albeit at the cost of significantly longer time-to-first-(final output)token”.
“A reasoning model may first spend thousands of tokens (and you can view this chain of thought!) to analyze the problem before giving a final response. This allows the model to be excellent at complex problem-solving tasks involving math and science and attack a complex problem from all angles before deciding on a response. Depending on your AMD hardware, each of these models will offer state-of-the-art reasoning capability on your AMD Ryzen™ AI processor or Radeon™ graphics cards”.
You can read the entire article with a step-by-step process on running DeepSeek R1 on your AMD Ryzen AI and Radeon-powered products right here.