Srijanie Dey, PhD

AI

Deep Dive into Anthropic’s Sparse Autoencoders by Hand ✍️

Explore the concepts behind the interpretability quest for LLMs Srijanie Dey, PhD · Follow Published in Towards Data Science · 11 min read · 20 hours ago — Image by author (Zephyra, the protector of Lumaria by my 4-year old) “In the mystical lands of Lumaria, where ancient magic filled the air, lived Zephyra, the Ethereal Griffin. With the body of a lion and the wings of an eagle, Zephyra was the revered protector of

Read More »
AI

Deep Dive into LlaMA 3 by Hand ✍️

Explore the nuances of the transformer architecture behind Llama 3 and its prospects for the GenAI ecosystem Srijanie Dey, PhD · Follow Published in Towards Data Science · 11 min read · 6 hours ago — Image by author (The shining LlaMA 3 rendition by my 4-year old.) “In the rugged mountain of the Andes, lived three very beautiful creatures — Rio, Rocky and Sierra. With their lustrous coat and sparkling eyes, they stood out

Read More »