Shirley Li

Mastering the art of fine-tuning: Learnings for training your own LLMs. Shirley Li · Follow Published in Towards Data Science · 17 min read · 8 hours ago — (Image from Unsplash) This is the third article in our GPT series, and also the most practical one: finally, we will talk about how to effectively fine-tune LLMs. It is practical in the way that, if you were asked to train your own LLMs today, you

Tracing the roots of ChatGPT: GPT-1, the foundation of OpenAI’s LLMs Shirley Li · Follow Published in Towards Data Science · 10 min read · 1 day ago — (Image from Unsplash) The GPT (Generative Pre-Training) model family, first introduced by OpenAI in 2018, is another important application of the Transformer architecture. It has since evolved through versions like GPT-2, GPT-3, and InstructGPT, eventually leading to the development of OpenAI’s powerful LLMs. In other words: