Aris Tsakpinis

AI

Preference Alignment for Everyone!

Frugal RLHF with multi-adapter PPO on Amazon SageMaker Aris Tsakpinis · Follow Published in Towards Data Science · 26 min read · 9 hours ago — Photo by StableDiffusionXL on Amazon Web Services Note: All images, unless otherwise noted, are by the author. What is this about and why is it important? Over the last 2 years, research and practice have delivered plenty of proof that preference alignment (PA) is a game changer for boosting

Read More »
AI

A Deep Dive into Fine-Tuning

Stepping out of the “comfort zone” — part 3/3 of a deep-dive into domain adaptation approaches for LLMs Aris Tsakpinis · Follow Published in Towards Data Science · 24 min read · 14 hours ago — Photo by StableDiffusionXL on Amazon Web Services Exploring domain adapting large language models (LLMs) to your specific domain or use case? This 3-part blog post series explains the motivation for domain adaptation and dives deep into various options to

Read More »
AI

A Deep Dive into In-Context Learning

Stepping out of the “comfort zone” — part 2/3 of a deep-dive into domain adaptation approaches for LLMs Aris Tsakpinis · Follow Published in Towards Data Science · 10 min read · 15 hours ago — Photo by StableDiffusionXL on Amazon Web Services Exploring domain adapting large language models (LLMs) to your specific domain or use case? This 3-part blog post series explains the motivation for domain adaptation and dives deep into various options to

Read More »