Davide Santangelo

In this article, we will walk through how to create a very simple language model using Ruby. While true Large Language Models (LLMs) require enormous amounts of data and computational resources, we can create a toy model that demonstrates many of the core concepts behind language modeling. In our example, we will build a basic Markov Chain model that “learns” from input text and then generates new text based on the patterns it observed. Note: