Combine Text Embeddings and Knowledge (Graph) Embeddings in RAG systems

15 min read

14 hours ago

In my previous articles, I wrote about using Knowledge Graphs in conjunction with RAGs and how Graph techniques can be used for Adaptive tokenization to build more context-aware LLMs. In this article, I am excited to present my experiments combining Text Embeddings and Knowledge (Graph) Embeddings and observations on RAG performance. I will start by explaining the concept of Text and Knowledge Embeddings independently, using simple open frameworks, then, we will see how to use both in RAG applications. This is fairly a long article…