Jake Teo

Leveraging AWS’s MLOps platform to serve your LLM models Jake Teo · Follow Published in Towards Data Science · 8 min read · 2 hours ago — Instances in an MLOps workflow that require an inference endpoint (created by author). In any machine learning project, the goal is to train a model that can be used by others to derive a good prediction. To do that, the model needs to be served for inference. Several