Meta has purchased NVIDIA’s new Blackwell B200 AI GPUs to train its Llama models, according to Meta CEO Mark Zuckerberg. The company is also training a third-generation of its Llama model on two GPU clusters that it announced last week, each of them packing around 24,000 of NVIDIA’s current-gen Hopper H100 AI GPUs.
2VIEW GALLERY – 2 IMAGES
The news is coming from a new report by Reuters, which said that Meta will continue using its current H100-powered AI GPU clusters to train its current-gen Llama 3 model, but will use NVIDIA’s new Blackwell B200 AI GPUs to train future generations of the model, according to a Meta spokesperson.
NVIDIA announced its new Blackwell B200 AI GPU at its GPU Technology Conference (GTC) event this week, offering gigantic improvements to all things AI.
Meta wants the best of the best, which is where the orders from the social networking giant for the best AI GPUs ever made come into play to power future Llama models. Meta has been one of NVIDIA’s biggest customers, buying up big quantities of AI GPUs over the last couple of years and that isn’t slowing down as now Blackwell is nearly here.
I recently reported that Meta CEO Mark Zuckerberg had a long-term vision for AGI (artificial general intelligence) that would be powered by the equivalent of 600,000 x NVIDIA H100 AI GPUs. Now that Blackwell is ramping up to release, Meta can super-charge its AGI efforts much faster.