Meta’s Next Llama AI Models Are Training on a GPU Cluster ‘Bigger Than Anything’ Else

Posted on:
Key Points

Managing such a gargantuan array of chips to develop Llama 4 is likely to present unique engineering challenges and require vast amounts of energy..

Meta executives on Wednesday sidestepped an analyst question about energy access constraints in parts of the US that have hampered companies efforts to develop more powerful AI...

According to one estimate, a cluster of 100,000 H100 chips would require 150 megawatts of power..

Some AI experts worry that making significantly more powerful AI models freely available could be dangerous because it could help criminals launch cyberattacks or automate the design of chemical or biological weapons..

Today, the signature offering based on Llama models is the ChatGPT-like chatbot known as Meta AI thats available in Facebook, Instagram, WhatsApp, and other apps...