Stories

  1. Image: The Register

    Meta details Prometheus supercluster used to train its Muse AI models

    Meta published details about Prometheus, its New Albany, Ohio, supercluster used to train the Muse family of AI models. The system combines Nvidia Grace Blackwell-based clusters, with a Vera Rubin-based cluster expected to join; Meta says Prometheus will eventually scale to a gigawatt of capacity and about a million accelerators. Meta also described measures to keep training running through hardware failures, including a pool of redundant GPUs: more than 11 percent of the GPUs are dead or idle as replacements, one account says.

  2. Image: Meta Engineering

    Meta details Prometheus AI supercluster, scaling plans and training reliability

    Meta published an account of Prometheus, its gigawatt-scale AI supercluster in New Albany, Ohio, whose first phase is complete and has trained the Muse family of models, including Muse Wonder. The company says it is scaling the site toward roughly 1 million GPUs and describes its hardware, networking and closed-loop liquid cooling. Meta reports more than 85% goodput for Muse Wonder pre-training and more than 90% for reinforcement learning, with interruptions averaging about 47,000 GPU hours apart; firmware fixes have raised that figure past 54,000 GPU hours.

Publishers