Meta details Prometheus supercluster used to train its Muse AI models
Meta published details about Prometheus, its New Albany, Ohio, supercluster used to train the Muse family of AI models. The system combines Nvidia Grace Blackwell-based clusters, with a Vera Rubin-based cluster expected to join; Meta says Prometheus will eventually scale to a gigawatt of capacity and about a million accelerators. Meta also described measures to keep training running through hardware failures, including a pool of redundant GPUs: more than 11 percent of the GPUs are dead or idle as replacements, one account says.
