Meta is Working On Its Own Chip for AI
Meta – known as Facebook, Whatsapp, and Instagram parent company. Has announced the development of a new chip for running artificial intelligence (AI) models, and a new data center architecture for AI workloads.
Meta’s VP and Head of Infrastructure, Santosh Janardhan shared details of the progress made in a recent blog jd post. As Meta increases its AI efforts, CEO Mark Zuckerberg says the company “sees an opportunity to introduce AI agents to billions of people that will be useful and meaningful”.
Meta’s new chip called Meta Training and Inference Accelerator (MTIA) is an “in-house, custom accelerator chip family targeting inference workloads. MTIA provides greater compute power and efficiency than CPUs, and it is customized for our internal workloads.” With a combination of MTIA chips and GPUs, Meta believes “we’ll deliver better performance, decreased latency, and greater efficiency for each workload.”
TechCrunch reports that the MTIA chip is a long ways away, “due out in 2025, capable of both training AI modes and running them.”
Meta is also working on Research SuperCluster (RSC) AI Supercomputer. Will be the “one of the fastest AI supercomputers in the word” says Janardhan in the blog post). The goal of RSC is to “build to train the next generation of large AI models to power new augmented reality tools, content understanding systems, real-time translation technology and more.”
References :
- https://about.fb.com/news/2023/05/metas-infrastructure-for-ai/
- https://techcrunch.com/2023/05/18/meta-bets-big-on-ai-with-custom-chips-and-a-supercomputer/
- https://www.theverge.com/2023/5/18/23728678/meta-ai-new-chip-mtia-msvp-datacenter