Skip to content
Tether Investor

Tether Investor

Breaking Technology News

  • News
  • Culture
  • Social
  • Enterprise
  • Science
  • Mobile
  • Gadgets
  • Internet
  • Cyber Security
  • Video News
  • Privacy Policy
    • DMCA / Copyrights Disclaimer
    • Terms and Conditions
    • Whitelist

Meta pulls the curtain back on its A.I. chips for the first time

News
May 18, 2023admin

17 hours ago

Investors have been closely watching Meta’s investments into AI and related data center hardware as the company embarks on a “year of efficiency” that includes at least 21,000 layoffs and major cost cutting.

Although it’s expensive for a company to design and build its own computer chips, vice president of infrastructure Alexis Bjorlin told CNBC that Meta believes that the improved performance will justify the investment. The company has also been overhauling its data center designs to focus more on energy-efficient techniques, like liquid cooling, to reduce excess heat.

One of the new computer chips, the Meta Scalable Video Processor (MSVP), is used to process and transmit video to users while cutting down on energy requirements. Bjorlin said “there was nothing commercially available” that could handle the task of processing and delivering 4 billion videos a day as efficiently as Meta wanted.

The other processor is the first in the company’s Meta Training and Inference Accelerator (MTIA) family of chips intended to help with various AI-specific tasks. The new MTIA chip specifically handles “inference,” which is when an already-trained AI model makes a prediction or takes an action.

Bjorlin said that the new AI inference chip helps power some of Meta’s recommendation algorithms used to show content and ads in people’s news feeds. She declined to answer who is manufacturing the chip, but a blog post said that the processor is “fabricated in TSMC 7nm process,” indicating that chip-giant Taiwan Semiconductor Manufacturing is producing the technology.

She said that Meta has a “multi-generational roadmap” for its family of AI chips that include processors used for the task of training AI models, but declined to offer details beyond the new inference chip. Reuters previously reported that Meta cancelled one AI inference chip project and started another that was supposed to roll out around 2025, but Bjorlin declined to comment on that report.

Because Meta isn’t in the business of selling cloud computing services like companies including Google-parent Alphabet or Microsoft, the company didn’t feel compelled to publicly talk about its internal data center chip projects, she said.

“If you look at we’re sharing—our first two chips that we developed—it’s definitely giving a little bit of a view into what are we doing internally,” Bjorlin said. “We haven’t had to advertise this, and we don’t need to advertise this, but you know, the world is interested.”

Meta vice president of engineering Aparna Ramani said the company’s new hardware was developed to work effectively with its home-grown PyTorch software, which has become one of the most popular tools used by third-party developers to create AI apps.

The new hardware will eventually be used to power tasks related to the metaverse, such as virtual reality and augmented reality, as well as the burgeoning field of generative AI, which generally refers to AI software that can create, compelling text, images, and videos.

Ramani also said that Meta has developed a generative AI-powered coding assistant for the company’s developers to help them more easily create and operate software. The new assistant is similar to Microsoft’s GitHub Copilot tool that it released in 2021 with help from the AI startup OpenAI.

In addition, Meta said it completed the second-phase buildout, or the final buildout, of its supercomputer dubbed Research SuperCluster (RSC), which the company detailed last year. Meta used the supercomputer, which contains 16,000 Nvidia A100 GPUs, to train the company’s LLaMA language model, among other uses.

Ramani said that Meta continues to act on its belief that it should contribute to open-source technologies and AI research in order to push the field of technology. The company has disclosed that its biggest LLaMA language model, LLaMA 65B, contains 65 billion parameters and was trained on 1.4 trillion tokens, which refers to the data used for AI training.

Companies like OpenAI and Google have not publicly disclosed similar metrics for their competing large language models, although CNBC reported this week that Google’s PaLM 2 model was trained on 3.6 trillion tokens and contains 340 billion parameters.

Unlike other tech companies, Meta released its LLaMA language model to researchers so they can learn from the technology. However, the LlaMA language model was then leaked to the wider public, leading to many developers building apps incorporating the technology.

Ramani said that Meta is “still thinking through all of our open source collaborations, and certainly, I want to reiterate that our philosophy is still open science and cross collaboration.”

Watch: A.I. is a big driver of sentiment for big tech

Post navigation

Oppo Reno 10 Pro+ Camera Specifications Confirmed: All Details
Netflix stock jumps 10% as it boasts ad-tier growth

Related Posts

China readies new Covid-19 rules as investors cheer easing shift

December 5, 2022admin

Apple shareholders reject outside proposal to end DEI programs

February 25, 2025admin

SurgePays: This Technology And Telecommunications Company Is Ready To Put The Pedal To The Metal

December 27, 2022admin

Recent Articles

  • CyberPowerPC India to Host Esports Masterclass Series in Navi Mumbai
  • iPhone 16 Available in India at Rs 69,999 in Flipkart’s GOAT Sale 2025
  • It’s a huge week for crypto in D.C. But the industry may not get everything it wants
  • Google Pixel Watch 4 Said to Use the Same Chip as Pixel Watch 3
  • Delhi High Court Orders E-Commerce Firms to Delist These Fake Products
  • Coreweave stock pops after company announces $6 billion AI data center in Pennsylvania
  • MP Materials stock rips 23% higher after $500 million Apple deal for rare earth magnets
  • Portronics Beem 540 Projector Launched in India: Price, Specifications
  • Samsung Galaxy F36 5G India Launch Date Announced; Design Shown
  • China’s Baidu to bring its driverless cars to Uber globally

Startups

  • State-Backed HazyBeacon Malware Uses AWS Lambda to Steal Data from SE Asian Governments
  • Securing Agentic AI: How to Protect the Invisible Identity Access
  • AsyncRAT’s Open-Source Code Sparks Surge in Dangerous Malware Variants Across the Globe
  • North Korean Hackers Flood npm Registry with XORIndex Malware in Ongoing Attack Campaign
  • The Unusual Suspect: Git Repos
  • New PHP-Based Interlock RAT Variant Uses FileFix Delivery Mechanism to Target Multiple Industries
  • ⚡ Weekly Recap: Scattered Spider Arrests, Car Exploits, macOS Malware, Fortinet RCE and More

Enterprise

  • Microsoft teams with Khan Academy to make its AI tutor free for K-12 educators and will develop a Phi-3 math model
  • Kyndryl and Nvidia team to enable and accelerate enterprise generative AI adoption
  • Does India have what it takes to challenge China in electronics manufacturing?
  • How the Web3 stack will automate the enterprise
  • Three ‘soft skills’ for every developer’s toolbox
  • Dissecting the hype over low-code
  • Cybersecurity is a corporate social responsibility, especially in times of war

Categories

  • Culture
  • Cyber Security
  • Enterprise
  • Entertainment
  • Gadgets
  • Gaming
  • Internet
  • Mobile
  • News
  • Science
  • Social
  • Video News

Useful Links

  • DMCA / Copyrights Disclaimer
  • Terms and Conditions
  • Whitelist Us
  • Disclaimer
  • Privacy Policy
  • Abuse

Categories

  • Culture
  • Cyber Security
  • Enterprise
  • Entertainment
  • Gadgets
  • Gaming
  • Internet
  • Mobile
  • News
  • Science
  • Social
  • Video News
Tether Investor | Theme: News Portal by Mystery Themes.