Qualcomm, Meta Join Hands To Enable on-device AI apps By CIOTechOutlook Team

Qualcomm, Meta Join Hands To Enable on-device AI apps

CIOTechOutlook Team | Wednesday, 19 July 2023, 06:06 IST

To optimize the use of Meta's Llama 2 big language models directly on devices rather than solely relying on cloud services, Qualcomm Technologies has announced that it is collaborating with Meta. According to Qualcomm, running generative artificial intelligence models like Llama 2 on devices like smartphones, PCs, virtual reality (VR)/augmented reality headsets, and cars enables developers to save on cloud costs and offer users more private, dependable, and customized experiences.

Consequently, the chip-maker plans to "make available on-device Llama 2-based AI implementations to enable the creation of new and exciting AI applications." Customers, partners, and developers will be able to create use cases such as intelligent virtual assistants, productivity software, content creation tools, and more. These brand-new, Snapdragon-powered on-device AI experiences can operate in places with no connectivity or even while in airplane mode.

"To effectively scale generative AI into the mainstream, AI will need to run on both the cloud and devices at the edge, such as smartphones, laptops, vehicles, and IoT devices," said Durga Malladi, senior vice president and general manager of technology, planning and edge solutions businesses, Qualcomm Technologies.

Due to its innovation in on-device AI, the chip manufacturer is ideally situated to serve the Llama ecosystem.

"The Company has an unmatched footprint at the edge -- with billions of smartphones, vehicles, XR headsets and glasses, PCs, IoT, and more, being powered by its industry-leading AI hardware and software solutions -- enabling the opportunity for generative AI to scale," Qualcomm said.

Starting in 2024, the chip manufacturer plans to offer Llama 2-based AI implementation on devices running the Snapdragon processor.