If there’s one thing we learned from Meta Connect 2024 it’s that the tech giant is still in the game for the “metaverse”, even if it’s not using that term like it did three years ago. Meta CEO Mark Zuckerberg took to the stage Wednesday to help show off the new Quest 3S VR headset and updated Ray-Ban smart glasses. The big news, however, centers on the “Orion” model, the company’s first true pair of AR glasses.
Like Meta Connect 2023, this year’s conference featured Zuckerberg showcasing his company’s efforts to combine AI and mixed reality aspirations. At the same time, Meta is rolling out big plans to fill its social media apps with AI, whether you want it or not.
Meta’s Quest 3S is an Inexpensive VR Headset for Beginners
If the Quest 3’s $500 starting price put you off, Meta hopes its $300 Quest 3S will be your ticket to the wonderful world of VR. It has the same chip and RAM specs as the Quest 3, but the 3S has a worse display and lacks a depth sensor for better hand tracking. However, the Meta promises that it will still have all the same software capabilities as its older brother.
It will still support the full Quest 3 game and app library, and anyone who orders the headset between now and next April will get the upcoming game Batman: Arkham Shadow. The Quest 3S starts at $300 for 128 GB, but the 256 GB version costs $400. Also, Meta reduced the price of the 512 GB Quest 3 from $650 to $500.
Project ‘Orion’ is Meta’s First Pair of Authentic AR Glasses
The big reveal of Meta Connect was the culmination of Zuckerberg’s long-time dream of a “metaverse”. “Orion” is Meta’s first real pair of AR glasses, though it’s still in prototype format. They are thick-framed glasses with a single waveguide-type screen that displays an upward-facing display. It packs some AR capabilities, like hand and eye tracking with seven sensors built into the frame. The device includes a wristband and a “compute puck” to handle all the touch interpretation and processing of the glasses.
All Windows 11 PCs Will Be Able To Stream On Demand
Meta has announced that it is working with Microsoft to enable any Windows 11 PC screencast to Meta Quest devices. According to a short demo shown on Connect, it should work like the Apple Vision Pro glasses feature for Mac. Your simulated Windows screen will appear in front of you within a sliding window. You will be able to use your mouse and keyboard to interact with your laptop as usual. As far as we can tell right now, Meta hasn’t given an expected release date.
You will be able to use Quest Travel Mode on trains
Horizon OS is installed travel mode earlier this year, it looks like it will compete directly with the Apple Vision Pro. During Connect, Meta said it plans to expand the mode to work on trains. Meta said it will soon support downloading videos for offline viewing to add to the mobility capabilities. The company will also add official support for using the device while sleeping.
Meta’s Nixing the Quest 2 and Quest Pro
With the Quest 3S, Meta is ditching the previous cheaper Quest 2 headset alongside the more expensive Quest Pro. Meta said it will sell both devices until the end of the year, or until they run out.
You can use your phone to scan your room and see it in Quest
Zuckerberg told the Connect audience that he was working on a beta “Hyperscape” app that would allow users to scan any room and interact with it on Quest headsets. The app recreates environments using 3D rendering volume. We currently have no idea when it will be available, but the company is releasing a few demos that show space simulations.
Ray-Ban’s Meta Smart Glasses Get More AI Upgrades
I Meta Ray-Bans it came as a surprise to everyone, including—apparently—even Meta. The social media giant once developed glasses with them AI vision and speech recognition abilities. The company will upgrade the glasses with Morse assistant features, such as setting reminders. Users will soon be able to scan QR codes or phone numbers on the glasses, apparently allowing you to unlock them on your phone. Meta added that it will also be integrated with audiobook and music apps, including Spotify, Amazon Music, and Audible.
A few more features are coming later this year. Users will be able to translate live between English and three other languages: French, Italian, and Spanish. Meta revealed that it is working on a few other AI vision skills. This can work like other wearable AI efforts like A person’s PIN. Users should be able to ask questions about their location and receive AI-generated answers. Whether they will be accurate is another question entirely.
Meta Smart Glass Will Work With Prescription Lenses And Sunglasses
Zuckerberg shared that the next versions of Ray-Bans will include other types of EssilorLuxottica lenses, such as prescription lenses and transition lenses for both indoor and outdoor use. Brands also plans to release a limited edition clear plastic Wayfarer-Meta Ray-Bans that will appeal to older Game Boy clear owners. Those limited-edition glasses cost $430, $100 more than the standard Wayfarer glasses.
Meta’s smart glasses will connect with the Be My Eyes App
Zuckerberg said he is working with the app makers behind Be My Eyes to integrate the accessibility app with Meta’s Ray-Bans. The app works to connect visually impaired or blind people with volunteers via video to explain their location. This integration will enable it to work with cameras on Ray-Bans, allowing volunteers to see exactly what app users are looking at.
“Meta AI” will take over your Facebook, Instagram, Messenger, and WhatsApp
While its hardware game seems strong, Meta isn’t done incorporating AI into all of its businesses, especially social media applications that is still its greatest invention. The first thing users will notice when they try to search their feed is the AI voice feature. This will allow AI chatbots to talk to users like the latest ChatGPT voice assistant. That feature will roll out to users in the US, Canada, Australia, and New Zealand next month.
Meta AI also gets the features of vision. You can use them in chat functions of various applications to describe images. Meta gave an example of how it can tell the type of unknown bird you sent to your friends. The chat function can even edit the picture based on your information. Like Google’s Magic Editor, we can remove unwanted elements from your photos by replacing pixels.
Facebook and Instagram May Soon Be Filled with More AI Slop
Those who have noticed their Facebook feed was filled in at the edges with AI slop know that Meta is exploring ways to add more AI-generated content. Meta said it is working on a system that will generate content based on what you’ve already watched. The company said this content will be “based on your interests.” Some content will “show you” based on what Facebook knows about your interests.
The social giant is planning more features. The key is automatic video dubbing and lip syncing to Reels. When you’re mindlessly scrolling through videos on Instagram, Meta says you’ll be able to watch them “in your favorite language.”
There is a new version of Llama that can understand images and text
The following interpretations of Meta’s Llama LLM include smaller and larger models. There are 11B- and 90B-parameter multimodal models capable of understanding images and text. In addition, the 1B and 3B sub-models are designed to work on mobile devices and not in the cloud. Meta said these models should work with Qualcomm and MediaTek mobile chips.
All versions of Llama 3.2 are available with company website again A Hugging Face.