Google is once again pushing the boundaries of how we search for information. With the latest update to Google Lens, users can now search using video and voice, taking interactive searches to a new height.
This feature is currently available on Android and iOS through Search Labs, making search experiences not only more engaging but also more convenient.
Bringing Video and Voice Search to Life
Imagine you’re visiting an aquarium and notice a school of fish swimming in unison. You’re curious about their behavior, so you pull out your phone, open Google Lens, and start recording a video while asking your question.
Within seconds, you receive an explanation, thanks to the power of Google’s new AI model, Gemini. It’s like having a knowledgeable friend right in your pocket, ready to provide answers.
This fresh update is bound to be a hit with younger generations, especially Gen Z, who often look for quick and interactive ways to satisfy their curiosity. But it doesn’t stop there—Google is setting the stage for a more intuitive future in digital searches.
How the Gemini AI Model Works
The magic behind this new feature lies in Google’s AI model, Gemini. When you capture a video, Gemini processes it as a series of images, similar to how Google Lens currently handles photos.
However, the key difference is that Gemini can analyze multiple frames in a row, providing a more comprehensive answer based on a sequence of visual information.
Rajan Patel, VP of Engineering at Google, elaborated on this process, explaining that the AI looks at multiple images consecutively to give answers drawn from a vast range of web-based information. This marks a significant leap from the previous version of Google Lens, making it smarter and more intuitive.
Key Features of the Update:
- Video and Voice Search: Now live on Google Lens via Android and iOS.
- Gemini AI Model: Analyzes videos frame by frame for accurate answers.
- Voice Search for Photos: Available globally but only in English at the moment.
What About Sound Recognition?
While the new feature in Google Lens is impressive, it doesn’t yet recognize sounds in videos. For instance, it can’t identify a bird by its song, a skill that could add a whole new dimension to nature exploration.
However, Patel hinted that Google is already working on this capability, so sound recognition could soon be a part of this innovative tool.
Making Search More Natural
Incorporating video and voice search into Google Lens is part of Google’s effort to make searches feel more natural and less restricted to typing or still images. This enhancement opens up more ways for users to interact with their surroundings and receive instant information.
Stay informed with the latest news in AI and tech, and receive daily actionable tips and advice right in your inbox. Work less, earn more and read about the latest trends before everyone else 🫵
For example, if you’re cooking and unsure about a particular ingredient’s use, you can record a short video, ask your question aloud, and get your answer in real-time.
How to Use the New Feature:
- Open Google Lens on your Android or iOS device.
- Point your camera at the subject of your interest.
- Record a video while asking your question.
- Receive an answer based on what the AI analyzes from the video.
Sound Recognition in the Works
Sound recognition is a natural next step for this technology, allowing users to identify objects or animals not just by sight but also by sound. This development would make Google Lens even more versatile, adding another layer of interactivity.
For now, we can expect continuous improvements as Google refines Gemini’s abilities to provide even richer search experiences.
Why This Update Matters
This feature isn’t just a novelty; it’s a glimpse into the future of search. By allowing video and voice to lead the way, Google is making information more accessible and user-friendly. It reflects a move towards an era where searching isn’t limited to keywords or text but can happen through our natural interactions with the world around us.
Benefits of Video and Voice Search:
- Enhanced User Experience: More interactive and engaging than traditional text searches.
- Immediate Answers: Provides on-the-spot information, reducing the need for extended searches.
- Natural Interaction: Mimics real-life conversations, making searches feel more fluid.
Balancing Pros and Cons
Like any new technology, this update has its pros and cons. On the one hand, video and voice search can enhance user experience and make information more accessible. On the other hand, some users may have privacy concerns or need time to adapt to this new way of searching.
Pros:
- Offers a more interactive and engaging way to search.
- Reduces reliance on text and typing.
- Ideal for quick, on-the-go queries.
Cons:
- Privacy concerns when using video in public spaces.
- May not yet be fully accessible in all languages.
How It Stacks Up Against Other Search Tools
Compared to other search tools, Google Lens with video and voice search is a game-changer. While other platforms like Siri or Alexa offer voice-based interactions, combining it with video analysis gives Google Lens a unique edge.
It transforms the search experience from a simple Q&A into an interactive exploration of the user’s environment.
Stay informed with the latest news in AI and tech, and receive daily actionable tips and advice right in your inbox. Work less, earn more and read about the latest trends before everyone else 🫵
A Fun Nod to Pop Culture
Did you know that Google Lens’ existence can be partly traced back to J-Lo? It’s a quirky reference, alluding to how a cultural moment can sometimes spark technological advancements. Who would’ve thought that such a simple tool would evolve into something so powerful?
Looking Ahead: A More Interactive Future
The latest update to Google Lens shows Google’s commitment to making search more dynamic and engaging. While sound recognition is still in development, it’s clear that Google is on a path to make searching even more immersive and natural. For now, we can enjoy this new way of exploring the world, one video at a time.
| Feature | Description | Availability |
|---|---|---|
| Video and Voice Search | Search using videos and voice for instant answers. | Android and iOS through Search Labs |
| Gemini AI Model | Analyzes videos frame-by-frame to provide responses. | Live globally |
| Voice Search for Photos | Ask questions using your voice when searching photos. | Available globally, in English only |
| Sound Recognition | Future feature in development for sound analysis. | Not available yet |
Final Thoughts
Google’s latest update to Google Lens is not just a new feature; it’s a step toward a more intuitive and seamless way to interact with information. With its ability to handle video and voice, it redefines how we think about searching for information in our everyday lives.
It’s like having a personal, knowledgeable assistant at your fingertips, ready to help explore the world around you.
Whether you’re a tech enthusiast or just someone curious about your surroundings, this update has something for everyone. And with Google continuously improving its AI capabilities, the future of search looks brighter and more interactive than ever.
