Google Lens Just Got a Major Upgrade: Now Search with Videos!

Google Lens has just received a massive upgrade that unlocks a whole new way to search: using videos! Previously limited to image and text searches, Google Lens now lets you search for information by simply recording a short video. This groundbreaking feature utilizes the power of Gemini AI, Google's latest and most advanced AI model, to provide comprehensive and insightful answers.

How Video Search Works

1. Open the Google Lens app on your iOS or Android smartphone.

2. Press and hold the "Search" button in the middle of the screen to record a 20-second video.

3. As you record, you'll see the text "Speak now to ask about this video."

4. Ask your question using your voice. For example, "Why are those fish swimming together?"

5. Google Lens will display an AI Overview, which uses Gemini AI to summarize information from various websites.

6. The AI Overview will also include links if you want to learn more.

Additional Advantages

Google Lens can understand a sequence of images (frames) within the video you record.

The specially developed Gemini model can understand multiple images in order and provide a response drawn from the web.

New Features and Enhancements

Google Lens Shopping Queries and "Circle to Search" feature: This feature now also includes reviews, prices, retail availability, current deals, and relevant shopping ads.

How does Google Lens search using videos?

Google Lens now allows users to search for information using videos, a feature that was previously limited to images and text-based searches. To use this feature, open the Google Lens app on your iOS or Android smartphone and press and hold the "Search" button to record a 20-second video. While recording, you can ask a question about the video using your voice. Google Lens will then use Gemini AI to summarize information from various websites and display an AI Overview. This AI Overview will also include links if you want to learn more.

What kind of information can you search for with Google Lens's new video feature?

You can ask questions about what you see in the video using your voice, such as "Why are those fish swimming together?" Google Lens will then use Gemini AI to summarize information from various websites and display an AI Overview. This AI Overview will also include links if you want to learn more.

What is the AI model used in Google Lens's new video feature?

Google Lens's new video feature uses a specially developed Gemini model to understand multiple images in order and provide a response drawn from the web.

What are some of the limitations of Google Lens's new video feature?

While Google Lens's new video feature is powerful, it does have some limitations. Currently, video search is only available in English. Additionally, the feature is still in testing and only available through Search Labs. Google is still experimenting with voice recognition, so you can't yet identify bird species from their calls.

Exploring the Potential

Google Lens's ability to understand and search through videos opens up a world of possibilities for information discovery. This new feature is a testament to the ongoing evolution of AI and its potential to revolutionize how we interact with the world around us.