Microsoft is stepping up its AI game with exciting updates for its Copilot Plus PCs. They’re rolling out a host of AI-driven features to enhance search functionality and user interactions.
Starting in November, these innovations are expected to significantly improve how users interact with their devices, making daily tasks smoother and more intuitive.
Among the most anticipated updates are the enhanced AI-powered search features and the introduction of a new “Click to Do” feature. This feature promises to transform how users engage with content across their devices.
AI-Powered Search
One of the standout features of this update is the enhanced AI-based search in Windows. For years, Windows search has struggled to deliver accurate results. Even often frustrating users who had to remember exact file names or locations. That’s about to change.
What’s New with AI Search?
- Natural Language Processing (NLP): The new AI search capabilities will use advanced NLP. This will allow users to find files, images, emails, and documents without knowing exact keywords or file names. Want to find a photo of a birthday party from years ago? Simply type something like “birthday celebration,” and the AI will locate the most relevant images. Even if the keywords don’t appear in the file names.
- Enhanced Search in File Explorer: The improved search will first roll out in File Explorer. Users can now search for pictures using descriptive words, such as “sunset beach photo,” making it easier to sift through vast photo collections without needing to remember file names.
- Integrated Search Across Apps: Microsoft’s search upgrades won’t just be limited to File Explorer. Expect the enhanced search to be integrated into Windows’ main search interface, settings, and apps like OneDrive. The AI-powered system will even assist users in locating specific system settings, such as typing “connect headphones” in the Settings search box.
Click to Do
Another game-changing feature that will roll out with Copilot Plus PCs is the Click to Do functionality. Microsoft’s version aims to provide users with interactive overlays that allow for quick actions and shortcuts. Oh, yes this was inspired by Google’s Circle to Search.
How Does Click to Do Work?
- Instant Shortcuts: By pressing the Windows key and left-clicking, an overlay will appear. Hence, providing options to interact with the content on your screen. This could range from selecting an image in a YouTube video for a Bing search, to choosing text from a document to summarize or edit.
- Context-Aware Actions: Click to Do isn’t just limited to visual content. It’s designed to be context-aware. This means it can offer text-related actions such as rewriting paragraphs, summarizing text, explaining complex phrases, or even composing emails – all without needing to leave the page you’re on.
- Optimized for Speed and Efficiency: Whether you’re watching a video, editing a document, or browsing the web, Click to Do allows you to instantly perform actions, reducing the time spent on repetitive tasks.
Real-Life Applications of Click to Do
Imagine watching a YouTube video where someone is wearing a jacket you really like. With Click to Do, you can select the jacket, and the system will perform a visual search using Bing to find similar products.
Or maybe you’re reviewing a lengthy report and want a quick summary of a few paragraphs. Instead of manually copying and pasting, Click to Do lets you summarize text with just a click, saving valuable time and effort.
Early Access and Rollout Plans
Microsoft plans to test these features with Windows Insiders in October, followed by a broader release in November.
The gradual rollout will ensure the system performs optimally. Microsoft has emphasized that these tools will be enhanced by the NPU chips in Copilot Plus PCs, which handle local searches on OneDrive content even when users are offline.
The highly anticipated Recall feature, previously announced, will also become available for testing. Initially exclusive to Qualcomm-powered devices, it will roll out to Intel- and AMD-powered devices starting in November. Recall is designed to help users track and retrieve important information across their apps and documents.
Generative Fill and Erase in Microsoft Paint
In addition to search improvements, Microsoft is bringing AI-driven features to some of its most iconic apps, including Microsoft Paint. Generative fill and erase functions will be introduced, allowing users to modify images with ease.
Stay informed with the latest news in AI and tech, and receive daily actionable tips and advice right in your inbox. Work less, earn more and read about the latest trends before everyone else 🫵
Imagine filling in the background or erasing unwanted elements from a photo—all with a simple click. These features are part of Microsoft’s ongoing effort to make creative tools more accessible to everyday users.
Why These AI Features Matter
AI continues to reshape how we interact with technology. Microsoft’s new tools are pushing the boundaries of what’s possible on a personal computer.
The company’s focus on enhancing user experiences through natural language processing and intuitive features like Click to Do signals a future where interacting with technology feels seamless and instinctive.
For businesses and everyday users alike, these changes represent a significant step toward a more integrated, user-friendly computing environment. No longer will users need to remember intricate file names or struggle to find the right settings. AI is bridging the gap between technology and human intuition.
What’s Next for Windows Copilot Plus PCs?
As Microsoft continues to test and refine these features, tech enthusiasts and everyday users will be eager to see how well they perform in real-world scenarios.
While AI’s potential is vast, the real test will be in its execution – ensuring that these tools work smoothly and efficiently.
With major investments in AI across the tech industry, Microsoft’s latest efforts reflect the fierce competition to stay at the forefront of innovation. As these AI-powered features roll out, it’s clear that Microsoft is aiming to set new standards for user-friendly, intelligent computing.
If the early results are anything to go by, Copilot Plus PCs may just be the new gold standard in AI-enhanced personal computing.
| Feature | Description | Rollout Timeline |
|---|---|---|
| AI-Powered Search | Natural language search in File Explorer, OneDrive, and system settings | November 2024 |
| Click to Do | Interactive shortcuts for images, text, and videos | November 2024 |
| Recall | Tool for retrieving information across apps | October 2024 |
| Generative Fill/Erase | AI-driven image editing in Microsoft Paint | November 2024 |
By infusing everyday tasks with smart AI capabilities, Microsoft is making it easier for users to manage their content, search intuitively, and interact with digital media in ways that feel natural. Will this be a game-changer for Windows users? All signs point to yes.
