Microsoft’s ‘Click to Do’ Feature Will Be Your On-Screen Assistant Every Step of the Way

Microsoft Visual Search Click to Do featured image
Image Courtesy: Microsoft
In Short
  • Microsoft's new Click to Do helps users make visual searches of text, images, and videos on screen.
  • Windows Search has also improved, letting users search for image content to find them easily.
  • The new features are set to roll out to Windows Insiders on Copilot Plus PCs starting in October.

Let’s admit it; the moment Google announced its Circle to Search feature earlier this year, our hands have been itching to get something similar on other OSes. Well, it looks like Microsoft heard us. The company has now announced a new ‘Click to Do’ feature for Windows users alongside its Copilot redesign, making quick actions available every step of the way.

This is not the first time Microsoft has tried bringing a Circle to Search-like feature. Microsoft Edge Canary features a Circle to Copilot feature that works all too similarly. Using your mouse, you just have to circle on-screen content to get more details about it. However, with Click to Do in Windows 11, you can hit right-click to find the option to do a “Visual Search with Bing” right there.

Microsoft has announced a brand new Click to Do feature
Image Courtesy: Microsoft

You can also hit the Windows Key, and an interactive overlay will appear, that features this option. Yusuf Mehdi, Executive VP and Consumer CMO at Microsoft states, “Click to Do works by first understanding everything you’ve seen on your screen and enabling useful shortcuts to actions to help you more quickly search, learn, edit, shop, or act on those items. It works on any window, document, image, or even video.”

However, that’s not the only spotlight in the myriad of announcements. Turns out, Microsoft is finally improving Windows Search with the use of AI. Users can now search for images by simply describing its contents. This is similar to how one can make use of Pixel Screenshots to search for image content.

Given how terrible the image clutter can get (just look at my downloads and screenshots folder), it seems like a feature that the community will welcome with open arms. Moreover, Windows Search has been terribly slow and buggy for a long time. So, hopefully, with the addition of new AI features, Microsoft will address those issues as well.

The AI image search feature will first be introduced in the File Explorer and later expanded to other areas in Windows. However, do note that both Click to Do and the improved Search will be Copilot Plus PC-only features initially.

Microsoft will start testing out the AI features starting in October, rolling it out to Windows Insiders on Copilot Plus PCs. It will gradually roll out to every Copilot Plus PC user sometime next month. Later on, the features will also make it to Intel and AMD-powered Windows PCs.

What do you think about Microsoft’s answer to Circle to Search? Tell us your thoughts on it in the comments down below!

Comments 0
Leave a Reply

Loading comments...