Don't miss out on our latest stories. Add PCMag as a preferred source on Google.

Microsoft is bringing semantic search to the Copilot app on Windows 11. 

With this update, Insiders will be able to search for files and images using natural language. In other words, you can just describe what you're looking for instead of remembering the exact file name or words mentioned in the file. Sharing examples, Microsoft says you can use queries like "find images of bridges at sunset on my PC," "find my CV," or "find the file with the chicken tostada recipe" to get to your desired items. 

To test the feature, Insiders need to have a Copilot+ PC and download the latest version of the Copilot app (version 1.25082.132.0 and higher) from the Microsoft Store. It currently works in English, Chinese (Simplified), French, German, Japanese, and Spanish.

(Credit: Microsoft)

Semantic search was first added to Windows Search, File Explorer, and the Settings app on Copilot+ PCs earlier this year. At the time, Microsoft said it didn't require an internet connection and relied on a small language AI model that runs locally on your device's Neural Processing Unit (NPU). It also said that none of the data gathered would be "sent to any other computer or to Microsoft." It's unclear if all of these conditions apply as the feature comes to the Copilot app as well. We've reached out to Microsoft for clarification.

Recommended by Our Editors

Google's Agentic AI Tool Gemini Spark Is Now Available. Here's How to Try It

I Used ChatGPT to Build Complex Spreadsheets Fast. Here’s How You Can, Too

GitHub Copilot Costs Skyrocket As Users Are Pushed to Per-Token Billing

However, to confirm what the Copilot app can access, retrieve, or read, you can go to Copilot Settings under Permission settings. 

The Copilot app update also adds two other features. A revamped homepage now displays your recent apps, files, and conversations. For now, it fetches PNG, JPEG, SVG, PDF, DOCX, XLSX, CSS, JSON, and TXT files from your standard Windows "Recent" folder.

(Credit: Microsoft)

It's also getting a Vision update. According to The Verge, if you pick an app from the "Get guided help" section of the homepage, a Vision session will scan everything on your screen and guide you through the basics of the app.

All of these features are packed into the latest version of the Copilot app for Copilot+ PCs, but they are "gradually rolling out, so not all Insiders will get the update right away," Microsoft adds.