Microsoft is updating several new artificial intelligence (AI) features on Windows 11 and Copilot+ PCs. We start with Copilot Vision, which allows Copilot to help users complete several tasks displayed on the screen. It will look at the screen and provide suggestions based on the questions given by the user. Copilot Vision is currently only available to Windows 11 computer owners in the United States.
Next, Click to Do understands the context of what is displayed on the screen before providing relevant suggestions. For example, if it recognizes a certain email, it can send it directly to Teams. If a book is being read, it can listen to the user's reading before providing suggestions for fluency and correct pronunciation. It can also perform long text summaries. The Click to Do feature is only available on Copilot+ PCs.
In Photos, the Relight feature can be used to automatically edit photos. New light sources can be added and 2D photos are transformed with the AI Relight lighting system. This feature is only available for Copilot+ PCs with Snapdragon X series chips and will be available for Copilot+ PCs with AMD chips in the near future.
In Paint, there is a feature to automatically generate stickers. Users can select the object they want to use as a sticker or use artificial intelligence to select it for them. The Snipping Tool screenshot feature is also powered by AI through the Perfect Screenshot and Color Picker features. Perfect Screenshot will process the screenshot and cut out the unnecessary parts. Color Picker also allows you to quickly select colors in HEX, RGB or HSL format.
Finally, a help agent in Settings is also provided. Users can search in Settings using normal language. For example, “how to change screen resolution to 4K” and it will immediately provide the relevant menu in Settings. All of the above features were previously announced and were previously only available to Windows Insider users. Microsoft said that these feature updates will begin to be received by Windows 11 and Copilot+ PCs in stages.