In celebration of its 50th anniversary, Microsoft has announced a major upgrade to its AI assistant, Copilot, introducing a powerful new feature called Vision. This enhancement will allow Copilot to view and interact with users’ Windows screens in real time, delivering a more intuitive and personalized experience across devices.
The Vision feature, which was previously introduced for the web version of Copilot, is now expanding to Windows and mobile platforms. With this update, users can harness the power of Copilot through the native Windows app to streamline work across applications, browser tabs, and files. By reading the screen and interacting with its contents, Copilot Vision aims to assist users with everything from file organization and settings changes to real-time collaboration on projects—without the need to constantly switch between programs.
Microsoft highlighted that the feature is designed to make task execution more efficient, whether through typing or voice commands. Users can access Copilot by pressing Alt + Space or holding it for two seconds to activate voice functionality.
While the native Copilot app is available immediately, the new Vision feature will roll out next week to members of the Windows Insider Program for initial testing. A general release date has not yet been announced.
In a live demonstration, Microsoft showcased how Copilot Vision adds a second on-screen cursor to guide users through tasks visually. For instance, in Adobe Photoshop, the assistant highlighted specific tools and provided step-by-step instructions using a combination of voice prompts and visual cues, offering a more hands-on and interactive experience.
This innovation marks a significant leap forward in AI integration with desktop environments, bringing the concept of a true digital assistant closer to reality.
Stay tuned to DC Brief for further updates on this story and other technology developments.
