Microsoft Copilot Vision AI Now Free for All Edge Users in the U.S.

Microsoft's Copilot Vision AI Now Free for All Edge Users in the U.S.

Microsoft has officially rolled out its Copilot Vision AI to all users in the United States via the Edge browser. This advanced AI tool is designed to enhance the browsing experience by allowing users to interact with AI based on the content displayed on their screen.

How Copilot Vision Works

Copilot Vision acts as an AI assistant that can "see" what you're doing on your screen, provided you opt-in. This enables users to ask context-specific questions without needing to manually describe or copy-paste information. The AI can then provide relevant answers and assistance based on the visual context.

Supported Websites and Use Cases

While Microsoft states the feature works for "most" websites, it offers a list of recommended starter sites. These include:

Wikipedia
Tripadvisor
Williams Sonoma
Amazon
Target
Wayfair
Food & Wine
OpenTable
Geoguessr

Example Use Cases:

E-commerce: When shopping on Amazon, users can ask Copilot to identify products made from specific materials (e.g., "breathable sheets") and the AI can highlight suitable options or suggest search terms.
Cooking: On recipe sites like Food & Wine, Copilot Vision can assist cooks by answering questions hands-free or reading out recipe steps, facilitating a more interactive cooking experience.

Release and User Feedback

Mustafa Suleyman, CEO of Microsoft AI, announced the release on Bluesky, highlighting its ability to "think out loud" with users and eliminate the need for extensive manual input. He emphasized the convenience of not having to "over-explain, copy-paste, or struggle to put something into words."

Privacy and Data Handling

Microsoft is proceeding cautiously with Copilot Vision, likely to avoid the controversies surrounding its Recall feature. The company assures users that the feature is strictly opt-in, does not record the screen, is only active when enabled by the user, and deletes data at the end of each session. This approach aims to build user trust and ensure data privacy.

Accessing Copilot Vision

Interested users can find setup instructions and a tutorial on the Microsoft website.

Other Computing News:

Apple Loses AI Whiz to Meta: A key AI expert has moved from Apple to Meta, reportedly with a highly attractive offer.
NASA's VR Training: NASA is utilizing virtual reality to prepare astronauts for upcoming moon missions.
Dyson's Growing System: Dyson has developed a new system for vertical farming.
Wimbledon's Robot Judges: Robot line judges at Wimbledon were reportedly found napping during matches.
Spotify Band on AI: The band The Velvet Sundown discusses their use of AI.