Microsoft has launched Copilot Labs to test new AI features, including Copilot Voice and Copilot Vision, enhancing user experience while ensuring privacy.
Microsoft Unveils Experimental AI Features with Copilot Labs
New York City, New York – In a significant step towards advancing AI-driven assistant technology, Microsoft has introduced a series of updates to its generative AI tool, Copilot, including several experimental features through a newly created platform known as Copilot Labs. This announcement was made on Tuesday during the Microsoft Copilot and Windows Event held in New York City.
The new set of features revealed includes Copilot Voice, Think Deeper, and Copilot Vision. However, before these innovations are rolled out to the general public, they will be available for testing within Copilot Labs. This approach mirrors Google’s strategy with Google Labs, where experimental features are housed for user testing and feedback.
Introduction to Copilot Labs and its Initial Features
Copilot Labs aims to provide a sandbox environment where users can access and try experimental AI features that are still under development. This enables Microsoft to gather insightful feedback and refine these tools before a broader release. Initially, two primary experimental features will be hosted on the platform: Copilot Vision and Think Deeper.
Copilot Vision: Enhanced Visual and Textual Assistance
Copilot Vision is designed to work within Microsoft Edge, offering real-time, context-aware voice assistance by recognising and interpreting the on-screen content. This feature aims to combine the capabilities of Copilot Voice with visual elements, enhancing the quality and relevance of the assistance provided.
For instance, during a demonstration at the NYC event, Copilot Vision was shown aiding a user in selecting outfit inspirations from Pinterest. The feature not only suggested suitable outfits but also provided motivational support when the user expressed self-doubt.
To address privacy concerns, Microsoft has clarified that Copilot Vision is an opt-in feature. The interactions will not be stored for training purposes, and it will not operate on all websites or paywalled content. The feature is intended to read and interpret site content in real-time without processing or storing it.
Think Deeper: Detailed and Thoughtful AI Assistance
The Think Deeper feature is set to enrich Copilot’s ability to handle more complex and nuanced questions by taking additional time to formulate responses. This functionality enables step-by-step guidance for complicated queries, positioning it as a more thoughtful and detailed AI assistant.
Currently, Think Deeper is in its early development stages and is accessible exclusively through Copilot Labs. For those seeking a more advanced tool with similar capabilities, they can opt for OpenAI’s o1-model via ChatGPT, although it requires a subscription to the ChatGPT Plus service at $20 per month.
Access and Subscription Details
While these innovative features promise to significantly enhance AI-driven assistance, they are currently available only to Copilot Pro users. The Copilot Pro subscription includes access to a variety of features such as priority access to the latest AI models during peak times and Copilot integration within Microsoft Office applications like Word, Excel (in preview), PowerPoint, and Outlook. The subscription is priced at $20 per month.
For users interested in exploring experimental AI features without a subscription, Google Labs offers a comparable, cost-free platform for trying out similar innovations.
As Microsoft progresses with refining these features, Copilot Labs will be pivotal in collecting user feedback, ensuring that the tools meet user expectations and needs before their wider release.
Source: Noah Wire Services
