Share this article
Latest news
With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low
Copilot in Outlook will generate personalized themes for you to customize the app
Microsoft will raise the price of its 365 Suite to include AI capabilities
Death Stranding Director’s Cut is now Xbox X|S at a huge discount
Outlook will let users create custom account icons so they can tell their accounts apart easier
Microsoft’s Sigma is here and it helps you with tasks in real time
The system relies on HoloLens 2
2 min. read
Published onApril 30, 2024
published onApril 30, 2024
Share this article
Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more
Microsoft released the Situated Interactive Guidance Monitoring and Assistance (SIGMA), anopen-sourceresearch prototype system for real-world tasks. Also, it combines mixed reality with AI tech to assist us with daily tasks. In addition, according to Microsoft, the system will give you instructions based on your skill set and adapt to any of your mistakes. Thus, SIGMA will make us fix objects around the house, cook, and build furniture.
How can you access Micosoft’s SIGMA?
SIGMA is available onGitHub, and you can access it right away. However, you will need HoloLens 2 because the system relies on the sensing and rendering capabilities of the headset. Also, it uses large visual models like Detic and SEEM to scan your environment for useful objects. On top of that, Sigma provides answers with the help of LLMs (large language models) likeGPT-4.
Even if anyone can use SIGMA, the system is for researchers. In addition, Microsoft made it open-source to speed up the process by allowing them to avoid basic engineering. Thus, they can focus on the features instead.
Additional features for researchers
The developers of SIGMA built it on top of another open-source project known as the Platform for Situated Intelligence framework. Additionally, it provides tools for visualization, debugging, and maintenance. Also, the system has a client-server architecture.
Due to itsPSI framework, SIGMA enables fast prototyping that allows researchers to create prototypes of AI assistants. Furthermore, they can use the built-in features to replay data collected.
Because of its architecture, SIGMA bypasses device limitations by sending various data streams containing RGB (red-green-blue), depth, audio, head, hand, and gaze tracking information to a desktop server. So, a more powerful device does the processing. Thus, in the future, it might become possible to use the system on other devices as well.
Ultimately, SIGMA is one more step forward in theAI race for Microsoft. Also, this system could eventually revolutionize research and bring AI assistants closer to us. After all, who wouldn’t like an assistant capable of providing professional answers at any time? In addition, it can be a great help in finding the objects that we need.
What are your thoughts? Are you going to try SIGMA? Let us know in the comments.
More about the topics:AI,microsoft,open source
Sebastian Filipoiu
Sebastian is a content writer with a desire to learn everything new about AI and gaming. So, he spends his time writing prompts on various LLMs to understand them better. Additionally, Sebastian has experience fixing performance-related problems in video games and knows his way around Windows. Also, he is interested in anything related to quantum technology and becomes a research freak when he wants to learn more.
User forum
0 messages
Sort by:LatestOldestMost Votes
Comment*
Name*
Email*
Commenting as.Not you?
Save information for future comments
Comment
Δ
Sebastian Filipoiu
Sebastian is a content writer with a desire to learn everything new about AI and gaming.
