Share this article

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low

Copilot in Outlook will generate personalized themes for you to customize the app

Microsoft will raise the price of its 365 Suite to include AI capabilities

Death Stranding Director’s Cut is now Xbox X|S at a huge discount

Outlook will let users create custom account icons so they can tell their accounts apart easier

Snowflake Arctic, an open-source, efficient, and cost-effective LLM, is set to take on Llama and Mixtral

It’s delivering better performance than most available LLMs

2 min. read

Published onApril 26, 2024

published onApril 26, 2024

Share this article

Read our disclosure page to find out how can you help Windows Report sustain the editorial teamRead more

When it comes to open-source LLMs(Large Language Models), the options are rather limited. But withSnowflakeunveilingArctic, things are about to get exciting!

Branded as theBest LLM for Enterprise AI,Arctichits the bull’s eye in two aspects: low training cost and high training efficiency.

Arctic’sannouncement blogreads,

As per the data shared bySnowflake,Arcticdelivers better performance at a lower computing power and cost thanLLAMA 3andMixtral 8x7B.

To achieve relatively high training efficiency,Arcticuses theDense-MoE Hybridtransformer architecture, which provides 480BMoE Parametersand 17BActive Parameters.

Coming to the equally criticalInference Efficiencyin theArcticLLM,Snowflakepartnered with NVIDIA to achieve a throughput of70+tokens per second with a batch size of1. This finds several mentions in the blog.

You can currently accessSnowflake’s ArcticLLM onHugging Faceor theGitHub repository. In the coming days, it will be available onAmazon Web Serice (AWS),Lamini,Microsoft Azure,NVIDIA APICatalog,Perplexity,Replicate, andTogether AI.

There have been significant improvements in the LLM landscape over the last few years,Arcticbeing a prime example of how much we have accomplished. And withcorporations investing heavily in AI, the future looks promising!

What’s your first thought aboutSnowflake’s ArcticLLM? Share with our readers in the comments section.

More about the topics:artificial intelligence,open source

Kazim Ali Alvi

Windows Hardware Expert

Kazim has always been fond of technology, be it scrolling through the settings on his iPhone, Android device, or Windows PC. He’s specialized in hardware devices, always ready to remove a screw or two to find out the real cause of a problem.

Long-time Windows user, Kazim is ready to provide a solution for your every software & hardware error on Windows 11, Windows 10 and any previous iteration. He’s also one of our experts in Networking & Security.

User forum

0 messages

Sort by:LatestOldestMost Votes

Comment*

Name*

Email*

Commenting as.Not you?

Save information for future comments

Comment

Kazim Ali Alvi

Windows Hardware Expert

Kazim is specialized in hardware devices, always ready to remove a screw or two to find out the real cause of a problem.

With KB5043178 to Release Preview Channel, Microsoft advises Windows 11 users to plug in when the battery is low#

Copilot in Outlook will generate personalized themes for you to customize the app#

Microsoft will raise the price of its 365 Suite to include AI capabilities#

Death Stranding Director’s Cut is now Xbox X|S at a huge discount#

Outlook will let users create custom account icons so they can tell their accounts apart easier#

Snowflake Arctic, an open-source, efficient, and cost-effective LLM, is set to take on Llama and Mixtral#