{"id":150708,"date":"2023-09-06T13:34:45","date_gmt":"2023-09-06T08:04:45","guid":{"rendered":"https:\/\/dripp.zone\/news\/?p=150708"},"modified":"2023-09-06T13:34:45","modified_gmt":"2023-09-06T08:04:45","slug":"microsoft-boosts-ai-efficiency-with-a-heavy-metal-quartet-of-compilers-crypto-news","status":"publish","type":"post","link":"https:\/\/dripp.zone\/news\/microsoft-boosts-ai-efficiency-with-a-heavy-metal-quartet-of-compilers-crypto-news\/","title":{"rendered":"Microsoft Boosts AI Efficiency With a \u2018Heavy Metal Quartet\u2019 of Compilers – Crypto News"},"content":{"rendered":"
\n

Microsoft has unveiled a suite of four new artificial intelligence compilers designed to optimize the performance of various AI models. The \u201cheavy metal quartet\u201d of cutting-edge compilation tools bear the names Rammer, Roller, Welder and Grinder.<\/p>\n

The tools were developed by Microsoft Research in collaboration with a number of academic institutions. They provide advanced solutions for compiling \u2014basically the transformation from source code (human readable) into machine code (a bunch of ones and zeroes that make a computer executable)\u2014 mainstream AI models and running them more efficiently on hardware accelerators like GPUs.<\/p>\n

In a Microsoft Research blog post<\/a> highlighting their capabilities, the company says the compilers build on Microsoft’s extensive research and development in artificial intelligence.<\/p>\n

\u201cThe AI compilers we developed have demonstrated a substantial improvement in AI compilation efficiency, thereby facilitating the training and deployment of AI models,\u201d wrote \u200b\u200bJilong Xue, Principal Researcher at MSR Asia. \u201cIn the future, these large-scale models themselves may inherently assist in achieving optimization and compilation.\u201d<\/p>\n

The four new compilers each tackle distinct challenges in optimizing AI workloads.<\/p>\n

Rammer<\/a> focuses on maximizing hardware parallelism\u2014the capacity of hardware to do different things simoultaneously. This is a key factor in performance, and Rammer minimizes runtime scheduling overhead through improved utilization of parallel resources.<\/p>\n

Roller<\/a> takes a different approach to accelerate compilation, using a fast construction algorithm to find solutions, ultimately generating optimized kernels in seconds rather than hours. In other words, Roller helps create efficient computer programs for AI faster by simplifying the design process.<\/p>\n

Welder<\/a> reduces expensive memory access traffic by connecting operators in a concentrated pipeline. It unifies memory optimizations into a single framework for greater efficiency.<\/p>\n

Finally, Grinder<\/a> enables control-flow execution on accelerators by integrating it with data flow. This allows optimization across control flow boundaries. Think of it like an expert guiding the steps of an apprentice, telling them what to do to get the job done faster.<\/p>\n

As one of the leading technology giants, Microsoft has been at the forefront of AI advancement. The company has partnered closely with AI research firm OpenAI on large language models like GPT-3.5 and GPT-4, which powers ChatGPT and Bing Chat. More recently, Microsoft partnered with Meta<\/a> to integrate LLaMA-2 in its cloud computing solution and introduced a technique called the Algorithm of Thoughts<\/a> to enhance reasoning in models like ChatGPT.<\/p>\n

Testing found the compilers significantly outperformed existing solutions on benchmarks. Rammer exceeded other compilers by up to 20x on GPUs. Roller matched or exceeded state-of-the-art performance while lowering compilation time by orders of magnitude. Welder surpassed frameworks like PyTorch by up to 21x on GPUs. Grinder accelerated models with control flow by up to 8x.<\/p>\n

The heavy metal quartet demonstrates Microsoft\u2019s continued leadership in designing breakthrough AI systems \u2014and coming up with fun names for its products. While big partnerships in the AI space like the one with OpenAI grab headlines<\/a>, the company also actively develops vital software infrastructure to empower AI behind the scenes.<\/p>\n

With sizable performance gains over existing solutions, Rammer, Roller, Welder and Grinder could provide key competitive advantages as more complex AI workloads emerge.<\/p>\n

\n
<\/p>\n

Stay on top of crypto news, get daily updates in your inbox.<\/h3>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

Microsoft has unveiled a suite of four new artificial intelligence compilers designed to optimize the performance of various AI models. The \u201cheavy metal quartet\u201d of cutting-edge compilation tools bear the names Rammer, Roller, Welder and Grinder. The tools were developed by Microsoft Research in collaboration with a number of academic institutions. They provide advanced solutions […]<\/p>\n","protected":false},"author":2,"featured_media":150709,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[230,225,221,227,226,228,229,60,223,224,222],"class_list":["post-150708","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cryptocurrency","tag-brave","tag-coinbase","tag-crypto","tag-decentralised","tag-decentralized","tag-decentralized-exchange","tag-erc-20","tag-featured","tag-meme-coin","tag-robinhood","tag-solana"],"_links":{"self":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/150708","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/comments?post=150708"}],"version-history":[{"count":2,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/150708\/revisions"}],"predecessor-version":[{"id":150711,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/posts\/150708\/revisions\/150711"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media\/150709"}],"wp:attachment":[{"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/media?parent=150708"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/categories?post=150708"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/dripp.zone\/news\/wp-json\/wp\/v2\/tags?post=150708"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}