Machine Studying | Accelerated Computation | Synthetic Intelligence

An evaluation of the foremost items of pc {hardware} used to run AI, together with a brand new heavy hitter.

This text discusses Groq, a brand new strategy to pc {hardware} that’s revolutionizing the best way AI is utilized to actual world issues.

Earlier than we discuss Groq, we’ll break down what AI basically is, and discover a number of the key parts of pc {hardware} used to run AI fashions. Specifically; CPUs, GPUs, and TPUs. We’ll discover these vital items of {hardware} by beginning in 1975 with the Z80 CPU, then we’ll construct up our understanding to fashionable methods by exploring a number of the vital evolutions in pc {hardware}.

Armed with an understanding of a number of the elementary ideas and tradeoffs in pc {hardware}, we’ll use that understanding to discover what Groq is, the way it’s revolutionizing the best way AI computation is completed, and why that issues.

Naturally there’s so much to cowl between early CPUs and a leading edge billion greenback AI startup. Thus, this can be a fairly lengthy article. Buckle up, it’ll be value it.

Who’s this convenient for? Anybody involved in synthetic intelligence, and the realities of what it takes to run AI fashions.

How superior is that this submit? This submit accommodates leading edge concepts from a leading edge AI startup, and explains them assuming no prior data. It’s related to readers of all ranges.

Pre-requisites: None, however there’s a curated checklist of assets on the finish of the article for associated studying.

Disclaimer 1: this text isn’t about Elon Musk’s chat mannequin “Grok”. Groq and Grok are utterly unrelated, apart from the truth that their names are primarily based on the identical ebook.

Disclaimer 2: Through the time of writing I’m not affiliated with Groq in any method. All opinions are my very own and are unsponsored. Additionally, thanks to the…