MatMul Free LLMs were one of my favorite inventions last year. They achieved 10x the efficiency, very good performance, and very encouraging scaling. Let's learn how they did it. Self-attention, a common mechanism for capturing sequential dependencies in LLMs, relies on expensive matrix

When you think about it, it's wild how many processes are represented as Markovian. Some of the coolest uses of AI- Climate forecasting, simulations, games, etc. Let's understand Markovian Processes from the lens of AI for Chip Design. A Markovian Process is a type of stochastic (random