Amelia's Weekly Fish Fry

Artificial intelligence is moving faster than ever, but as AI models continue to grow in size and complexity, the challenges surrounding inference performance are becoming impossible to ignore. In this week's podcast, ElastixAI CEO Dr. Mohammad Rastegari and I chat about how we can overcome those challenges and why a different approach to AI infrastructure is necessary for the next generation of AI innovation. We also explore the key bottlenecks limiting inference performance, how ElastixAI is tackling these issues, and why FPGAs are emerging as a compelling platform for accelerating large language model inference.

Let’s go to space!!!! This week, we're diving into the cutting edge of AI in space with Pratish Shah of Aitech. Pratish and I discuss Aitech's IQSat -  the world's first AI-enabled picosatellite constellation platform, and how the shift to AI in space computing is changing the economics and timeline for collecting and analyzing data beyond Earth. We'll also cover the immense challenges of integrating high-performance AI into a harsh environment, the emerging capabilities from constellations like IQSat, and Aitech’s essential role in NASA’s Artemis II mission.

My podcast guest this week is Andy Hock, Chief Strategy Officer at Cerebras.  Andy and I are discuss the the revolutionary details of the Cerebras Wafer-Scale Engine (WSE). We also explore where the next major competitive frontier lies for AI hardware, how the latest WSE addresses the critical latency and energy efficiency challenges of deploying massive AI models for inference and Cerebras' role in democratizing access to large-scale AI research and deployment.

In this week’s podcast, we’re diving deep into the technology that is driving the next wave of enterprise digital transformation: Private 5G. My guest is Parm Sandhu, Group Vice President of Enterprise 5G Products and Services at NTT DATA, Inc. Parm and I chat about how NTT is tackling the biggest misconceptions businesses have about Private 5G today and what key considerations you need to keep in mind for a successful deployment. We also explore the crucial role of Private 5G connectivity in laying the groundwork for 'physical AI' and the strategic partnerships that are speeding up its deployment across industries.

This week we're talking all about the future of embedded software development with TASKING Co-CEO Christoph Herzog. Christoph and I explore how Large Language Models and agentic AI are moving from novelty to necessity, directing external agents within the TASKING toolchain to automate critical verification and validation tasks. We also discuss the Model Context Protocol (MCP) and how it helps maintain adherence to strict industry standards.