Eye On A.I.

AI is getting smarter, but now it needs better  judgment.
In this episode of the Eye on AI Podcast, we speak with Robbie Goldfarb, former Meta product leader and co-founder of Forum AI, about why treating AI as a truth engine is one of the most dangerous assumptions in modern artificial intelligence.
Robbie brings first-hand experience from Meta's trust and safety and AI teams, where he worked on misinformation, elections, youth safety, and AI governance. He explains why large language models shouldn't be treated as arbiters of truth, why subjective domains like politics, health, and mental health pose serious risks, and why more data does not solve the alignment problem.
The conversation breaks down how AI systems are evaluated today, how engagement incentives create sycophantic and biased models, and why trust is becoming the biggest barrier to real AI adoption. Robbie also shares how Forum AI is building expert-driven AI evaluation systems that scale human judgment instead of crowd labels, and why transparency about who trains AI matters more than ever.
This episode explores AI safety, AI trust, model evaluation, expert judgment, mental health risks, misinformation, and the future of responsible AI deployment.
If you are building, deploying, regulating, or relying on AI systems, this conversation will fundamentally change how you think about intelligence, truth, and responsibility.

Want to know more about Forum AI?
Website: https://www.byforum.com/
X: https://x.com/TheForumAI
LinkedIn: https://www.linkedin.com/company/byforum/
Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI

(00:00) Why Treating AI as a "Truth Engine" Is Dangerous
(02:47) What Forum AI Does and Why Expert Judgment Matters
(06:32) How Expert Thinking Is Extracted and Structured
(09:40) Bias, Training Data, and the Myth of Objectivity in AI
(14:04) Evaluating AI Through Consequences, Not Just Accuracy
(18:48) Who Decides "Ground Truth" in Subjective Domains
(24:27) How AI Models Are Actually Evaluated in Practice
(28:24) Why Quality of Experts Beats Scale in AI Evaluation
(36:33) Trust as the Biggest Bottleneck to AI Adoption
(45:01) What "Good Judgment" Means for AI Systems
(49:58) The Risks of Engagement-Driven AI Incentives
(54:51) Transparency, Accountability, and the Future of AI

In this episode of Eye on AI, Craig Smith sits down with Jarrod Johnson, Chief Customer Officer at TaskUs, to unpack how agentic AI is changing customer service from conversations to real action. 
 
They explore what agentic AI actually is, why chatbots were only the first step, and how enterprises are deploying AI systems that resolve issues, execute tasks, and work alongside human teams at scale. 
 
The conversation covers real-world use cases, the economics of AI-driven support, why many enterprise AI pilots fail, and how human roles evolve when AI takes on routine work. 
 
A grounded look at where customer experience, enterprise AI, and the future of support are heading.



Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI


 
(00:00) Jarrod Johnson and the Evolution of TaskUs
(03:58) Why AI Became Core to Customer Service
(06:07) Humans, AI, and the New Support Model
(07:16) What Agentic AI Actually Is
(11:38) TaskUs as an AI Systems Integrator
(14:59) How Agentic AI Resolves Customer Issues
(19:52) Workforce Impact and the Human Role
(23:26) Why Most Enterprise AI Pilots Fail
(30:32) Real Client Case Study: Healthcare Impact
(36:34) Why Customer Service Still Feels Broken
(38:49) The End of IVR Menus and Legacy Systems
(42:25) AI Safety, Compliance, and Governance
(49:38) Training Humans for AI and RLHF Work
(54:34) The Future of Agentic AI in Enterprise

Inference is now the biggest challenge in enterprise AI.

In this episode of Eye on AI, Craig Smith speaks with Nick Pandher, VP of Product at Cirrascale, about why AI is shifting from model training to inference at scale. As AI moves into production, enterprises are prioritizing performance, latency, reliability, and cost efficiency over raw compute.

The conversation covers the rise of inference-first infrastructure, the limits of hyperscalers, the emergence of neoclouds, and how agentic AI is driving always-on inference workloads. Nick also explains how inference-optimized hardware and serverless AI platforms are shaping the future of enterprise AI deployment.
 
If you are deploying AI in production, this episode explains why inference is the real frontier.
 

Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI



(00:00) Preview
(00:50) Introduction to Cirrascale and AI inference
(03:04) What makes Cirrascale a neocloud
(04:42) Why AI shifted from training to inference
(06:58) Private inference and enterprise security needs
(08:13) Hyperscalers vs neoclouds for AI workloads
(10:22) Performance metrics that matter in inference
(13:29) Hardware choices and inference accelerators
(20:04) Real enterprise AI use cases and automation
(23:59) Hybrid AI, regulated industries, and compliance
(26:43) Proof of value before AI pilots
(31:18) White-glove AI infrastructure vs self-serve cloud
(33:32) Qualcomm partnership and inference-first AI
(41:52) Edge-to-cloud inference and agentic workflows
(49:20) Why AI pilots fail and how enterprises succeed

In this episode of Eye on AI, we sit down with Evan Reiser, co-founder and CEO of Abnormal AI, to unpack how AI has fundamentally changed the cybersecurity landscape.
 
We explore why social engineering remains the most costly form of cybercrime, how generative AI has lowered the barrier for sophisticated attacks, and why humans have become the primary attack surface in modern security. Evan explains why traditional, signature-based defenses fall short, how behavioral AI detects threats that have never existed before, and what it means to build security systems that understand how people actually work and communicate.
 
The conversation also looks ahead at the AI arms race between attackers and defenders, the economics driving cybercrime, and what it truly means to be an AI-native company operating at scale.
 
This episode is a deep dive into the human side of AI security and why the future of cybersecurity depends less on code and more on behavior.



Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI

(00:00) Abnormal AI's origin
(02:31) Why phishing is still the biggest threat
(05:57) How attackers manipulate human trust
(10:05) The true cost of social engineering
(11:58) Vendor account compromise explained
(15:02) How AI changed cyber attacks
(16:28) Behavioral security vs traditional defenses
(19:55) Where Abnormal fits in the security stack
(22:24) Human psychology as the attack surface
(24:01) Why cyber defense is asymmetric
(28:48) Humans as the new zero-day
(31:01) Why attackers target people, not systems
(33:21) Behavioral modeling from ads to security
(36:10) Why money drives almost all attacks
(40:06) What happens after credentials are stolen
(42:18) Text scams and lateral movement
(43:55) What it means to be AI-native
(47:13) How Abnormal uses AI internally

In this episode of Eye on AI, Craig Smith speaks with Jonathan Wall, founder and CEO of Runloop AI, about why AI agents require an entirely new approach to compute infrastructure.
 
Jonathan explains why agents behave very differently from traditional servers, why giving agents their own isolated computers unlocks new capabilities, and how agent-native infrastructure is emerging as a critical layer of the AI stack. The conversation also covers scaling agents in production, building trust through benchmarking and human-in-the-loop workflows, and what agent-driven systems mean for the future of enterprise work.
 
Stay Updated:
Craig Smith on X: https://x.com/craigss
Eye on A.I. on X: https://x.com/EyeOn_AI
 
(00:00) Why AI Agents Require a New Infrastructure Paradigm
(01:38) Jonathan Wall's Journey: From Google Infrastructure to AI Agents
(04:54) Why Agents Break Traditional Cloud and Server Models
(07:36) Giving AI Agents Their Own Computers (Devboxes Explained)
(12:39) How Agent Infrastructure Fits into the AI Stack
(14:16) What It Takes to Run Thousands of AI Agents at Scale
(17:45) Solving the Trust and Accuracy Problem with Benchmarks
(22:28) Human-in-the-Loop vs Autonomous Agents in the Enterprise
(27:24) A Practical Walkthrough: How an AI Agent Runs on Runloop
(30:28) How Agents Change the Shape of Compute
(34:02) Fine-Tuning, Reinforcement Learning, and Faster Iteration
(38:08) Who This Infrastructure Is Built For: Startups to Enterprises
(41:17) AI Agents as Coworkers and the Future of Work
(46:37) The Road Ahead for Enterprise-Grade Agent Systems