Podcast

Conversations on applied AI .

Long-form conversations with operators, researchers, and founders shipping AI in the real world. Watch the episodes below, or subscribe on YouTube.

EP 03

Rahul Parundekar on production RAG

With Rahul Parundekar, Founder, AI Hero (ex-LlamaIndex, Toyota)

Sep 18, 2024 59 min

Production RAG end to end — when to fine-tune vs. augment, tricks to squeeze accuracy out of retrieval, multimodal RAG, on-device LLMs, and why the open-source wave is reshaping the infrastructure conversation.

Show notes
EP 02

Dhruv Singh on LLM evaluation at scale

With Dhruv Singh, Founder, Honeyhive.ai

Jul 30, 2024 1h 23m

A long conversation on LLM evaluation in production — vibe checks vs. principled metrics, Bradley-Terry scoring, chain-of-thought prompting, wrapper companies, and the uncomfortable question of P(doom).

Show notes