Building With AI

Harnessing data to create intelligent machines | Naveen Rao (VP of GenAI, Databricks)

Episode Notes

In this episode of Building With AI, host Haroon Choudery is joined by Naveen Rao, VP of GenAI at Databricks. Naveen is a serial entrepreneur who established the first AI chip company, which he sold to Intel in 2016. He then founded MosaicML in 2020, which was acquired by Databricks for $1.3 billion last year.

 

During the episode, he shares:

[00:00] Up next: 

[00:51] Episode introduction 

[01:40] Autoblocks: AI Optimization Platform 

[02:06] Naveen's Introduction 

[05:17] Naveen's experience scaling AI products 

[06:52] Why we need to scale AI 

[11:40] MosaicML's jobs to be done 

[14:09] Why did MosaicML team up with Databricks? 

[18:24] LLMs 101 

[24:47] The economics of training AI models 

[28:11] Training a new model vs. adapting a general model 

[30:51] The shelf life of AI models 

[34:33] A look into DSPy 

[41:11] The challenges of DSPy 

[43:59] Techniques and architectures that excite Naveen 

[47:58] Advice for teams building with AI

Brought to you by Autoblocks (https://www.autoblocks.ai/) — how product teams deliver better AI experiences.

Building with AI is a weekly podcast featuring conversations with top AI product builders and leaders. Through thoughtful dialogue, host Hamza Choudery Choudery (Co-founder of Autoblocks) uncovers tactical insights that help listeners build & scale world-class AI products.

Subscribe to Building With AI:

Where to find Naveen Rao:

Learn more about Databricks:

Where to find Hamza Choudery:

Learn more about Autoblocks: