701: Generative A.I. without the Privacy Risks (with Prof. Raluca Ada Popa)

Dr. Raluca Ada Popa, renowned computer scientist, entrepreneur, and President of Opaque Systems, joins Jon Krohn to share her insights on securely interacting with AI APIs like OpenAI's GPT-4, the pros and cons of open vs. closed-source AI development, and the seamless operation of compute pipelines across multiple clouds. This episode is brought to you by AWS Inferentia (https://go.aws/3zWS0au) and by Modelbit (https://modelbit.com), for deploying models in seconds. Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information. In this episode you will learn: • What is a confidential computing platform? [04:31] • How to get started with confidential computing [12:10] • The challenges of confidential computing and LLMs [21:11] • How to safeguard your data while using commercial LLMs like GPT-4 [38:00] • Open-source vs closed-source [52:28] • Raluca's PreVail cybersecurity company [1:01:50] • Combining entrepreneurship and academic career [1:04:03] • DARE Program [1:10:39] Additional materials: www.superdatascience.com/701