S3 E18 John Schulman (co-founder OpenAI) on ChatGPT: invention, capabilities and limitations

What's in this episode:
00:00:00 John Schulman
00:01:14 sponsors: Index Ventures and Weights and Biases
00:02:17 what is ChatGPT
00:03:17 how is ChatGPT built
00:05:29 generating text better than any human
00:06:42 tasks which bots don't perform well
00:07:29 maybe this is just a beginning
00:08:36 bringing in Reinforcement Learning (RL)
00:10:48 uses of ChatGPT that are surprising
00:12:32 ChatGPT is good at programming
00:13:30 why hallucinations happen and how to avoid them
00:16:06 training ChatGPT to be aware of hallucinations
00:18:42 retrieval vs. training
00:21:34 single pass training
00:22:50 future in scaling up
00:23:49 closed vs open source
00:27:03 need for another approach to push the development in future
00:30:06 does fine-tuning decrease generalization ability
00:32:42 LLM domination and maybe something more on the horizon
00:37:01 John's curious career path
00:40:47 transition from imitation learning
00:43:10 potential in Academia with a limited budget
00:45:40 interesting problems for Ph.D. students
00:47:54 is there any future in tiny data sets
00:50:24 academia or industry as a Ph.D. student today
00:51:57 being John Schulman
00:55:49 things to do to relax

Links:
ChatGPT: https://chat.openai.com
John Schulman: http://joschu.net/

Sponsor Links:
https://www.indexventures.com/
https://wandb.com

This episode on other platforms:
Apple: https://bit.ly/3YhMvP5
Spotify: https://bit.ly/3Ks0bBn
Amazon: https://bit.ly/3OkR4Dx
Google: https://bit.ly/3q7igOg
Acast: https://bit.ly/3Qox9pO

Host: Pieter Abbeel
Production: Bo Obradovic