Supper Club × OpenAI, Future of programming, LLMs, and Math with Andrey Mishchenko

In this supper club episode of Syntax, Wes and Scott talk with Andrey Mishchenko about working at OpenAI, getting started in machine learning, what RLHF is, the impact of plugins on ChatGPT, and what the future holds for developers in a world with ChatGPT tools.

Show Notes

• 00:33 Welcome

• 00:59 ChatGPT introduction

• 02:17 Who is Andrey Mishchenko?

• 03:17 What is circle packing?

• 05:04 When did you start at OpenAI?

• 06:21 Levels of interaction

• 08:39 How do you train the model to understand?

• 11:13 What’s RLHF?

• 13:56 What are plugins for ChatGPT?

• 16:11 What languages are you using to code for AI?

• 19:15 Did you have any idea ChatGPT would be so popular?

• 21:13 Did your math degree help get into language modeling?

• 28:34 Do Wes or Scott worry they’re going to lose their job?

• 33:24 How has farming been shaken up by AI?

• 34:59 Do you think the pace of AI will continue?

• 35:30 Will plugins change how people use AI tools?

• 41:21 What does AI do better than anything else?

• 49:11 Supper Club questions

• 55:04 SIIIIICK ××× PIIIICKS ×××

• Andrey Mishchenko - Member of Technical Staff - OpenAI

• Bing Chat (GPT-4) in Google - Chrome Web Store

• ChatGPT plugins

• Introduction - OpenAI API

××× SIIIIICK ××× PIIIICKS ×××

Shameless Plugs

Tweet us your tasty treats

• Scott’s Instagram
• LevelUpTutorials Instagram
• Wes’ Instagram
• Wes’ Twitter
• Wes’ Facebook
• Scott’s Twitter
• Make sure to include @SyntaxFM in your tweets
• Wes Bos on Bluesky
• Scott on Bluesky
• Syntax on Bluesky