How a chatbot like ChatGPT or Claude is made

Process map by Brian. 25 steps, 2 layers. Tags: ai, tech, science.

1. The AI lab: Collect text, code and images from the web and licensed sources
2. The AI lab: Clean and filter the data
3. A giant computer cluster: Pretraining: predict the next word, trillions of times
4. The AI lab: Fine-tune on examples of good answers
5. Testers and red teams: Humans rank the answers and the model learns what people prefer
6. Testers and red teams: Safety testing: try to make it do harm
7. The AI lab: Does it pass the safety and quality tests?
8. Users: Release it to users
9. Users: People use it, give thumbs up and down, and find new failures
10. The AI lab: Update and release the next version
11. The AI lab: Fix, retrain and retest

Read this process as Markdown

$Ai $Tech $Science All process maps