Course contentsShow
← Machine Learning and Deep Learning
Lesson 1209 of 3,53827. Pretrained Language Models: GPT Family and BeyondFree lesson

GPT-3.5: Bridging Base Models and Chat

The intermediate step between GPT-3 and GPT-4 that introduced code-davinci-002 and early instruction tuning.

GPT-3.5: Bridging Base Models and Chat

What you'll learn: How GPT-3.5 introduced instruction-tuning and specialized models that transformed raw GPT-3 into conversational assistants.

The Evolution Between GPT-3 and GPT-4

After GPT-3's impressive zero-shot and few-shot abilities, researchers discovered a crucial gap: while the model could predict text brilliantly, it wasn't naturally good at following instructions or holding conversations. GPT-3.5 filled this bridge.

What Made GPT-3.5 Different

The GPT-3.5 series introduced code-davinci-002, a model fine-tuned specifically on code and instruction-following datasets. Unlike pure GPT-3 models trained solely on next-token prediction, GPT-3.5 models underwent additional instruction tuning—training them to respond appropriately to explicit user commands.

Think of it like this: GPT-3 was a brilliant writer who could continue any story, but GPT-3.5 learned to be a helpful assistant who could answer questions when asked and write code when requested.

Early Instruction Tuning

Instruction tuning involved training the base GPT-3 model on datasets of instruction-response pairs:

  • "Translate this to French: Hello" → "Bonjour"
  • "Summarize this article: [text]" → [concise summary]
  • "Write a Python function that..." → [working code]

This training helped models understand the intent behind prompts rather than just continuing patterns. The code-davinci-002 variant excelled particularly at programming tasks, bridging GPT-3's language abilities with structured code generation.

From Base Model to Chat

GPT-3.5 laid the groundwork for ChatGPT by showing that instruction-tuned models could maintain context across turns and follow conversational norms—moving beyond pure autoregressive text completion to genuine dialogue.

Key Takeaway: GPT-3.5 transformed GPT-3's raw predictive power into instruction-following capability through targeted fine-tuning, introducing code-davinci-002 and establishing the foundation for chat-based AI assistants.