powstik
Prove
Growth Paths / AI Engineering 7: Transformers Deep Dive
AdvancedSkills

AI Engineering 7: Transformers Deep Dive

16 free lessons, then a project of your own.

16 free lessons, then a project of your own. Free lessons, a free self-check, and real work confirmed by 3 people. Part of the Varsity Curriculum: AI Engineering, adapted from AI Engineering from Scratch (MIT License).

1 required outcomes1 weeksCredential on completion

Path outcomes

SkillsOptional

Implement a Transformer Component From a Published Paper Specification

Prerequisite (optional here): Implementing one transformer component from a paper; this phase builds the whole transformer.

Take this Challenge →

3 milestones

  1. 1Understand Transformer Architecture Through Implementation
  2. 2Study Pretraining, Fine-Tuning, and RLHF at Technical Depth
  3. 3Analyse Limitations and Present to an Expert Reviewer
Skills

Learn Transformers Deep Dive (AI Engineering Phase 7)

Phase 7: 16 lessons.

Take this Challenge →

2 milestones

  1. 1Do the phase's lessons in public
  2. 2Train a small transformer you wrote

Resources for this path

No affiliate links. No sponsored placements.

The course map this path is adapted from (MIT License).

Every lesson and its code, free.