Prove
Growth Paths / AI Research 1: Backprop from scratch
ExpertSkills

AI Research 1: Backprop from scratch

Your own autodiff, proved correct by tests, then one honest ablation.

Your own autodiff, proved correct by tests, then one honest ablation. Free resources, your code in a public repo, and real work confirmed by people. Part of the Varsity Curriculum: AI Research.

Part of: AI Research · Proves for: Engineers, PG

1 required outcomes6 weeksCredential on completion

Path outcomes

How this is verified: 4 are confirmed by people who saw the work.

SkillsOptional

Learn Deep Learning Core (AI Engineering Phase 3)

Prerequisite (optional here): the AI Engineering phase this builds on.

Take this Challenge →

2 milestones

  1. 1Do the phase's lessons in public
  2. 2Build a tiny deep learning framework
Skills

Write backpropagation from scratch, with tests

Research step 1.

Take this Challenge →

2 milestones

  1. 1Build autodiff and prove it with tests
  2. 2Run one ablation and write it up

Resources for this path

No affiliate links. No sponsored placements.

Free video course and notebooks (MIT License): backprop and language models built by hand.

Free official tutorials.