How to Improve at Learning Using Neuroscience & AI

Summary

Dr. Terry Sejnowski, computational neuroscientist at the Salk Institute, explains how the brain learns through algorithms — particularly the reinforcement learning algorithm driven by dopamine — and how understanding these mechanisms can dramatically improve how we acquire and retain knowledge. The conversation covers the neuroscience of memory consolidation, the role of exercise in brain health, and practical tools including a free online course on learning how to learn.


Key Takeaways

  • All motivation is governed by a single learning rule: the brain predicts future rewards, updates based on prediction errors, and builds a “value function” — the same algorithm used by AlphaGo.
  • Both cognitive (explicit) and procedural (practice-based) learning are essential — removing practice from education is neurologically counterproductive.
  • Sleep spindles during non-REM sleep consolidate memories learned the previous day; more spindles = better long-term retention.
  • Exercise is the most powerful tool for brain and cognitive health — daily physical activity replenishes mitochondrial function and maintains cognitive vigor at any age.
  • Negative/punishment-based learning is far more powerful than reward-based learning — one very bad experience can produce permanent learning (the basis of PTSD).
  • Active, effortful learning outperforms passive intake — solving problems yourself beats being told the answer, both for humans and AI.
  • A free “Learning How to Learn” course exists (co-created with Barbara Oakley) with 4 million users across 200 countries — zero cost, no math or vocabulary prerequisites.
  • Treating AI like a human (being polite, conversational) yields better results and is less cognitively draining because it leverages existing social brain circuits.
  • Cognitive “velocity” matters — pushing slightly beyond your reflexive reading or learning pace, like interval training, improves retention and brain efficiency.

Detailed Notes

The Brain’s Core Learning Algorithm

  • The basal ganglia is responsible for learning sequences of actions to achieve goals — not just motor actions but also thinking patterns.
  • The brain uses reinforcement learning: it predicts the next reward, compares that to what actually happens, and updates synaptic plasticity accordingly.
  • This builds a value function — a lifetime accumulation of knowledge about what is good or bad for you (e.g., knowing what to order at a restaurant).
  • This same algorithm powered DeepMind’s AlphaGo, which defeated the world Go champion.
  • The prefrontal cortex governs the “no-go” side of this system — planning, impulse control, social behavior. It is the last brain region to mature in adolescence.

Two Types of Learning Systems

  • Cognitive (explicit) learning: cortical, step-by-step, conscious — like reading a textbook.
  • Procedural learning: subcortical (basal ganglia-driven), automatic, acquired through repetition — like learning a tennis serve or solving physics problems.
  • The two systems are complementary and necessary — removing procedural practice (homework, problem sets, drills) from education undermines both systems.
  • Classroom instruction alone is insufficient; active problem-solving is where real skill is built.

Punishment vs. Reward in Learning

  • Small, incremental rewards drive gradual improvement.
  • Punishment is dramatically more effective — one highly negative experience can produce permanent, one-trial learning.
  • This underlies PTSD: a single traumatic event can reorganize behavior for life.
  • Social punishment (public correction, embarrassment) is a potent learning signal.

Sleep, Memory Consolidation & Sleep Spindles

  • Sleep spindles (lasting ~1–2 seconds) travel in circular waves across the cortex during non-REM sleep.
  • The hippocampus replays daily experiences, triggering sleep spindles that “knead” new memories into existing cortical knowledge without overwriting it.
  • Research by Sara Mednick (UC Irvine): the drug zolpidem (Ambien) doubles sleep spindle frequency, and subjects who took it after learning recalled twice as much the next morning.
  • Caveat: zolpidem wipes out memory formation after the drug is taken — so it consolidates the past but impairs new encoding.
  • Exercise increases sleep spindle density, particularly REM sleep, which may support motor learning consolidation.

Exercise as the Primary Brain Health Tool

  • Dr. Sejnowski runs daily on the beach at the Salk Institute and climbs the cliff (340 ft) each day; hikes in the Alps.
  • Exercise replenishes mitochondrial function — mitochondria decline with age, reducing cellular energy (ATP) and cognitive vigor.
  • High-intensity interval training (HIIT)-style intervals (e.g., 10-second sprints) are especially effective — analogous to cognitive “intervals” during reading.
  • Exercise benefits every organ system: cardiovascular, immune, neurological.
  • Regular exercise is described as “the best and cheapest drug you can take.”

Cognitive Reserve and Alzheimer’s Prevention

  • A Chinese study found that onset of Alzheimer’s disease was earliest in those with no formal education and latest in those with the most education.
  • Hypothesis: More cognitive exercise = more neural reserve — the brain can sustain more damage before symptoms appear.
  • This mirrors the concept of mitochondrial reserves — the more you build up early, the longer you can draw on them.

Learning How to Learn — Free Course

  • Course name: Learning How to Learn
  • Created by: Dr. Terry Sejnowski and Barbara Oakley
  • Format: MOOC (Massive Open Online Course) — bite-sized ~10 minute videos, ~50–60 lessons over one month, includes quizzes, tests, and peer forums.
  • Cost: Free
  • Available on: Coursera (originally) — search “Learning How to Learn”
  • Audience: Designed for students but most popular with ages 25–35 — working adults who need to learn new skills efficiently.
  • Topics covered: How to overcome procrastination, exam anxiety, how to generalize knowledge, active vs. passive learning strategies.
  • Reach: 4 million learners across 200 countries, 98% approval rating.

AI as a Learning and Cognitive Tool

  • Large language models (LLMs) like ChatGPT and Claude are not parrots — they generalize from training data to solve new problems, similar to how the brain generalizes.
  • Key insight: Treating AI conversationally (politely, as you would a human) activates existing social brain circuits, making the interaction less cognitively draining and producing better outputs.
  • Different LLMs have different strengths — Google Gemini has improved significantly at mathematical reasoning (from ~20% to ~80% accuracy on chain-of-reasoning problems).
  • AI cannot replace procedural learning — a student who uses AI to write a song is not building the underlying neural architecture of musicianship.

Brain Connectivity and Development

  • Infant brains undergo massive synapse overproduction followed by synaptic pruning — retaining only the most energetically efficient connections.
  • As we age, the cortex thins and connectivity decreases, but early memories remain rock-solid because they were laid down during peak plasticity.
  • New optical recording techniques allow simultaneous recording from tens of thousands of neurons across dozens of areas — revealing that all brain areas interact during any complex task, not just the “relevant” one.
  • More visual cortex input comes from the motor system than from the eye itself (research by Mriganka Sur at UCLA in mice).

Mentioned Concepts