skip to main content
Caltech
AI Bootcamp

Transformers

February 3–7, 2025
Resnick Sustainability Center 120

Objective:

To equip participants with the tools and knowledge to understand, implement, and utilize transformer based models in their research or explore these concepts further through advanced courses or self-study.

Topics Covered:

  • Introduction to Transformers and Attention Mechanisms
  • Transformer Architectures (Encoder-Decoder, GPT)
  • Vision Transformers
  • Fine-tuning Transformers
  • Applications of Transformers

Prerequisites

  • Python Programming
  • Machine Learning Basics and experience with ML frameworks such as PyTorch or TensorFlow
  • Linear Algebra
  • Multivariable Calculus
  • Probability Theory

Registration:

Please take the pre-screening Quiz before 11:59 PM Pacific Time on Thursday Jan 30th

Registration URL: https://caltech.instructure.com/enroll/NTHPFE

Note: This bootcamp is open to Graduate Students, Post Docs, and Faculty

Contact:

Bootcamp director: Reza Sadri, [email protected]
Administrative assistant: Caroline Murphy

Deadline for Registration: January 30, 2025