---

Week 13: Reading Questions

1. Transformers are general purpose machines. What are some examples of the types of inputs they can operate on and outputs they can produce?
2. Transformers consist of repeated layers made up of attention blocks followed by feedforward blocks. At a high level, what are each of these blocks doing when processing textual input?
3. How is a transformer turned into a ChatBot?