---

Week 12: Reading Questions

1. Describe what a word embedding is and how it is used in LLMs.
2. Describe the term self-attention and why it is essential to how LLMs understand language.
3. What causes LLMs to halluciate?