# Lecture - Theories of Deep Learning MT25, XV, A few things we missed and a summary

> Source: https://ollybritton.com/notes/uni/part-c/mt25/theories-of-deep-learning/lectures/summary/ · Updated: 2025-11-18 · Tags: uni, lecture

- [Course - Theories of Deep Learning MT25](https://ollybritton.com/notes/uni/part-c/mt25/theories-of-deep-learning/)

- Dropout
- Skip connections
- Tokenisation
	- Tokens are probably different in a chat context vs a coding context
- How sparse can you make your nets before losing loads of accuracy?
- Major omissions
	- How well does depth improve generalisation error?

---
Olly Britton — https://ollybritton.com. Machine-readable index: https://ollybritton.com/llms.txt