0 of 3 done
Architectures for ordered data — text, time series, audio — culminating in the transformer, the architecture behind modern LLMs. Part of the ML Engineer track.
- RNNs, LSTMs & GRUs — [Advanced] — recurrent networks that process sequences step by step, and how gating fixed their memory problem
- Transformers & Attention — [Advanced] — self-attention, multi-head attention, and why transformers replaced RNNs
- NLP & Embeddings — [Advanced] — tokenization, stemming/lemmatization, and word/sentence embeddings
Related
- Deep Learning — the fundamentals these build on
- How LLMs Work — the applied view of the transformers this section explains from the modeling side
- RAG & Embeddings — embeddings put to work in applications
Jump to a subject
Software engineering
Infrastructure & security
Computer science
Hardware & engineering