teaching

Welcome to my teaching materials collection. These page and course are currently under development.

Transformer Architectures

GitHub Repository

End-to-end implementation of transformer architectures with production-grade practices.

Part 1: Core Implementation

Notebook English Russian
1. Understanding Tokenization: Byte-Pair Encoding Kaggle Colab Kaggle Colab
2. Implementing Transformer Architecture Kaggle Colab Kaggle Colab
3. Improving architecture with SoTA techniques Kaggle Colab Kaggle Colab
4. Evaluation Metrics (BLEU, ROUGE, METEOR, WandB) Kaggle Colab Kaggle Colab
5. Complete Transformer (End-to-End Pipeline) Kaggle Colab Kaggle Colab

Part 2: Architecture Enhancements

Notebook English Russian
1. BERT: Bidirectional Encoder Representations Kaggle Colab Kaggle Colab
2. GPT: Generative Pre-trained Transformers Kaggle Colab Kaggle Colab

Part 3: Optimization & Multimodality

Notebook English Russian
1. Vision Transformers (ViT) & Multimodal Architectures Kaggle Colab Kaggle Colab
2. Model Optimization (PEFT, LoRA, Quantization) Kaggle Colab Kaggle Colab