Can AI Achieve True Creativity?

Exploring the parallels between human creativity and neural networks

2025   ·   4 min read   ·   ai,   neuroscience,   creativity   ·   featured-posts

PEFT Method Overview [implementing Adapters in PyTorch]

Exploration of modern parameter-efficient fine-tuning techniques with PyTorch implementations and practical insights.

2025   ·   46 min read   ·   machine-learning,   transformers,   peft,   lora,   adapters,   fine-tuning   ·   featured-posts

Physical Symbol Systems and the Language of Thought

Exploration of the physical hypothesis of symbolic systems, the language of thought hypothesis, and philosophical challenges

2025   ·   12 min read   ·   cognitive-science,   philosophy-of-mind,   symbolic-systems,   language-of-thought   ·   featured-posts

Building a Transformer (Cross-Attention and MHA Explained)

Learn and implement the most iconic architecture in modern deep learning.

2025   ·   30 min read   ·   machine-learning,   transformers,   multihead-attention,   positional-encoding,   nlp   ·   featured-posts

Understanding Byte-Pair Encoding Algorithm

Implement one of the most popular tokenization algorithms and learn how to use ready-made solutions.

2025   ·   41 min read   ·   tokenization,   bpe,   algorithms,   nlp   ·   featured-posts