Find a concept

Search Notes and Discovery

Enter a term to search published Notes and Discovery.

    Structured learning

    Build understanding in a useful order.

    Notes turn connected AI concepts into calm, durable learning paths. Pick a topic or begin with the recommended foundation.

    Recommended first path

    Start Here

    A structured path through attention, multi-head composition, positional information, and encoder-decoder architecture.

    View the Transformers curriculum
    1. foundation

      Attention mechanism in detail

      A step-by-step account of queries, keys, values, masking, scaling, softmax, and the final weighted sum.

      3 min read
    2. intermediate

      Multi-head attention

      How parallel attention projections create complementary views and recombine them into one representation.

      3 min read

    Browse the curriculum

    Topics

    foundation

    Transformers

    A structured path through attention, multi-head composition, positional information, and encoder-decoder architecture.

    Notes
    4
    Reading time
    123 min
    foundation

    Tokenization

    From text and bytes to subword algorithms, domain tokenizer training, held-out evaluation, and model compatibility.

    Notes
    1
    Reading time
    48 min
    foundation

    Prompt Engineering

    Design, test, and improve prompts through worked examples, structured outputs, reasoning strategies, and inspectable workflows.

    Notes
    3
    Reading time
    124 min
    foundation

    Classical System Design

    Understand how networked systems communicate, scale, and stay reliable through concrete requests, worked examples, and design trade-offs.

    Notes
    1
    Reading time
    48 min
    foundation

    Fine Tuning

    Adapt pretrained Transformers to new tasks through clear terminology, worked metrics, and complete encoder and decoder training workflows.

    Notes
    1
    Reading time
    42 min