Skills · davila7

model-architecture-nanogpt: educational GPT implementation skill

A skill with a compact educational GPT implementation of about 300 lines that reproduces GPT-2 (124M) on OpenWebText.

This text was machine-translated from the publisher's own information and has not been checked by a human editor. The publisher's original text is the reference.

This resource was imported automatically from the sources listed below and has not been reviewed by the AI Gate team yet. The description is the publisher's own, as published. Check the repository before installing.

What it does

The skill provides an educational GPT implementation of about 300 lines of code, which the publisher describes as readable and easy to modify. It reproduces GPT-2 (124M) trained on OpenWebText. The implementation is attributed to Andrej Karpathy.

It suits anyone who wants to learn the GPT architecture from scratch, working through a transformer model in a short codebase that can be read and changed.

Training runs in one of two setups: on Shakespeare text using a CPU, or on OpenWebText using multiple GPUs.

Limitations and requirements

Training on OpenWebText is described as requiring multiple GPUs. The Shakespeare option is described as running on a CPU.

Safety

Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.

  • Runs code or changes an assistant's behaviour

Sources

  • AI Templates (aitmpl) first seen 13 Nov 2026 · last seen 19 Nov 2026 · its page on the source · figures reported by the source: aitmpl downloads 38
    model-architecture-nanogpt

    Educational GPT implementation in ~300 lines. Reproduces GPT-2 (124M) on OpenWebText. Clean, hackable code for learning transformers. By Andrej Karpathy. Perfect for understanding GPT architecture from scratch. Train on Shakespeare (CPU) or OpenWebText (multi-GPU).

    v1.0.0
    As shown on www.aitmpl.com when we last read it
Not reviewedSkills
alirezarezvani

claude-skills (330+ skills) by alirezarezvani

A skill collection by alirezarezvani with more than 330 skills covering engineering, marketing, compliance and C-level advisory.

Writing & contentSecurity
Updated 14 Nov 2026
Not reviewedSkills
anthropics

Tres tx story

Tres tx story is a skill published by anthropics, located within the tres-finance-plugin in a GitHub plugins repository.

Business & finance
Updated 14 Nov 2026
Not reviewedSkills
github

Desk journal

Desk journal is a skill published by GitHub, listed in its awesome-copilot repository.

Software development
Updated 19 Nov 2026
Not reviewedSkills
wshobson

Saga orchestration (wshobson)

A saga orchestration skill published by wshobson, listed under the backend-development plugin in the agents repository.

Software development
Updated 19 Nov 2026
model-architecture-nanogpt: educational GPT implementation skill | AI Gate Discover