Skills · davila7

evaluation-lm-evaluation-harness: LLM benchmark skill

A skill for evaluating large language models across more than 60 academic benchmarks, released under the MIT license.

This text was machine-translated from the publisher's own information and has not been checked by a human editor. The publisher's original text is the reference.

This resource was imported automatically from the sources listed below and has not been reviewed by the AI Gate team yet. The description is the publisher's own, as published. Check the repository before installing.

What it does

This skill evaluates large language models on more than 60 academic benchmarks, including MMLU, HumanEval, GSM8K, TruthfulQA and HellaSwag. It supports models served through HuggingFace, vLLM and APIs.

It is suited to benchmarking model quality, comparing models, reporting academic results and tracking progress during training. The source material does not describe further setup steps.

Safety

Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.

  • Runs code or changes an assistant's behaviour

Sources

  • AI Templates (aitmpl) first seen 13 Nov 2026 · last seen 17 Nov 2026 · its page on the source · figures reported by the source: aitmpl downloads 98
    evaluation-lm-evaluation-harness

    Evaluates LLMs across 60+ academic benchmarks (MMLU, HumanEval, GSM8K, TruthfulQA, HellaSwag). Use when benchmarking model quality, comparing models, reporting academic results, or tracking training progress. Industry standard used by EleutherAI, HuggingFace, and major labs. Supports HuggingFace, vLLM, APIs.

    v1.0.0
    As shown on www.aitmpl.com when we last read it
Not reviewedSkills
github

Onboard context matic

Onboard context matic is a skill published by GitHub and hosted in its awesome-copilot repository.

Software development
Updated 17 Nov 2026
Not reviewedSkills
google

Bigquery migration validator

A skill published by Google for validating BigQuery migrations.

Data & databases
Updated 17 Nov 2026
Not reviewedSkills
github

Openapi to application code

A GitHub skill whose name points to turning OpenAPI definitions into application code; no further details are available.

Software development
Updated 17 Nov 2026
Not reviewedSkills
openai

Twilio notifications alerts advisor

A development skill from openai that offers advice on notifications and alerts using Twilio.

Software development
Updated 14 Nov 2026