Skills · davila7

data-processing-nemo-curator: GPU-accelerated data curation for LLM training

A skill by davila7 for GPU-accelerated curation of text, image, video and audio data for LLM training.

This text was machine-translated from the publisher's own information and has not been checked by a human editor. The publisher's original text is the reference.

This resource was imported automatically from the sources listed below and has not been reviewed by the AI Gate team yet. The description is the publisher's own, as published. Check the repository before installing.

What it does

The skill covers data curation for LLM training across text, image, video and audio. Its listed features are fuzzy deduplication, which the publisher describes as 16× faster, quality filtering with 30+ heuristics, semantic deduplication, PII redaction and NSFW detection. Processing scales across GPUs using RAPIDS.

It is intended for preparing high-quality training datasets, cleaning web data and deduplicating large corpora. Someone assembling a training set from raw web or multimedia sources would reach for it to filter, deduplicate and redact data before training.

Running it involves GPU hardware and the RAPIDS stack. The resource is released under the MIT license.

Limitations and requirements

Requires GPUs and RAPIDS, as stated in the publisher's description.

Safety

Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.

  • Runs code or changes an assistant's behaviour

Sources

  • AI Templates (aitmpl) first seen 13 Nov 2026 · last seen 18 Nov 2026 · its page on the source · figures reported by the source: aitmpl downloads 133
    data-processing-nemo-curator

    GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

    v1.0.0
    As shown on www.aitmpl.com when we last read it
Not reviewedSkills
wshobson

Connectivity triage

A skill published by wshobson for connectivity triage, with no further documentation available in its source.

AI agents & models
Updated 14 Nov 2026
Not reviewedSkills
wshobson

Saga orchestration (wshobson)

A saga orchestration skill published by wshobson, listed under the backend-development plugin in the agents repository.

Software development
Updated 14 Nov 2026
Not reviewedSkills
github

Flowstudio Power Automate Debug

A GitHub-published skill, named for debugging Power Automate flows, listed under development and productivity.

Software developmentProductivity & automation
Updated 18 Nov 2026
Not reviewedSkills
davila7

flowio: FCS file parser for flow cytometry data

A skill for parsing Flow Cytometry Standard (FCS) files, versions 2.0 to 3.1, as part of flow cytometry data preprocessing.

Software developmentData & databases
Updated 18 Nov 2026
data-processing-nemo-curator: GPU-accelerated data curation for LLM training | AI Gate Discover