Hugging Face Datasets

huggingface.co · Datasets

Free

Hub of hundreds of thousands of datasets plus a library for loading and streaming them efficiently.

#datasets#hub#streaming#library

Visit Hugging Face Datasets ↗GitHub ↗

About the Datasets category

Open corpora and dataset tooling for pretraining and evaluation. Data quality and documentation matter as much as model architecture.

Hugging Face Datasets is one of 5 datasets tools indexed on Axiomi. Facts on this page come from the tool's official site and public APIs; prices and features change, so confirm details on the official website before you commit.

// related

Related tools

All Datasets →

Dolmagithub.comAI2's open pretraining corpus and toolkit used to train OLMo, with tools for curating large text datasets.DatasetsOpen source★ 1.6k

Common Crawlcommoncrawl.orgNonprofit that maintains a free, open archive of web crawl data used in most large-scale pretraining corpora.DatasetsFreeHN 2

LAIONlaion.aiNonprofit producing open multimodal datasets, models and tools for democratising machine learning research.DatasetsFreeHN 2

FineWebhuggingface.coLarge, carefully filtered and deduplicated English web dataset for LLM pretraining, documented with ablations.DatasetsOpen source

Transformershuggingface.coHugging Face's library defining thousands of model architectures, the de facto reference implementation for open models.ML FrameworksOpen source★ 167k

Hugging Face Hubhuggingface.coCentral hub for open models, datasets and demo Spaces, the GitHub of the machine learning community.Research PlatformsFreemium★ 4k