Atlas

AI labs

AI labsUnited States

Snorkel AI models

Snorkel AI is an American data-centric AI company, spun out of the Stanford AI Lab in 2019 and headquartered in Redwood City, California. Originally known for programmatic/weak-supervision data labeling, it now focuses on producing expert training data and evaluation datasets for frontier AI labs and is a top external contributor to Terminal-Bench, which is led by Stanford University and the Laude Institute, and released Snorkel-Mistral-PairRM-DPO, a Mistral-7B model refined via iterative DPO using PairRM response ranking.

snorkel.ai

Scored models
1
Best ranked
Snorkel-Mistral-PairRM-DPO #731 of 896
Newest
Snorkel-Mistral-PairRM-DPO Jan 19, 2024
Open weights
1 of 1

Snorkel AI models ranked by capability

Capability is Atlas's single score for each model, fitted to every sourced benchmark result (methodology). Rank is among all 896 ranked models from every lab.

ModelReleasedCapabilityRankBenchmarksWeights
Snorkel-Mistral-PairRM-DPOJan 19, 2024100.0#7319Open

All AI labsOpen-weight LLM leaderboard