Massive Multitask Language Understanding. A popular benchmark that tests AI models across 57 academic subjects, from philosophy to physics. Scores are reported as accuracy percentages. While useful for comparing models, MMLU has been criticized for some incorrect questions and overuse as a ranking metric.
A standardized test used to measure and compare AI model performance.
The process of measuring how well an AI model performs on its intended task.
An AI model that understands and generates human language.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.