A decoding strategy that keeps track of multiple candidate sequences at each step instead of just picking the single best option.
A decoding strategy that keeps track of multiple candidate sequences at each step instead of just picking the single best option. The 'beam width' controls how many candidates to track. Produces more coherent output than greedy decoding but is slower and can be less creative.
A parameter that controls the randomness of a language model's output.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
The research field focused on making sure AI systems do what humans actually want them to do.
The broad field studying how to build AI systems that are safe, reliable, and beneficial.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.