A transformer architecture adapted for image processing. Instead of processing words, it divides images into patches and treats each patch like a token. Showed that the attention mechanism could match or beat CNNs at vision tasks. Now the dominant architecture for many computer vision applications.
The neural network architecture behind virtually all modern AI language models.
The field of AI focused on enabling machines to interpret and understand visual information from images and video.
Convolutional Neural Network.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.