Graphics Processing Unit. Originally designed for rendering graphics, GPUs turned out to be perfect for the parallel math operations needed to train neural networks. NVIDIA's H100 and Blackwell chips dominate the AI training market. GPU availability and cost are major bottlenecks for AI development.
The processing power needed to train and run AI models.
The dominant provider of AI hardware.
Tensor Processing Unit.
A mathematical function applied to a neuron's output that introduces non-linearity into the network.
An optimization algorithm that combines the best parts of two other methods — AdaGrad and RMSProp.
Artificial General Intelligence.
Browse our complete glossary or subscribe to our newsletter for the latest AI news and insights.