Latest News

WebGPT: Improving the factual accuracy of language models through web browsing

We’ve fine-tuned GPT-3 to more accurately answer open-ended questions using a text-based web browser.

Perceiver IO: a scalable, fully-attentional model that works on any modality

Customizing GPT-3 for your application

Fine-tune with a single command.

Training CodeParrot 🦜 from Scratch

Introducing Snowball Fight ☃️, our first ML-Agents environment

OpenAI Residency

As part of our effort to support and develop AI talent, we’re excited to announce the OpenAI Residency.

Getting Started with Hugging Face Transformers for IPUs with Optimum

Introducing the Data Measurements Tool: an Interactive Tool for Looking at Datasets

Accelerating PyTorch distributed fine-tuning with Intel technologies

OpenAI’s API now available with no waitlist

Wider availability made possible by safety progress.

Fine-Tune XLSR-Wav2Vec2 for low-resource ASR with 🤗 Transformers

Scaling up BERT-like model Inference on modern CPU - Part 2

Solving math word problems

We’ve trained a system that solves grade school math problems with nearly twice the accuracy of a fine-tuned GPT-3 model. It solves about 90% as many problems as real kids: a small sample of 9-12 year olds scored 60% on a test from our dataset, while our system scored 55% on those same problems.

Course Launch Community Event

Large Language Models: A New Moore's Law?

Train a Sentence Embedding Model with 1B Training Pairs

The Age of Machine Learning As Code Has Arrived