Foundation models

A foundation model is a large AI model that is pre-trained on a vast quantity of data, that can be adapted to a wide range of downstream tasks. Examples of foundation models include GPT-3 and BERT.

Foundation models are a key component of the next generation of AI, and they are already being used by major players like Google and Microsoft.