Training data

The training data of an LLM is the data used to learning the model parameters of the LLM. The data itself is not part of the LLM. Some data can include large bodies of text used for foundation models and other data is part of instruction tuning the model.

Last updated 25th March 2023.