LLM in Practice by Accumulation Point

LLM blog posts and term-definitions: a practical collection

Back to term definitions

Inference

To use a model for inference means to use it for production (in contrast to training or learning). This is the common use of an LLM.

Last updated 5th March 2023.