Inference is a fancy term that just means using an ML model that has already been trained. In most contexts, it refers to using the model via API, although technically something like prompting an LLM is also inference.
Inference
Read the full post ↗
How do Large Language Models work?
Breaking down what ChatGPT and others are doing under the hood
Read in the Knowledge Base →