technically logo

Learn

Company Breakdowns
What technical products actually do and why the companies that make them are valuable
Knowledge Bases
In-depth, networked guides to learning specific concepts
Posts Archive
All Technically posts on software concepts since the dawn of time
Terms Universe
The dictionary of software terms you've always wanted

Explore knowledge bases

AI, it's not that ComplicatedAnalyzing Software CompaniesBuilding Software ProductsWorking with Data Teams
Loading...

Meet Technically

Technically exists to help you get better at your job by becoming more technically literate.

Learn more →

Solutions for Teams

For GTM Teams
Sell more software to developers by becoming technically fluent.
For Finance Professionals
Helping both buy-side and sell-side firms ask better technical questions.
General Team Inquiries
Volume discounts on Technically knowledge bases.
Loading...
Pricing
Sign In
← Back to Universe

Loss Function

aiadvanced

When training a machine learning model, a loss function is something you design that tells the model when its answers are right and when they're wrong. There are a bunch of different types, some catered to specific ML tasks like image classification (whether a plant has a bug on it or not) or regression (predicting a stock price), or predicting the next word in a sentence for an LLM.

As a model is trained, it predicts an answer to a question. If it's right, it gets a point. If it's wrong, it loses a point. After enough of these iterations, it starts to learn how to predict the correct answer.

There are lots of different types of loss functions, but behind the scenes, they're just telling your model "good job" or "try again." This is why it's so important, when training an ML or AI model, to have nicely curated, labeled data with a clear right and wrong answer.

Read the full post ↗

How do you train an AI model?

A deep dive into how models like ChatGPT get built.

Read in the Knowledge Base →

Related terms

ChatGPT

Context Window

Inference

LLM

Machine Learning

Post-training

Support
Sponsorships
Twitter
Linkedin
Privacy + ToS