technically logo

Learn

AI Reference
Your dictionary for AI terms like LLM and RLHF
Company Breakdowns
What technical products actually do and why the companies that make them are valuable
Knowledge Bases
In-depth, networked guides to learning specific concepts
Posts Archive
All Technically posts on software concepts since the dawn of time
Terms Universe
The dictionary of software terms you've always wanted

Explore knowledge bases

AI, it's not that ComplicatedAnalyzing Software CompaniesBuilding Software ProductsWorking with Data Teams
Loading...

Meet Technically

Technically exists to help you get better at your job by becoming more technically literate.

Learn more →

Solutions for Teams

For GTM Teams
Sell more software to developers by becoming technically fluent.
For Finance Professionals
Helping both buy-side and sell-side firms ask better technical questions.
General Team Inquiries
Volume discounts on Technically knowledge bases.
Loading...
Pricing
Sign In

The AI Reference

The guide to AI that you've been looking for. Click on any term for an in depth explanation and FAQ (plus diagrams).

Search icon

Concepts

Context Window

Context Window

A context window is how much data an AI model can hold in memory at once.

Token

Token

A token is the basic unit of a Large Language Model's vocabulary.

Embeddings
Coming Soon

Embeddings

Embeddings are how AI models turn words, images, or other data into mathematical coordinates that computers can actually work with.

Model Parameters
Coming Soon

Model Parameters

Parameters are the learned "knowledge" stored inside AI models - the numerical values that determine how the model responds to inputs.

Training

Fine Tuning

Fine Tuning

Fine tuning is the process of taking a pre-trained AI model and specializing it for your specific use case.

Reinforcement Learning from Human Feedback (RLHF)

Reinforcement Learning from Human Feedback (RLHF)

RLHF is the final training step that turns a knowledgeable but rambling AI into the helpful assistant you know and love.

Training Dataset

Training Dataset

Training datasets are the examples you show an AI model so it can learn to recognize patterns and make predictions.

Instructional Fine-tuning
Coming Soon

Instructional Fine-tuning

Instructional fine-tuning is how you turn a pre-trained AI model – knowledgeable, but useless – into a helpful assistant that actually answers your questions.

Inference

Hallucination

Hallucination

AI hallucination is when AI models confidently generate information that's completely made up or wrong.

Inference

Inference

Inference is a fancy term that just means using an ML model that has already been trained.

Prompt Engineering

Prompt Engineering

Prompt engineering is the art of talking to AI models in a way that gets you the results you actually want.

RAG

RAG

Retrieval Augmented Generation (RAG) is a way to make LLMs like GPT-4 more accurate and personalized to your specific data

Reasoning

Reasoning

AI reasoning is how artificial intelligence systems solve problems, think through complex situations, and draw conclusions from available information.

Model Architecture

Neural Network

Neural Network

Neural networks are the mathematical brains behind modern AI—think of them as simplified versions of how your actual brain processes information.

Transformers
Coming Soon

Transformers

Transformers are the neural network architecture that powers modern AI like ChatGPT, revolutionizing how models process language and other sequential data.

Infrastructure

GPU
Coming Soon

GPU

GPUs are specialized chips that do thousands of simple calculations simultaneously, making them perfect for AI training.

Impress your engineers

70K+ product managers, marketers, bankers, and other -ers read Technically to understand software and work better with developers.

Newsletter
Support
Sponsorships
X + Linkedin
Privacy + ToS

Written with 💔 by Justin in Brooklyn