Learn

Company Breakdowns

What technical products actually do and why the companies that make them are valuable

Knowledge Bases

In-depth, networked guides to learning specific concepts

All Technically posts on software concepts since the dawn of time

The dictionary of software terms you've always wanted

Explore knowledge bases

AI, it's not that Complicated Analyzing Software Companies Building Software Products Working with Data Teams

Loading...

Meet Technically

Technically exists to help you get better at your job by becoming more technically literate.

Solutions for Teams

Sell more software to developers by becoming technically fluent.

For Finance Professionals

Helping both buy-side and sell-side firms ask better technical questions.

General Team Inquiries

Volume discounts on Technically knowledge bases.

Loading...

← Back to Universe

Token

aiintermediate

A token is the basic unit of a Large Language Model's vocabulary. It's essentially how a model translates our language – words, characters, and punctuation – into computer language. Tokenization is the process of actually doing that conversion.

Read the full post ↗

How do Large Language Models work?

Breaking down what ChatGPT and others are doing under the hood

Read in the Knowledge Base →

Related terms

ChatGPT

Context Window

Inference

LLM

Loss Function

Machine Learning

Support

Sponsorships

Twitter

Linkedin

Privacy + ToS