Technically
AI Reference
Your dictionary for AI terms like LLM and RLHF
Company Breakdowns
What technical products actually do and why the companies that make them are valuable
Learning Tracks
In-depth, networked guides to learning specific concepts
Posts Archive
All Technically posts on software concepts since the dawn of time
Terms Universe
The dictionary of software terms you've always wanted

Explore learning tracks

AI, it's not that ComplicatedAnalyzing Software CompaniesBuilding Software ProductsWorking with Data Teams
Loading...
I'm feeling luckyPricing
Log In

For AI at work, start with something small

How to make sure your next big AI push doesn't flop.

Last updated Mar 23, 2026ai
Justin Gage
Justin Gage
Read within learning track:AI, it's not that complicated

If you’re looking to get the most out of AI tools as they exist today, your best bet is to start small: pick a recurring, manual process to automate instead of trying to tackle an entire function or workflow.

  • AI is not going to do your entire job for you, at least not yet. Think of it as a tool to do the annoying, repetitive parts of your job.
  • The best place to apply AI right now is in the "messy middle" – tasks that are time consuming and manual, but not super business critical per se.
  • There is technical reasoning here too: AI models work better when you give them a narrow scope, clear context, and a tight feedback loop.
  • Find one specific, annoying thing you do every week, like summarizing meeting notes or categorizing customer feedback, and try to automate that.

Terms Mentioned

Reasoning

Metric

Context Window

The "messy middle" is AI's sweet spot + my writing story

There are essentially unprecedented budgets and hype around AI right now, and naturally leaders are getting extremely ambitious about what AI can do for their organizations: replace entire jobs, intelligent assistants, augmenting intelligence, phrases like that. This might happen eventually? But right now it’s just biting off way more than the actual AI models we have today can chew.

IMO the best use for AI models today is to automate repeatable, manual tasks that you do in your day to day and don’t require external cooperation.

Personally, (as a writer) I was extremely skeptical of GenAI models when they first came out, and resisted using them for years, really until the beginning of 2025. Everyone was prompting models to generate entire posts, which felt very wrong to me both practically (these posts sucked) and spiritually (they sucked out your soul).

But earlier this year I started to try them for one small specific thing, which was putting together scaffolding for a post before I wrote it, essentially eliminating the “blank page” problem (and writers reading this will understand). With a combination of a detailed style guide and good prompting – and then really getting in and writing – I’m able to get what’s in my brain onto paper faster, while still giving people personal, authentic writing that is actually from me.

The point is, I didn’t try to automate all writing for Technically (yikes), or create some new interface where you just talked to a Technically model. I took one specific thing that was tedious and fairly automatable, spent a few weeks/months tinkering with it, and got it to a tractable, good spot.

The same is true in finance. I spoke to CJ Gustafson who runs the excellent Mostly Metrics newsletter. When it comes to AI for finance teams and CFOs, he thinks there’s this "messy middle" where AI is perfect. To understand the middle, you have to understand the extremes where AI is a terrible fit:

  1. High risk, low volume tasks: Think about transferring a large sum of money. This happens infrequently, but the consequences of getting it wrong are catastrophic. Letting an AI handle this is dumb.
  2. Low risk, low effort tasks: On the other end, if a task takes you five minutes, you probably don't need to spend an hour setting up an AI automation for it. Software engineers fall for this all the time…

The messy middle is everything between those two poles. It’s the work that takes up 30-90 minutes of your day, happens regularly, and is mind-numbingly manual. Think: creating the first draft of a weekly report, summarizing a long meeting transcript, or categorizing a hundred pieces of user feedback. This is exactly what I use AI for today.

Loading image...

A technical perspective: why starting small is a better fit for today’s models

Beyond the organizational / sociological reasons to start small, today’s models are actually built for handling these kinds of smaller tasks instead of the larger less tractable ones that CIOs are talking about during fireside chats at conferences.

Continue reading with an all-access subscription

Continue reading with all-access

In this post

  • A technical perspective: why starting small is a better fit for today’s models
  • 1. Context is everything
  • 2. Tighter feedback loops

More in this track

How do Large Language Models work?

Breaking down what ChatGPT and others are doing under the hood

What's GPT-3?

GPT-3 is a Machine Learning model that generates text.

$15/month

30-day money-back guarantee

Or use
Up Next
How are companies using AI?

Enough surveys and corporate hand-waving. Let's answer the question by looking at usage data from an AI compute provider.

What's a datacenter?

What actually goes on inside the buildings propping up the US economy.

It was never about LLM performance

Beware the benchmark.

Content
  • All Posts
  • Learning Tracks
  • AI Reference
  • Companies
  • Terms Universe
Company
  • Pricing
  • Sponsorships
  • Contribute
  • Contact
Connect
SubscribeSubstackYouTubeXLinkedIn
Legal
  • Privacy Policy
  • Terms of Service

© 2026 Technically.