The Friday Deploy
The plain English newsletter for people who run the business, not the tech stack. No jargon. Every Friday.
What “We’re Hitting Scale Limits” Actually Means
Your developer sends a message: “We’re starting to hit scale limits and we need to talk about our infrastructure.”
You read it twice. You’re not sure if this is urgent, expensive, or both. You write back “okay, let’s chat” and spend the next three days quietly worried.
Here’s what’s actually going on.
What “hitting scale limits” means in plain English
Every application, whether it’s your ecommerce store, your membership platform, or your custom web app, is running on hardware and software that was configured for a certain volume of activity. A certain number of users, a certain number of orders, a certain number of database queries per second.
Scale limits are the point where that original configuration starts to struggle under the current load.
Think of it like a car park. When you built your business, you put in 50 spaces. For a few years, that was plenty. But now you’ve grown, and on busy days there are 80 cars trying to get in. The car park isn’t broken. It just wasn’t designed for this much demand.
Your application is the same. It’s not a failure. It’s actually a sign that the business has grown.
Why your developer is telling you now
Developers don’t usually raise this until they’re seeing real signals in the system. Common triggers include:
Slower response times under load. Pages that used to load in under a second are now taking two or three seconds when traffic is high. Users might not complain directly, but your conversion rate quietly drops.
Database query times creeping up. The database is having to work harder to retrieve information because there’s simply more of it, and the queries weren’t optimised for this volume. For how to diagnose slow database queries in detail, this is usually where to start looking.
Background job queues backing up. Things like order confirmation emails, inventory updates, or report generation run in the background. When the system is under load, these queues can get backed up, which means customers experience delays they shouldn’t.
Memory or CPU spiking. Your hosting plan allocates a certain amount of processing power. When that’s consistently maxed out, the application starts to slow down or throw errors.
If your developer is raising this now, it means they’ve seen enough of these signals to know it’s going to get worse before it gets better, especially if you’re heading into a busy period.
What actually needs to happen
There are usually a few different directions to go, and your developer should be able to explain which applies to your situation.
Vertical scaling means upgrading the server your application runs on to something more powerful. More CPU, more memory. It’s the quickest fix, but there’s a ceiling. You can only upgrade hardware so far, and the costs can climb.
Horizontal scaling means running multiple copies of your application at the same time, spreading the load across them. This is more complex to set up, but it’s more robust and scales further.
Query and code optimisation means going into the application itself and making the code more efficient. Sometimes the scale problem isn’t the hardware at all. Certain parts of the code are simply working much harder than they need to. This is often the best long-term fix because it makes everything faster, not just at peak load.
Caching means storing the results of common queries so the database doesn’t have to run the same calculation over and over again. A well-implemented caching layer can dramatically reduce load on your database.
In practice, the solution is usually a combination of these. A good developer will tell you which lever to pull first based on where the bottleneck actually is.
Questions worth asking
Before you agree to anything, it’s reasonable to ask your developer the following.
Where exactly is the bottleneck? You want them to point to a specific part of the system, whether that’s the database, application server, or background jobs, rather than a vague sense that things are slow. If they can’t name it, they may not have diagnosed it properly yet.
Is this urgent or is this planning? There’s a real difference between “we need to act before the next peak” and “we’re fine now but should roadmap this for next quarter.” Push for a clear answer.
What’s the cost range and what does each option involve? Vertical scaling is usually cheaper and faster to implement. Horizontal scaling and code optimisation take more time and therefore more budget. You need numbers to make a good decision.
What happens if we do nothing? Knowing the realistic downside helps you prioritise this against everything else on your plate.
The thing worth knowing
Scale problems are solvable. They don’t mean your platform is fundamentally broken or that you need to rebuild from scratch. In most cases, a targeted piece of work, typically a few days to a few weeks depending on complexity, will get things to a point where the system can handle significantly more load.
The risk of ignoring it is real, though. Applications that are consistently running near their limits are more likely to have outages during traffic spikes, which is exactly when you can least afford them.
If your developer has flagged this, take it seriously. Ask them to be specific about where the problem is, what the options are, and what they’d recommend and why.
That’s a conversation you can have, even without a technical background.
Need help translating what your developer is telling you into a decision you can actually make? That’s what we do. Get in touch.
Read more Technical Translation
Developer Communication, Ecommerce, Infrastructure, Non-Technical Guide, Scaling, Technical Translation, Website Performance
Previous NextThe Friday Deploy
The plain English newsletter for people who run the business, not the tech stack. No jargon. Every Friday.