← Module 07 · System ArchitectureMODULE 07 · SYSTEM ARCHITECTURE
Scaling
Scaling is changing a system’s capacity so it can handle more users, requests, data, or work while keeping an acceptable experience.
01 · What is it?
Scaling means increasing or decreasing the resources available to a system as demand changes.
Capacity can mean requests per second, concurrent users, storage, queue throughput, or the time needed to finish a job. Scaling is a product and architecture decision, not only a server-size decision.
02 · Think of it like...
Think of scaling like opening more checkout lanes or making one lane faster.
More lanes spread work across workers. A faster lane helps one worker do more. Each option changes cost, coordination, and the failure surface.
Demand→Capacity→Queue / Work→User Experience
03 · What does it do?
Absorb peaksHandle launches, campaigns, and other demand spikes.
Reduce contentionGive busy components enough CPU, memory, connections, or workers.
Control costMatch capacity to demand instead of paying for a permanent peak.
Protect reliabilityKeep latency and error rates inside agreed service targets.
04 · Where is it used?
Scale web traffic, background jobs, databases, caches, file services, message consumers, and storage capacity. The bottleneck may be a dependency rather than the component receiving the traffic.
05 · Example
During a sale, the product team expects five times the normal checkout traffic. Engineers add application instances, increase queue consumers, check database connection limits, and watch latency and error rate during the event.
More instances do not help if the database, payment provider, or file service is the limiting component.
06 · How it connects
Traffic→Load Balancer→Application Instances→Data Services
07 · Do Not Confuse
ScalingChange capacity to meet demand.
PerformanceHow efficiently and quickly a system works.
High availabilityKeep the service usable when parts fail.
OptimizationImprove resource use or behavior, which may reduce the need to scale.
08 · Topic Glossary
See the Module 07 Glossary for the shared bilingual vocabulary.
09 · What to Remember
Scaling is about capacity against demand. A PM should name the demand signal, the user-facing target, the bottleneck, and the cost or reliability guardrail.