Lakshya

Networks, Automation, Connectivity & Data Centres · Chapter 11 of 18

Colocation and the data centre

What you are actually renting, what the bill is made of, and why an AI rack changed the economics of an entire industry.

7 min read1 diagramAll 18 chapters

Even in a cloud-first world, someone runs the buildings. Colocation is a large and growing industry, it is where every network's physical reality lives, and it is a subject infrastructure candidates are expected to have at least a working grasp of — particularly in India, where data localisation rules and a construction boom have made it a genuine growth sector with real hiring.

YOU DO NOT RENT SPACE. YOU RENT POWER, AND SPACE COMES WITH IT. SPACEa 42U or 47U rackor a caged suitepriced per rack or per m²POWERcommitted kW per rackA+B feeds, metered or flatthe real cost driverCOOLINGCRAC / in-row / rear doorhot and cold aislesdirect-to-chip above ~30kWCONNECTIVITYcross-connectscarrier + cloud on-rampspriced per port per month UPTIME INSTITUTE TIERS — WHAT EACH ACTUALLY PROMISES TIER I — basicsingle path, no redundancyfull shutdown for any workTIER II — redundant partsN+1 components, single pathstill shuts down for path workTIER III — concurrentlyN+1 and dual pathsmaintainable any componentTIER IV — fault tolerant2N, compartmentalisedsurvives an unplanned failure The distinction nobody checks: Tier Certified Design Documents means a drawing passed review. Tier Certified Constructed Facilitymeans the building was tested. Marketing usually says “Tier III” and means the first. WHAT THE MONTHLY BILL IS MADE OF rack rental + committed kW + metered overage + cross-connects × n + IP transit (per Mbps 95th percentile) + remote hands (per hour) +one-off NRC at install
The four things you rent, the four tiers, and the components of the monthly bill. The distinction at the bottom of the tier block — certified design versus certified constructed facility — is the one that separates a marketing claim from a tested building.

You are buying power, and space comes with it

The single most useful reframe: colocation is priced on power, not floor area. A rack is a 42U or 47U cabinet, but what determines its price is the kilowatts committed to it. A 2 kW rack and a 15 kW rack occupy the same tiles and cost very different amounts, because the constraint in a data hall is the electrical and cooling capacity, not the floor.

  • Committed vs metered power. You commit to a kW figure and pay for it whether you draw it or not; overage above the commit is billed separately and expensively. Under-committing is a false economy and over-committing is dead money, so the sizing conversation is real work.
  • A and B feeds. Two independent power paths to the rack, from separate UPS systems. Your equipment must have dual power supplies to use them — single-PSU kit in a dual-fed rack still dies when one path is maintained.
  • Cross-connects. A physical cable from your rack to another tenant, a carrier, or a cloud on-ramp, billed per month per connection. At a dense exchange facility these accumulate quickly and are a meaningful part of the bill.
  • Remote hands. Someone in the building who will reseat a drive or read a console at 3 a.m., billed hourly with a minimum. Worth budgeting rather than discovering.
  • NRC. Non-recurring charges at install — racking, cabling, power commissioning. Always negotiated, frequently waived on a longer term.

Tiers, PUE, and the numbers that are actually meaningful

The Uptime Institute tier system is the industry's shared vocabulary, and the important thing to know is what each tier promises rather than the availability percentage that gets quoted alongside it.

  • Tier III is ‘concurrently maintainable’ — any single component or distribution path can be taken out for maintenance without shutting the load down. This is the commercial sweet spot and what most enterprise colocation is.
  • Tier IV is ‘fault tolerant’ — it survives an unplanned failure of any single component, with physically separated systems. Substantially more expensive, and genuinely necessary far less often than it is specified.
  • The certification distinction. ‘Tier III Certified Design Documents’ means drawings passed review. ‘Tier III Certified Constructed Facility’ means the building was physically tested. Marketing material routinely says ‘Tier III’ and means the first. Asking which is a very good question in a vendor conversation and an even better one in an interview.

PUE — power usage effectiveness — is total facility power divided by IT power. A PUE of 2.0 means you burn a watt of overhead for every watt of compute. Modern purpose-built facilities operate in the 1.2–1.5 range; hyperscalers report figures closer to 1.1. In India, ambient temperature and humidity make good PUE harder to achieve than in northern Europe, which is a genuine engineering constraint and one reason cooling innovation gets attention there.

Treat published PUE numbers with the same scepticism you would apply to any self-reported metric: it varies by season, by load factor, and by what the operator chooses to include in the boundary. A half-empty hall always reports a bad PUE because the fixed overhead is spread over less IT load, which is a measurement artefact and not an efficiency problem.

The AI rack, and why it broke the model

For twenty years an average enterprise rack drew 3–6 kW and data halls were designed around that. A rack of modern AI accelerators can draw 40–130 kW — an order of magnitude more in the same footprint. This is the single biggest structural change in the industry in a decade and it has consequences worth being able to name:

  • Air cooling stops working somewhere around 30–40 kW per rack. Above that you need direct-to-chip liquid cooling or immersion, which means plumbing in a building designed for airflow — a retrofit most existing halls cannot take.
  • The constraint moved to the grid. Data centre siting is now decided by where you can get tens or hundreds of megawatts connected, and grid connection queues in several markets run to years. This is why announcements are increasingly about power agreements rather than buildings.
  • Vacancy collapsed and pricing rose in the major markets through the mid-2020s, reversing a long period of falling prices. Northern Virginia is the extreme case.
  • India benefits structurally — data localisation requirements under the DPDP Act and RBI's payment-data rules mean certain workloads must be hosted domestically, which underwrites demand independently of the AI cycle.

The build-versus-cloud arithmetic, done honestly

A question you may well be asked: when does owning hardware in colocation beat renting from a cloud? The method matters more than the answer.

Cost elementColocationCloud
HardwareCapital, depreciated over 3–5 yearsIncluded in the hourly rate
Space and powerMonthly per rack per kWIncluded
BandwidthTransit per Mbps, 95th percentile — cheapEgress per GB — expensive
PeopleYou need hands, a network engineer and a hardware refresh planLargely absorbed
ElasticityNone. You bought the peakExcellent, and this is the real product
Time to first serverWeeks to monthsMinutes

The honest shape: cloud wins decisively on elasticity, on time-to-start, and on anything with a spiky or unknown load. Colocation wins on steady, predictable, high-volume workloads — and the two places it wins most dramatically are bulk egress, where the pricing gap is enormous, and sustained GPU capacity, where cloud rental over three years can exceed the purchase price of the hardware several times over. Which is precisely why a number of large AI companies have moved to owning.

The mature answer to “cloud or colo?” is therefore not a side, it is a method: “Split the workload. Elastic, unpredictable and new things belong in cloud; large steady-state things with predictable load and heavy egress belong where you can buy them outright. Then compute the three-year total for each, including the people, and be honest about the elasticity you are giving up.”

Check yourself

What does Tier III actually guarantee?Concurrent maintainability — any single component or path can be taken down for planned work without dropping the load. It does not guarantee survival of an unplanned failure; that is Tier IV.
Why did rack power density become the industry's main constraint?AI accelerators. A rack went from 3–6 kW to 40–130 kW, which exceeds what air cooling can remove and what most existing halls were built to supply.
What is PUE and what makes a reported figure unreliable?Total facility power over IT power. It varies with season, load factor and where the operator draws the measurement boundary — and a lightly loaded hall always looks bad.
Two circuits, two carriers, still a total outage. What did you fail to ask?For the physical route. Diverse invoices are not diverse fibre.
← Connectivity: transit, peering, exchanges and the commercial internetDiagnosing a network problem, with four worked scenarios →