Skip to content

QCon 2012 - Cloud, So Much More Than a Tools Fest

talks 2 min read

I joined a team inside a traditional enterprise that was building a real-time TV interaction app – the kind where a million viewers vote live during a show and the host responds in real time. The internal infrastructure team said they could handle it, but the peak loads were far beyond what they had ever provisioned. So the developers did what clever developers do: they went to the cloud.

The first prototype ran on Google App Engine. PaaS was great for not worrying about servers, but we hit a wall during live shows. The auto-scaling would kick in at exactly the wrong moment, making the app temporarily unavailable during peak traffic. Real-time television and scaling hiccups do not go together. We also wanted to use different languages and storage engines for different parts of the system – Java for stream encoding, Rails for fast prototyping, Node.js for handling concurrent connections, Redis for real-time counters, and a SQL database for the reporting team’s ETL tools. PaaS did not give us that flexibility.

Moving to IaaS gave us control but brought new challenges. I had to teach a team of developers things I had learned from years of enterprise operations: split services across dedicated machines for easier debugging, use virtualization for flexibility, and stop cloning AMIs by hand. We introduced configuration management with Vagrant for local development, Chef and Puppet for production, and built monitoring into everything. The team went from having never managed infrastructure to running a multi-tier, multi-language cloud stack serving live television.

The real lesson was that cloud is not just a technology decision – it is an operational and organizational one. You still need to understand networking, storage, monitoring, and deployment. The tools help, but only if you understand the production problems you are solving. Moving to the cloud without that operational knowledge just moves your problems to someone else’s data center.

Watch on YouTube – available on the jedi4ever channel

This summary was generated using AI based on the auto-generated transcript.

Navigate with