In this talk, “Scaling Deployment,” from Etsy talks on the development and deployment infrastructure that they utilize at Etsy. This talk was recorded at the Continuous Delivery NYC meetup at Etsy Labs. At Etsy they have over 100 engineers deploying more than 60 times a day. This culture of continuously deploying small change sets enables them to build and release robust features all while serving over a billion page views per month. In order to make sure they can keep up this pace, they have development and deployment infrastructure in place that makes it comfortable and simple to make changes. So simple that as an engineer at Etsy you deploy the site on your first day – even if you’re a dog.

But how is it possible to deploy so frequently among so many engineers and yet maintain a stable system? To answer this Dave gives a high-level overview of the basic application structure to introduce the specific architecture at Etsy and how their development environment is set up. For development, every engineer gets their own VM with the full application stack configured. This makes it easy to get started and puts every developer in the same, familiar setup. This is a crucial part in removing confusion and ambiguity about how to work on and deploy changes.

For the actual deployment Etsy uses a one-button deploy system – Deployinator - which they developed and open sourced. This system is integrated tightly with their company-wide IRC server and its set of tools that they’ve built to foster confidence, fast feedback and easy communication and collaboration between engineers. A detailed overview will be given on how the system works, how they use it and what problems they had to solve while making sure everyone can deploy as easily and fast as possible. One of the pillars of keeping it fast and scalable was also implementing Atomic Deploys for their web stack. This talk will go into details about what challenges they faced and how Etsy made it work with minimal interruption to the developer workflow.

Slides & Bio…

 

Organized by , this is a talk from their recent Dynamic Scaling meetup at Yahoo! URL’s cafe. In this talk, , Head of Tech Ops at Pinterest, covers how they Dynamically Scale at Pinterest.


Continue reading »

Mar 112013
 

Today we’ve got the recording of the first geek talk from the recent SF Redis meetup. , Head of Tech Operations at Pinterest, talks to us about their usage of the advanced key-value store in his talk titled ‘Redis at Pinterest’:


Continue reading »

 

 

Varnish Cache

At the brand new Varnish Cache User Group in NYC, Business Insider’s Chief Architect, , gave a talk entitled “Introduction to Caching with Varnish,” part one of a series of talks on Varnish.


Continue reading »

 

Ben Christensen speaking on the Netflix API

We were at Box.net this week for the SV Cloud Computing group to hear an awesome talk from Netflix engineer on the massive improvements Netflix has made to their API infrastructure over the past year or so. The Netflix API currently serves up to 1.6 billion requests/day (!) and supports more than 800 different connected devices. Their API architecture is designed for resiliency, and you’ll hear Ben talk about exactly how they achieve that – plus, some other very interesting info on how they’ve recently re-architected their API for easy of maintenance and maximum performance.

Audio

Continue reading »

Proudly hosted by WPEngine