9

Scaling Shopify to 300M uniques per month running Rails, Docker, MySQL with Simo...

 3 years ago
source link: https://www.youtube.com/watch?v=yg3YnnFjw2Y
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

Scaling Shopify to 300M uniques per month running Rails, Docker, MySQL with Simon Eskildsen

8,291 views
•Sep 21, 2015

Simon has incredible tips on building resilient apps. From scaling Shopify's database to failing over an entire data center, see how one of the largest Rails app running on thousands of Docker containers can handle intense flash sales and over 300M uniques/month.

How do you make apps more resilient? The easiest first step is tracking errors in development and production and my sponsor is offering viewers a free trial so you can get started in 5 minutes. http://rollbar.com

Simon Eskildsen works on Site Reliability, Performance, and Infrastructure at Shopify. He has worked on moving Shopify to Docker in production and making their infrastructure more resilient. He can be reached on Twitter at https://github.com/Sirupsen and on his website at http://sirupsen.com

Read a summary of this interview and watch more interviews like this one: https://scaleyourcode.com/interviews/...

2:13 - Where does your passion come from? 2:38 - How did you get started with Shopify? 4:42 - What is your job exactly? 5:12 - What does Shopify's architecture look like? 6:46 - Why are you not moving to microservices? 8:52 - How was your switch to Docker? 11:13 - How do you prepare for extremely popular sales? 12:48 - Describe the Failover Matrix and why people should be using it 14:56 - How does Shopify run tests? 17:00 - How do you scale your MySQL databases? 20:11 - You have stress-tested your services. What have you learned from it that we could also use? 22:25 - What happens behind the scenes when a new shop opens up? 23:02 - How do you deal with a large influx in traffic? 24:35 - Why run on your own hardware? 26:07 - Why not autoscale? 27:16 - Running tests in the cloud (with examples from Netflix, more on that here: https://scaleyourcode.com/interviews/...) 28:43 - Your checkouts went down during your first failover. What happened? 32:14 - What tools do you use to detect failures? 33:00 - How do you track Rails errors in production? (I recommend http://rollbar.com) 36:13 - How do you keep the Rails app running fast? 39:42 - Is Docker ready for production? 45:23 - Do you build containers with codebase in it or do you map your code? 47:21 - How do you get experience working on large scale systems? 50:09 - What skills and mindset do you look for when interviewing? 52:05 - How to reach out and follow up with Simon


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK