2 minute read
Bonjour! We’re off to Paris for the Paris.rb conf from taking place from June 28 - 29, 2018. This conference is designed to bring together Ruby enthusiasts from all over the world, to learn what’s new in Ruby and connect with each other. Our developers, Rafael França and Jenna Blumenthal, will be presenting the talks below:
2 min read
We’re excited to announce that we’ll be attending Percona Live 2018 in Santa Clara this coming April! Running from April 23-25, the Percona Live Open Source Database Conference is the premier event for anyone that develops and uses open source database software.
We’ll be sending three Shopify speakers to the event. Check out their conference topics below!
The role of the DBA is evolving, as more companies and products move to a hybrid model where, along with their traditional work, DBAs are expected to code. We’ve scaled our Data Stores team to bring in pure developers, pure DBAs, and a mix of both. We were able to find creative ways to help support our DBAs to better adapt to the changes in the industry. We’re discovering how increasingly complex it is to find candidates with this mix of experience, and through learning from our struggles we have learned the best methods to find DBAs and to help them evolve. We want DBAs to be prepared for this new world and would love to share our industry findings with this community.
Monday, April 23 (4:30pm - 6:30pm)
In this session, we will discuss our fully automated failover solution running in containers on Kubernetes. Using Orchestrator for MySQL failovers, ProxySQL to route queries and a Zookeeper-backed application we wrote called Taiji for service discovery, database failures and topology changes are handled without any human intervention. This system is tolerant to network partitions and connectivity issues, node failures, and even full-region outages.
After adding additional functionality to Orchestrator, we have it deployed with the raft consensus protocol and automatic failovers enabled. ProxySQL is deployed alongside a Taiji container that watches for changes in Zookeeper. All topology changes are automatically pushed to Zookeeper via Orchestrator callback scripts and a Taiji agent that performs health checks on databases. In less than a second, these changes are pushed to ProxySQL, so our application will seamlessly begin sending read and write queries to the proper database.
Tuesday, April 24 (3:50pm - 4:40pm)
Existing tools like mysqldump and replication cannot migrate data between GTID-enabled MYSQL and non-GTID-enabled MySQL - a common configuration across multiple cloud providers that cannot be changed. These tools are also cumbersome to operate and error-prone, thus requiring a DBA’s attention for each data migration. We introduced a tool that allows for easy migration of data between MySQL databases with constant downtime on the order of seconds.
Inspired by gh-ost, our tool is named Ghostferry and allows application developers at Shopify to migrate data without assistance from DBAs. It has been used to rebalance sharded data across databases. We plan to open source Ghostferry at the conference so that anyone can migrate their own data with minimal hassle and downtime. Since Ghostferry is written as a library, you can use it to build specialized data movers that move arbitrary subsets of data from one database to another.
Tuesday, April 24 (4:50pm - 5:15pm)
Interested in working at Shopify? Talk to Kayla at the conference, or reach out on LinkedIn! You can also check out our careers page.
2 min read
We’re excited to announce that we’ll be attending RailsConf 2018 in Pittsburgh from April 17 - 19! RailsConf is hosted annually by Ruby Central, Inc., and features the world’s largest gathering of Rails developers and Rubyists!
This year, we’re sending three Shopify engineers to speak about their experiences and best practices for developing on Rails for one of the world’s largest commerce sites. Check out their conference topics below!
Tracking down bugs can be hard. Tracking down bugs in a codebase touched by five thousand contributors is even harder. Making heads or tails of an inheritance-happy codebase like Rails can be a nightmare. How do you find where the bug in save is when save is overridden by 15 different modules?
In this talk, we’ll look at the process that goes into fixing a bug in Rails itself. You’ll learn about every step from the initial report, to when the fix is eventually committed. We’ll share tips on navigating Rails’ internals, and how to find the source of problems - even if you’re a complete newcomer to Rails.
Tuesday, April 17 (11:40am - 12:20pm)
Moving from operations powered by scripts like Capistrano, to containers orchestrated by Kubernetes, requires a shift in practices. In this talk, we’ll go beyond the operational basics of Kubernetes, and cover more advanced aspects, such as gradual deployments, capacity planning, job workers and their safety, and solving problems for unique cloud environments like Kubernetes.
This presentation is about the lessons we learned while migrating hundreds of Rails apps within the Shopify organization to Kubernetes.
Tuesday, April 17 (2:30pm - 3:10pm)
Upgrading Rails at Shopify has always been a tedious and slow process. A full upgrade cycle took as much time as releasing a new version of Rails - this wasn’t working for us. We realized that having a full-time team dedicated to working on Rails wasn’t the solution; instead, it was to build a proper toolkit and process for each upgrade. In this talk, you’ll learn about the different techniques and strategies that enabled Shopify to perform its fastest, smoothest Rails upgrade ever.
Interested in working at Shopify? Talk to Mackenzie, Alexa, or Jane about our engineering opportunities at our booth, or reach out to them on LinkedIn! You can also head over to our careers page.
3 minute read
Get pumped! This March, Shopify engineers will be speaking at SREcon Americas in Santa Clara, CA, USA! This three-day conference runs from March 27-29, 2018, and is dedicated to highlighting excellence, best practices, and thought leadership in the areas of engineering resilience, reliability, and scalability. Shopify engineers will be giving presentations on several topics, ranging from software engineer lesso
