Workshop - Test Smarter, Not Harder - Crafting a Test Selection Framework from Scratch
The simplest way of running tests is to run all of them, regardless of what changes you are testing. However, depending on the size of your test suite, this will either get slow or expensive. At Shopify we have almost 300,000 Rails tests and we add 50,000 more annually. The sheer amount of tests and their growth makes it impossible to run all tests, all the time! Hence we implemented a framework to only run tests relevant to your code changes.
We will build a test selection framework from scratch in this workshop. We will begin by exploring the fundamentals of such a framework: code analysis. After that we will dive into minitest reporters, how they work and how we can use them to generate a test map. Finally we will use the generated test map to only run tests relevant to your code changes. Attendees will walk away with a solid understanding of what test selection is, how it works and how to implement it.
- 13:30 - 14:30
- 5th October 2023
- Workshop Hall
Staff Engineer, Shopify
Christian Bruckmayer is originally from Nuremberg, Germany, although now calls the South West of England home. In his day job, he makes commerce better for everyone at Shopify. For more than a decade, he has been an avid open source contributor hacking for instance on JRuby, openSUSE Linux or various (Ruby) gems.
If he’s not hacking Ruby, he loves spending quality time with his family, including his daughter.