chore(ci): try to offload compute burden when merging (#9213)

We are going to ramp up what we test on master, and we don't want
people's runners to freeze up (as they have been!)