The answer to this one is that my Yaw P was way too low. The reason is that I had just upgraded my copter to a new version of Betaflight, and P gain scaling had changed. I was so used to putting in "11" as my P gain, I did it even though the new version of Betaflight should have used "110".