Maybe that's the point. I'm being forced to exert executive control to context switch. I had gotten some momentum going, so now I have to mentally brake and dissipate that momentum first before going in a new direction.
I was getting into a rhythm where I could loosen the leash on my mind a bit and just let it do its thing, but now I have to reign it back in again.