Actually, swapping the order of the conditions did in fact make some difference, strange.
I ran the query a couple of times for each variation to see if the difference in speed was just a coincidence or a pattern. Looks like the speed really is different.