I now think my last bugfix was incorrect - what we need to change when
the link is flipped is which end we compare, rather than which interface
on the vlink we compare with.

Quite a bear to track down!