[MartinH]

After playing around some more, maybe I just misunderstood how link points work. 

Are they only one way, start -> end?

I think I accidentally created the start and end reversed and the dots are more or less identical so I didn't notice that it mattered. So one of them would always just activate the touch actions.