Ziggy - do you also have a Surface Pro 3? The only time I process stylus input differently from finger input is if the stylus mode setting is enabled (under the menu at the left corner of the annotations editor). So I can't imagine why you would be seeing any difference when using a stylus versus a finger... Which annotations don't work with a stylus for you?
Mike
Mike