This is maybe not just an windows problem. I made the experience too that MSP is closing when I am in annotations mode. Mostly when I zoomed in to write something withe the pen. I usually avoid too zoom in and everything is fine. I thought my older Samsung device could not handle the zoom in the annotation mode
Samsung Note Pro 12.2 LineageOS 14.1
Huawei Media Pad M3 lite
Huawei Media Pad M3 lite