[itsme]

I agree that keeping annotations in place has too many difficulties.
Keeping annotations in the database instead of discarding them seems OK for me, but the user should know about it and should be able to delete or move these annotations.
How about something like a button or a control that becomes available when invisible annotations exist? Pressing that button could automatically add as many empty pages as necessary to show the annotations.