You can't, unless the guard thinks you have something his master wants.
Do you have a pendant from the swamp (see a flash by the left edge)?