You can't, unless the guard thinks you have something his master wants.
Do you have a pendant from the swamp (see a flash by the left edge)?
USE pendant on guard. He says to come back later.