How do I get into the castle?

Listen to what the eye at the door (past the drawbridge) told you.
Everything you need to know can be found in what he says.

No matter what you do, you're not getting in through the front door.

But there is an exit elsewhere beyond the moat.

See the hint about crossing the moat, and take the alternate way as described
in that question.  You should be able to get into the sewers by following
that path.

The switches in the sewer are the key to getting in.

Remember that Xanth uses a lot of wordplay.