Uncover both sides of a castle with a 450-year history – its role as a bishop’s palace, and as a fortress and state prison.