There was originally a wooden fortress on this site in 1260 which was totally destroyed. It was rebuilt 20 years later out of stone but again was destroyed and redone. From the 15th century the castle was continually added to and increased in size, it became what we see today by 1640. Throughout its history it as been contstantly destroyed, restored or rebuilt and left unhabited for long periods of time. The worst of the damage was done in 1944 during The Battle of Arnhem. After this extensive renovations were carried out and lasted until 1983.By then it was owned by The Friends of the Castle of Gelderland and back in its 18th century state. It is now opened as a museum.

There has been a number of ghosts seen at the castle including a man in the dungeons, a unhappy servant, and a witch like woman, also other misty figures have been noticed.