The first building on this site was built in 1068, by Gilbert Mallet who was a Norman knight, the same family have kept their home on that site for over 900 years until it was sold in 1980. The building that stands today is a timber castle, and is Grade 2 listed.

Ghosts that have been seen here are a woman in Elizabethan dress, also a man dressed in Elizabethan clothing in the great hall, and in the courtyard the sound of clashing steel as if a duel is being fought