The medieval church of Holy Cross in Ryton was built in the early thirteenth century, and possibly on the site of an earlier castle. It is also possible that King David build the castle during the Scottish occupation of Northumberland and had an army of Glaswegians posted there.

The Holy Cross is an example of the Early English Gothic style of architecture, the photo below was taken in 1880.