The structure of Swallow’s nest resembles a medieval knight's castle but it, in its present form, was built by the architect Sherwood in 1912