Construction of the castle began in 1969 when Bishop began construction on a family cottage, which he decided to surround with rocks. Several neighbors noted that the structure looked something like a castle. Bishop took this into consideration and soon began building his castle. He bought the land when he was fifteen for a price of $1,250. He has faced numerous challenges with the local and state government over ownership and activities on the site.