Elda castle, which is located on a hill beside the River Vinalopó, was built during the 12th and 13th Centuries, but was not sufficient to hold back the re-conquering Christians in the 13th Century. The town and castle changed hands frequently after the defeat of the Moors, and life in the region was generally unsettled due to constant battles between the Kingdoms of Castille and Aragon. Elda was finally annexed to the Kingdom of Valencia in 1304. By way of a treaty, numerous ‘moriscos’ (Moors converted to Christianity) were allowed to remain in Elda, where many stayed until finally expelled in 1581 by the Count of Elda - Joan Coloma. This expulsion resulted in a severe fall in the population of Elda, leaving only around six hundred Christian townspeople, this in turn led to a decline in the economy of the town, and it was very slow to recover during the following centuries