The first historical mention of the castle appears in the 1242 will of Viscount Guerau V de Cabrera, in which he granted his son Ramon a small inheritance consisting of the castles of Anglès and Brunyola. The medieval castle was systematically destroyed, particularly during the 15th century, as a result of several earthquakes and the War of the Remences. The few surviving remains are limited to several walls with arrow slits and some spaces preserved within the present-day urban layout, such as the Town Square, which once served as the castle’s parade ground.