The site of the Crusader Castle was originally occupied by an earlier fortification dating from the Fatimid period (969-1169 A.D.). In the beginning of the 12th century A.D., the Crusaders built a strong fortress, reusing Roman stonework from the site and cutting new stones to match the old ones.

The castle consisted of a courtyard, an enclosure with four towers at each corner of the building, and a fifth tower in the middle of the north wall to defend the entrance. The whole castle was originally surrounded by a moat. In Mamluke and Ottoman times, the castle was reused and some parts of it were restored.

Climbing to the top of the castle offers an excellent vantage point for taking in a panoramic view of the ruins and the Mediterranean Sea. * 28 April 1103 Raymond de St. Gilles captures the town with the aid of Genoese ships. Ugo Umbriaco administers the town on behalf of Raymond and Genoa. Crusader castle during 12th century. * 1188 Hugh III de Giblet surrenders his town and castle as ransom to Salahadin. * 1190 Salahadin orders dismantling of defensive walls as Emperor Frederick I (Barbarossa) approaches. * 1197 Guy I de Gilbet regains the castle and rebuild the defenses.