The castle was built in the mid-15th century by Marin Radoj as part of the extension of the Veriga Tower, which was built on the site in the late 14th century. The word camerlengo (Italian: camerlengo) refers to the title of an administrative official.