A general view of the harbour and seafront in Scarborough in England. You can see Scarborough Castle in the background. Scarborough is a Spa and holiday resort in North Yorkshire, England; population (1991) 38,800. A ruined Norman castle overlooks the town, which is a touring centre for the Yorkshire Moors.