Around 2,000 people protested in Crowborough against plans to house 540 single male asylum seekers at a disused army camp.