Historic England said a building could only be removed from the list if the secretary of state for culture, media and sport ...