Plans to expand a gaming centre into an empty unit fail to recognize that the building is Grade II listed – Conservation officers have claimed.