The B-listed Speirsfield House was hit by a second fire in May, months after a proposal to demolish it was withdrawn.