Fears over lorries ‘causing damage’ to 16th-century village home