'Don't do it!': Protesters 'scare off' buyers for heritage fig tree land