Labor facing tough times in its heartland