Brett knew his career was over when ghosts began haunting his sleep