Business confidence down but can improve with infrastructure investment