The big factor stopping thousands of women from starting a family