The parents of a man who was under the care of a former care home staff member found guilty of sexual abusing residents are upset about recent parole board decisions.