Quebec Labour Minister Jean Boulet has confirmed his plan to step away from politics at the end of his term.