The owner of a U.S. building sought for use as an ICE processing facility has addressed outcry over the proposed sale.