Anyone who wants to use public office for their own benefit should find a new line of work, Prime Minister Stephen Harper said Tuesday -- for the first time addressing a deepening scandal related to Sen. Mike Duffy's repayment of improperly filed expenses.