A new poll says confidence in the economy has plunged for many Canadian small business owners.