Peter Guthrie has been removed from the UCP caucus just over a month and a half after he quit his cabinet position over AHS procurement concerns.