Senate Speaker Leo Housakos has called for an investigation into the “serious” claims that Senator Don Meredith engaged in a sexual relationship with a teenager.

According to a statement released Thursday, Housakos has referred the allegations against Meredith to the Senate’s ethics officer.

“Speaker Housakos takes allegations of this nature very seriously and made the decision to refer the matter to the SEO without hesitation,” the statement said. “Senator Meredith will remain a sitting Senator pending the outcome of this investigation.”

The statement comes a day after Meredith was expelled from the Conservative caucus following a Toronto Star report that alleges the Pentecostal pastor began a relationship, two years ago, with a girl who was 16 years old at the time.

In the report, the girl alleged she and Meredith carried on a relationship that spanned two years, and had sex twice after she turned 18. The girl said she met Meredith, 50, at a church-related event.

The teen, who is not identified, shared text messages with the Star that were allegedly sent by Meredith.

Shortly after the story appeared online Wednesday evening, a Conservative spokesperson said Meredith is no longer a member of the party’s caucus.

Housakos said Thursday that he finds the allegations “disturbing, unacceptable and intolerable.”

He told The Canadian Press he hopes the ethics commissioner will come back in an “expeditious” fashion.

“As Speaker of the Senate of Canada I’m called upon to explain things,” Housakos said. “Certain things are inexplicable and this kind of behaviour is inexplicable.”

Housakos wasn’t the only senator speaking out about the allegations on Thursday.

Senate government leader Claude Carignan released a statement, saying he is “deeply concerned by the serious nature of the allegations” against Meredith.

Conservative Senator Vern White told The Canadian Press that if the allegations are proven true, Meredith should be removed from the Senate.

“This is his scandal,” White said. “This isn’t mine, this isn’t ours. This is his and he’ll own it.”

“He should do the honourable thing,” said Senator Jim Munson, “not only get booted out of caucus but resign.”

Transport Minister Lisa Raitt said Meredith should face “the full force of the law,” if the allegations are true.

But a handful of his fellow senators are still supporting Meredith.

“I would say I feel very bad for him,” said Sen. Anne Cools. “I find it disturbing and upsetting, so I can only imagine what he’s going through.”

Last week, CTV Ottawa Bureau Chief Robert Fife reported that Meredith is facing workplace sexual harassment and bullying allegations.

Meredith, who is married, was appointed to the Senate by Prime Minister Stephen Harper in 2010.

Even though Meredith is a senator, the RCMP says the case falls to local police in Ottawa, where the alleged incident took place.

The Ottawa Police has not said whether or not it is launching and investigation.

Since being appointed in 2010, Meredith has been known for speaking out about the need to protect youth innocence “for as long as possible” and the merits of abstinence.

None of the allegations against him have been tested in court.

With a report from CTV’s Deputy Ottawa Bureau Chief Laurie Graham