From outer space? Sask. farmers baffled after discovering strange wreckage in field
A family of fifth generation farmers from Ituna, Sask. are trying to find answers after discovering several strange objects lying on their land.
Eight years ago, a team of researchers launched a project to carefully repeat early but influential lab experiments in cancer research.
They recreated 50 experiments, the type of preliminary research with mice and test tubes that sets the stage for new cancer drugs. The results reported Tuesday: About half the scientific claims didn't hold up.
"The truth is we fool ourselves. Most of what we claim is novel or significant is no such thing," said Dr. Vinay Prasad, a cancer doctor and researcher at the University of California, San Francisco, who was not involved in the project.
It's a pillar of science that the strongest findings come from experiments that can be repeated with similar results.
In reality, there's little incentive for researchers to share methods and data so others can verify the work, said Marcia McNutt, president of the National Academy of Sciences. Researchers lose prestige if their results don't hold up to scrutiny, she said.
And there are built-in rewards for publishing discoveries.
But for cancer patients, it can raise false hopes to read headlines of a mouse study that seems to promise a cure "just around the corner," Prasad said. "Progress in cancer is always slower than we hope."
The new study reflects on shortcomings early in the scientific process, not with established treatments. By the time cancer drugs reach the market, they've been tested rigorously in large numbers of people to make sure they are safe and they work.
For the project, the researchers tried to repeat experiments from cancer biology papers published from 2010 to 2012 in major journals such as Cell, Science and Nature.
Overall, 54% of the original findings failed to measure up to statistical criteria set ahead of time by the Reproducibility Project, according to the team's study published online Tuesday by eLife. The nonprofit eLife receives funding from the Howard Hughes Medical Institute, which also supports The Associated Press Health and Science Department.
Among the studies that did not hold up was one that found a certain gut bacteria was tied to colon cancer in humans. Another was for a type of drug that shrunk breast tumors in mice. A third was a mouse study of a potential prostate cancer drug.
A co-author of the prostate cancer study said the research done at Sanford Burnham Prebys research institute has held up to other scrutiny.
"There's plenty of reproduction in the (scientific) literature of our results," said Erkki Ruoslahti, who started a company now running human trials on the same compound for metastatic pancreatic cancer.
This is the second major analysis by the Reproducibility Project. In 2015, they found similar problems when they tried to repeat experiments in psychology.
Study co-author Brian Nosek of the Center for Open Science said it can be wasteful to plow ahead without first doing the work to repeat findings.
"We start a clinical trial, or we spin up a startup company, or we trumpet to the world `We have a solution,' before we've done the follow-on work to verify it," Nosek said.
The researchers tried to minimize differences in how the cancer experiments were conducted. Often, they couldn't get help from the scientists who did the original work when they had questions about which strain of mice to use or where to find specially engineered tumor cells.
"I wasn't surprised, but it is concerning that about a third of scientists were not helpful, and, in some cases, were beyond not helpful," said Michael Lauer, deputy director of extramural research at the National Institutes of Health.
NIH will try to improve data sharing among scientists by requiring it of grant-funded institutions in 2023, Lauer said.
"Science, when it's done right, can yield amazing things," Lauer said.
For now, skepticism is the right approach, said Dr. Glenn Begley, a biotechnology consultant and former head of cancer research at drugmaker Amgen. A decade ago, he and other in-house scientists at Amgen reported even lower rates of confirmation when they tried to repeat published cancer experiments.
Cancer research is difficult, Begley said, and "it is very easy for researchers to be attracted to results that look exciting and provocative, results that appear to further support their favorite idea as to how cancer should work, but that are just wrong."
------
The Associated Press Health and Science Department receives support from the Howard Hughes Medical Institute's Department of Science Education. The AP is solely responsible for all content.
A family of fifth generation farmers from Ituna, Sask. are trying to find answers after discovering several strange objects lying on their land.
Andy Kim's 'Rock Me Gently' is marking a major milestone, as it celebrates its 50th anniversary.
Oprah Winfrey said on Thursday evening that she has long played a role in promoting unhealthy and unrealistic diets.
A southwestern Ontario woman has received an $8,400 bill from a hospital in Windsor, Ont., after she refused to put her mother in a nursing home she hated -- and she says she has no intention of paying it.
Toronto police say a man who allegedly attempted to access Drake’s Bridle Path property was taken to hospital on Thursday after an altercation with security guards.
If you're cruising down a highway and realize you have a flat tire, you may want to think twice before stopping to fix it on the side of the road.
Dangerous storms crashed over parts of the U.S. South on Thursday even as the region cleaned up from earlier severe weather that spawned tornadoes, killed at least three people, and gravely injured a boy who was swept into a storm drain as he played in a flooded street.
The National Post is reporting that Rex Murphy, the pundit and columnist who hosted a national call-in radio show for decades, has died.
Over the last decade, students have pushed universities to cut financial ties with fossil fuel producers, weapons manufacturers, tobacco companies and prison firms. Here's why it's not always that simple.
A Listowel, Ont. man, drafted by the Hamilton Tigercats last week, is also getting looks from the NFL, despite only playing 27 games of football in his life.
A small Ajax dessert shop that recently received a glowing review from celebrity food critic Keith Lee is being forced to move after a zoning complaint was made following the social media influencer’s visit last month.
The Canada Science and Technology Museum is inviting visitors to explore their poop. A new exhibition opens at the Ottawa museum on Friday called, 'Oh Crap! Rethinking human waste.'
The Regina Police Service says it is the first in Saskatchewan and possibly Canada to implement new technology in its detention facility that will offer real-time monitoring of detainees’ vital health metrics.
The stakes have been set for a bet between Vancouver and Edmonton's mayors on who will win Round 2 of the Stanley Cup playoffs.
A grieving mother is hosting a helmet drive in the hopes of protecting children on Manitoba First Nations from a similar tragedy that killed her daughter.
A chicken farmer near Mattawa made an 'eggstraordinary' find Friday morning when she discovered one of her hens laid an egg close to three times the size of an average large chicken egg.
A P.E.I. lighthouse and a New Brunswick river are being honoured in a Canada Post series.
An Ontario man says he paid more than $7,700 for a luxury villa he found on a popular travel website -- but the listing was fake.