Glut of social media posts, political divisiveness a challenge for content moderators
Leigh Adams has seen a steady rise of material for review since she began moderating user comments on websites roughly 14 years ago, but she says the volume only exploded in the last few years as the content's nature became so divisive there's only one word for it: "Bonkers."
Misinformation, trolling and worse has always existed online, but Adams says she saw a shift after the U.S. elected Donald Trump president in 2016 that reached a new height when George Floyd, a Black man in Minneapolis, was killed in police custody in May 2020, fuelling racial tensions just as the world was locked down due to the COVID-19 pandemic.
"It was really the perfect storm ...The internet was already struggling at that time with, 'How do we reconcile anonymity and accountability? How do we make sure to amplify the voices of those who might not be heard?"' said Adams, director of moderation services at Viafoura, a Toronto business reviewing user content for publishers.
"We had not solved for that and we still haven't solved for that, but then you have these (events) on top of it, it just made it a bad situation worse."
Adams noticed Trump being out of office and the return of pre-pandemic activities slightly quelled the "inflamed rhetoric" seen by Viafoura's more than 800 clients, which include media brands CBC, Postmedia and Sportsnet.
But she expects future "swelling" and other content moderation companies say they've detected no significant signs of the onslaught receding. It's likely that keeping up with the volumewill mean tackling an evolving suite of challenges.
Moderators foresee health misinformation continuing to spread rampantly, dubious posters becoming even more sophisticated in their attempts to disrupt platforms and a slew of new regulations targeting online harms in Canada and abroad.
"I don't see the demand declining any time soon, despite all of the talk of recession," said Siobhan Hanna, Telus International's managing director and global vice-president of artificial intelligence.
"For better or worse, this content moderation need will continue to just grow, but the need is going to be for more intelligent, efficient, thoughtful, representative, risk mitigative solutions to handle the increased demand."
Hanna says video is becoming one of the most challenging areas because moderators are no longer only reviewing clips depicting violence, indecency or other harms that may be difficult to watch.
Now there are also so-called deep fakes -- videos where someone's face or body has been digitally spliced into the frame so they appear to be doing or saying things they never did.
The technology has cropped up prominently on TikTok, when visual effects artist Chris Ume spread clips purporting to be of actor Tom Cruise playing card tricks, eating a gum-filled lollipop and performing Dave Matthews Band's song "Crash Into Me."
"I don't think anybody's going to be harmed by ... the videos he's creating, but it's also getting us all used to these deep fakes and maybe drawing our attention away from the more sinister applications, where it could affect the course of an election, or it could affect health care outcomes or decisions made around crimes," Hanna said.
In Ireland for example, videos supposedly depicting political candidates Diane Forsythe and Cara Hunter committing sexual acts were circulated while they ran for office earlier this year.
"I never cease to be surprised," said Adams. "You see the worst thing and then something else comes along, you think, 'what could possibly happen next?"'
Her team recently found a photo that appeared to be a sunset at first glance, but 17 layers back, showed a nude woman.
"If we had not had five people looking at that, it would have been live and up there," she said.
"It's getting more sophisticated and so you have to find new artificial intelligence (AI) tools that are just going to keep digging deeper."
Most companies rely on a blend of human moderators and AI-based systems to review content, but many like Google have conceded machine-based systems "are not always as accurate or granular in their analysis of content as human reviewers."
Adams sees the follies of AI when people invent and popularize new terms -- "seggs" instead of sex, "unalive"instead of dead and "not see" instead of "Nazi" -- to avoid being flagged by moderators, security filters and parental controls.
"In the amount of time it's going to take machines to learn that, that news cycle is over and we're onto something else because they found a new way to say it," Adams said.
But humans also aren't perfect and often can't keep up with the volumes of content alone.
Two Hat, a Kelowna, B.C. moderation company used by gaming brands Nintendo Switch and Rovio and owned by Microsoft, went from processing 30 billion comments and conversations a month before the health crisis to 90 billion by April 2020. Microsoft Canada did not provide more recent numbers, with spokesperson Lisa Gibson saying the company is not able to discuss trends at this time.
Facebook, Instagram, Twitter, YouTube and Google warned users in 2020 they were taking longer to remove harmful posts as the pandemic began and staff retreated home, where viewing sensitive content was tougher and in some cases, forbidden for security reasons.
When asked whether backlogs have been cleared, Twitter declined to comment and Facebook and Instagram did not respond. Google temporarily relied on more technology to remove content violating its guidelines as the pandemic began, which led to an increase in total video removals, spokesperson Zaitoon Murji said. The company expects to see a decline in video removals as it scales back that technology as more moderators return to the office, she added.
As the backlogs formed, countries toughened their stance on harmful content.
The EU recently reached a landmark deal requiring the prompt removal of harmful materials online, while Canada is promising to soon table a bill combating online hate, after a previous iteration was shelved amid a federal election.
Adams says the convergence ofCOVID-19, Trump's rise and the killing of Floyd made publishers more willing to take a stand against problematic content such as hate speech and health misinformation. Legislation, which can vary across countries and often be left up to interpretation, could result in companies having even less tolerance and taking anything that runs the risk of being seen as problematic down, she said.
The stakes are high because letting too much problematic content on a platform can make it unsafe, but removing too much can also interfere with free speech, said Anatoliy Gruzd, a Toronto Metropolitan University professor of information technology management.
"From the user side, that may feel like there's not enough effort to make platforms a welcoming and safe place for everyone, and in part that's because the platforms become so huge, with millions and billions of users at once," he said.
Gruzd doesn't see striking a balance between safety and freedom getting any easier as the policy patchwork evolves, but believes society will move toward considering boundaries and what is acceptable or not to be exposed to.
He said, "Some people will vote with their usage, whether they stop using Facebook or Twitter for certain things, they might decide to go to other platforms with or without too much moderation or they may decide to stop using social media completely."
This report by The Canadian Press was first published May 22, 2022.
MORE SCI-TECH NEWS
Dan Riskin on the ecological impact of invasive earthworms
Dan Riskin on whether or not rainforests can bounce back
CTVNews.ca Top Stories
Many Canadians remain unaware of the involvement of forced child labour in the products they buy, according to non-profit agency World Vision Canada.
Hundreds of protesters descended on the U.S. Supreme Court on Saturday to denounce the justice's decision to overturn the half-century-old Roe v. Wade precedent that recognized women's constitutional right to abortion.
As Pride festivities kick off around the world, many refugees are celebrating the LGBTQ2S+ community for the first time.
Prime Minister Justin Trudeau headed to the G7 summit in Germany on Saturday without a consensus from the Commonwealth to condemn the Russian invasion of Ukraine, but with a chorus of countries calling for help to overcome the fallout of the war.
The World Health Organization said the escalating monkeypox outbreak in nearly 50 countries should be closely monitored but does not warrant being declared a global health emergency.
After the Supreme Court overturned Roe v. Wade on Friday, holding that there is no longer a federal constitutional right to an abortion, protesters and supporters of the ruling gathered at the high court's building in Washington, D.C., and in other cities nationwide.
With the nation's capital bracing for anticipated anti-mandate 'freedom' movement protests during Canada Day weekend, interim Conservative Leader Candice Bergen says her MPs are free to attend.
A barge that ran aground near Vancouver's English Bay last year quickly became an accidental attraction, drawing selfie-seekers and inspiring T-shirt designs. But after seven months, residents seem to have grown weary of its hulking presence on the shoreline.
Ukraine's largest LGBTQ rights event, KyivPride, is going ahead on Saturday. But not on its native streets and not as a celebration.
As gas prices and food costs continue to escalate and another interest rate hike is expected next month, many Canadians are wondering if a recession is coming and how to prepare for a possible economic downturn.
The family of Chelsea Cardno says the body found on flooded farmland adjacent to Mission Creek Friday night has been identified as the missing Kelowna woman.
U.S. President Joe Biden on Saturday signed the most sweeping gun violence bill in decades, a bipartisan compromise that seemed unimaginable until a recent series of mass shootings, including the massacre of 19 students and two teachers at a Texas elementary school.
In 2010, U.S. Senator James Lankford testified that he believed a 13-year-old could consent to sex.
British Prime Minister Boris Johnson said on Saturday he aims to remain in power until the middle of the next decade, despite calls for him to quit, which would make him the country's longest continuously serving leader in 200 years.
He took his school to the U.S. Supreme Court in the 1980s for pulling 'objectionable' books. Here's his message to young people
Steven Pico, who 40 years ago joined a legal fight against his school board's banning of 'objectionable' books to the U.S. Supreme Court when he was 17, says the 'freedom to read a book is the foundation of our democracy.'
A gunman opened fire in Oslo's nightlife district early Saturday, killing two people and leaving more than 20 wounded in what the Norwegian security service called an 'Islamist terror act' during the capital's annual LGBTQ Pride festival.
Now that the House and Senate have adjourned for the summer, CTVNews.ca breaks down what key pieces of legislation passed in the final days of the spring session, and what key government bills will be left to deal with in the fall.
Tanya Ball began her career as a social worker for the Kaska Dene First Nation. Now she runs a land guardian program, working to monitor and protect a vast stretch of the band's northern British Columbia wilderness.
New research has found that women are 'significantly' more likely than men to suffer from long COVID syndrome, in addition to developing different symptoms of the disease.
The Ontario Brain Institute is playing a key role in open science and brain health research with the release of new clinical data that will help scientists around the world advance investigations into pediatric neurological conditions.
German lawmakers voted Friday to end the country's ban on advertising abortions, which has in the past led to doctors being prosecuted for providing information about the procedure to potential patients.
A team of biologists recently hauled in the heaviest Burmese python ever captured in Florida, officials said.
Coinciding with unrelenting cyberattacks against Ukraine, state-backed Russian hackers have engaged in "strategic espionage" against governments, think tanks, businesses and aid groups in 42 countries supporting Kyiv, Microsoft said in a report Wednesday.
NASA's first spacecraft designed to study a metallic asteroid won't be launching this year as planned, according to an announcement made by the agency on Friday.
Paul McCartney was joined by special guests Bruce Springsteen and Dave Grohl in an epic performance at Glastonbury on Saturday night that spanned the first Beatles demo to some of his latest recordings.
Phoebe Bridgers vented her frustration at America's high court during her Glastonbury Festival set on Friday night after the U.S. Supreme Court overturned Roe v. Wade.
A 15-month dispute in British Columbia's film and television industry has ended with the ratification of a new contract for creative and logistical staff working on productions shot in the province.
Statistics Canada says the number of job vacancies at the beginning of April hit just over one million, up more than 40 per cent compared with a year earlier.
Despite record low levels of unemployment, many sectors are suffering from labour shortages in the second quarter with restaurants and hotels continuing to be amongst the worst hit, a new Statistics Canada survey finds.
After the U.S. Supreme Court ruled on Friday to overturn Roe v. Wade, corporate giants from a range of industries pledged to provide support and financial assistance for employees — and, in some cases, their dependents — seeking abortions in states that outlaw the procedure.
An act of kindness from a Winnipeg bus driver is being shared by a passenger who says it warmed his heart to witness.
A new painting of the Duke and Duchess of Cambridge was revealed to the public on Thursday. The painting – the first official portrait of Prince William and his wife, Catherine, together – is on display at the Fitzwilliam Museum in Cambridge, U.K.
Mounties in Coquitlam are appealing to the public for help tracking down two pieces of artwork that were allegedly stolen from a high school art display.
Canadians Bennedict Mathurin and Shaedon Sharpe took very different paths to the NBA, but their pro dreams were realized just minutes apart on Thursday.
Major League Baseball's Houston Astros have thrown a combined no-hitter against the New York Yankees on Saturday at Yankee Stadium.
The U.S. House on Friday passed a bipartisan resolution calling on the Russian government to immediately release WNBA star Brittney Griner.
Toyota is recalling 2,700 bZ4X crossover vehicles globally for wheel bolts that could become loose, in a major setback for the Japanese automaker's ambitions to roll out electric cars.
A majority of Canadians who intend to travel this summer say high gas prices are affecting those planned getaways, a pair of recent surveys show.
Two people involved in testing for the electric car brand NIO died when one of its vehicles fell three stories from a Shanghai parking structure, the company said Friday.