Glut of social media posts, political divisiveness a challenge for content moderators
Leigh Adams has seen a steady rise of material for review since she began moderating user comments on websites roughly 14 years ago, but she says the volume only exploded in the last few years as the content's nature became so divisive there's only one word for it: "Bonkers."
Misinformation, trolling and worse has always existed online, but Adams says she saw a shift after the U.S. elected Donald Trump president in 2016 that reached a new height when George Floyd, a Black man in Minneapolis, was killed in police custody in May 2020, fuelling racial tensions just as the world was locked down due to the COVID-19 pandemic.
"It was really the perfect storm ...The internet was already struggling at that time with, 'How do we reconcile anonymity and accountability? How do we make sure to amplify the voices of those who might not be heard?"' said Adams, director of moderation services at Viafoura, a Toronto business reviewing user content for publishers.
"We had not solved for that and we still haven't solved for that, but then you have these (events) on top of it, it just made it a bad situation worse."
Adams noticed Trump being out of office and the return of pre-pandemic activities slightly quelled the "inflamed rhetoric" seen by Viafoura's more than 800 clients, which include media brands CBC, Postmedia and Sportsnet.
But she expects future "swelling" and other content moderation companies say they've detected no significant signs of the onslaught receding. It's likely that keeping up with the volumewill mean tackling an evolving suite of challenges.
Moderators foresee health misinformation continuing to spread rampantly, dubious posters becoming even more sophisticated in their attempts to disrupt platforms and a slew of new regulations targeting online harms in Canada and abroad.
"I don't see the demand declining any time soon, despite all of the talk of recession," said Siobhan Hanna, Telus International's managing director and global vice-president of artificial intelligence.
"For better or worse, this content moderation need will continue to just grow, but the need is going to be for more intelligent, efficient, thoughtful, representative, risk mitigative solutions to handle the increased demand."
Hanna says video is becoming one of the most challenging areas because moderators are no longer only reviewing clips depicting violence, indecency or other harms that may be difficult to watch.
Now there are also so-called deep fakes -- videos where someone's face or body has been digitally spliced into the frame so they appear to be doing or saying things they never did.
The technology has cropped up prominently on TikTok, when visual effects artist Chris Ume spread clips purporting to be of actor Tom Cruise playing card tricks, eating a gum-filled lollipop and performing Dave Matthews Band's song "Crash Into Me."
"I don't think anybody's going to be harmed by ... the videos he's creating, but it's also getting us all used to these deep fakes and maybe drawing our attention away from the more sinister applications, where it could affect the course of an election, or it could affect health care outcomes or decisions made around crimes," Hanna said.
In Ireland for example, videos supposedly depicting political candidates Diane Forsythe and Cara Hunter committing sexual acts were circulated while they ran for office earlier this year.
"I never cease to be surprised," said Adams. "You see the worst thing and then something else comes along, you think, 'what could possibly happen next?"'
Her team recently found a photo that appeared to be a sunset at first glance, but 17 layers back, showed a nude woman.
"If we had not had five people looking at that, it would have been live and up there," she said.
"It's getting more sophisticated and so you have to find new artificial intelligence (AI) tools that are just going to keep digging deeper."
Most companies rely on a blend of human moderators and AI-based systems to review content, but many like Google have conceded machine-based systems "are not always as accurate or granular in their analysis of content as human reviewers."
Adams sees the follies of AI when people invent and popularize new terms -- "seggs" instead of sex, "unalive"instead of dead and "not see" instead of "Nazi" -- to avoid being flagged by moderators, security filters and parental controls.
"In the amount of time it's going to take machines to learn that, that news cycle is over and we're onto something else because they found a new way to say it," Adams said.
But humans also aren't perfect and often can't keep up with the volumes of content alone.
Two Hat, a Kelowna, B.C. moderation company used by gaming brands Nintendo Switch and Rovio and owned by Microsoft, went from processing 30 billion comments and conversations a month before the health crisis to 90 billion by April 2020. Microsoft Canada did not provide more recent numbers, with spokesperson Lisa Gibson saying the company is not able to discuss trends at this time.
Facebook, Instagram, Twitter, YouTube and Google warned users in 2020 they were taking longer to remove harmful posts as the pandemic began and staff retreated home, where viewing sensitive content was tougher and in some cases, forbidden for security reasons.
When asked whether backlogs have been cleared, Twitter declined to comment and Facebook and Instagram did not respond. Google temporarily relied on more technology to remove content violating its guidelines as the pandemic began, which led to an increase in total video removals, spokesperson Zaitoon Murji said. The company expects to see a decline in video removals as it scales back that technology as more moderators return to the office, she added.
As the backlogs formed, countries toughened their stance on harmful content.
The EU recently reached a landmark deal requiring the prompt removal of harmful materials online, while Canada is promising to soon table a bill combating online hate, after a previous iteration was shelved amid a federal election.
Adams says the convergence ofCOVID-19, Trump's rise and the killing of Floyd made publishers more willing to take a stand against problematic content such as hate speech and health misinformation. Legislation, which can vary across countries and often be left up to interpretation, could result in companies having even less tolerance and taking anything that runs the risk of being seen as problematic down, she said.
The stakes are high because letting too much problematic content on a platform can make it unsafe, but removing too much can also interfere with free speech, said Anatoliy Gruzd, a Toronto Metropolitan University professor of information technology management.
"From the user side, that may feel like there's not enough effort to make platforms a welcoming and safe place for everyone, and in part that's because the platforms become so huge, with millions and billions of users at once," he said.
Gruzd doesn't see striking a balance between safety and freedom getting any easier as the policy patchwork evolves, but believes society will move toward considering boundaries and what is acceptable or not to be exposed to.
He said, "Some people will vote with their usage, whether they stop using Facebook or Twitter for certain things, they might decide to go to other platforms with or without too much moderation or they may decide to stop using social media completely."
This report by The Canadian Press was first published May 22, 2022.
MORE SCI-TECH NEWS
Dan Riskin on how climate change pushed a pest northward
Dan Riskin on the ecological impact of invasive earthworms
CTVNews.ca Top Stories
In the wake of last year’s discoveries of unmarked graves at residential schools and the prominent displays of the Canadian flag during 'Freedom Convoy' protests, some Canadians are re-evaluating the meaning of the national symbol.
'Not going to happen in our lifetime': First-time homebuyers share their struggles with purchasing a home
A recent survey shows nearly 50 per cent of Canadians who rent expect to do so forever. As rising interest and inflation rates contribute to a sense of pessimism among first-time homebuyers in Canada, some are sharing their struggles with purchasing their first house.
NEW THIS MORNING | What you need to know about Canada Day celebrations in Ottawa
A sea of red and white is expected to converge on downtown Ottawa and LeBreton Flats today to celebrate Canada's 155th birthday.
Police officers in cruisers, on foot patrol and on bicycles are patrolling the Parliamentary Precinct, the ByWard Market and the so-called 'motor vehicle control zone,' as the city prepares for Canada's 155th birthday celebrations and possible protests.
Russian missile attacks on residential areas in a coastal town near the Ukrainian port city of Odesa early Friday killed at least 19 people, authorities reported, a day after Russian forces withdrew from a strategic Black Sea island.
Stunning new revelations about former U.S. President Donald Trump’s fight to overturn the 2020 election have exposed growing political vulnerabilities just as he eyes another presidential bid.
The Royal Canadian Navy says it has relieved the commanding officer of a warship in the Pacific Fleet.
After the overturning of Roe v. Wade by the U.S. Supreme Court, some LGBTQ2S+ couples are alarmed, worrying about a return to a time when they lacked equal rights to married heterosexual couples under the law. Many, fearful that their marital status is in danger, are moving now to square away potential medical, parental and estate issues.
Gov. Gen. Mary Simon says Canadians should work together to build an inclusive society in her official message to the nation to mark Canada Day.
Conservative leadership candidate Pierre Poilievre joined the final leg of a march led by a Canadian soldier charged for speaking out against COVID-19 vaccine requirements that has sparked promises -- and fears -- of a new wave of protests in the capital.
Multiple crashes involving bears in a B.C. national park earlier this month prompted a crackdown on drivers in the area, according to the B.C. Highway Patrol and Parks Canada.
A rare portrait of Diana, Princess of Wales, will be on public display for the first time after it was recently sold for US$201,600 at auction.
Chinese President Xi Jinping on Friday defended his vision of the 'one country, two systems' framework against accusations by the U.S., U.K. and others that Beijing has undermined the freedoms and autonomy promised to Hong Kong for 50 years.
For the second time in three days, a visitor to Yellowstone National Park was gored by a bison, park officials said Thursday.
The Dutch central bank DNB on Friday apologized for its role in the 19th century slave trade and said it would fund projects to raise awareness of slavery and to mitigate the effects it still has on people.
Canadian Forces veteran James Topp marched through Ottawa on Thursday on the final leg of his cross-country march, and was joined by Conservative Party leader Pierre Poilievre for part of the walk.
The Conservative Party of Canada says approximately 675,000 members will be eligible to vote in this year's leadership race.
The Canadian Food Inspection Agency is recalling a number of different Enjoy Life brand bakery products because they may contain pieces of plastic.
The Canadian Food Inspection Agency has issued a recall for two flavours of RemarkaBall brand Crunchy Energy Balls because they may contain milk which is not declared on the label.
Canada will require that companies add nutrition warnings to the front of pre-packaged food with high levels of saturated fat, sugar or sodium in an effort to help grocery shoppers make healthier choices with just a glance.
The TBone study, conducted over a seven-year period starting in 2015, found that prolonged weightlessness accelerated bone loss in the astronauts.
A pair of orcas drove great white sharks away from a stretch of South African coast after killing five sharks over just a few months in 2017, according to a new study.
Instagram is blocking posts that mention abortion from public view, in some cases requiring its users to confirm their age before letting them view posts that offer up information about the procedure.
This week, pop culture critic Richard Crouse reviews new movies: 'Minions: The Rise of Gru,' 'Marcel the Shell with Shoes On,' 'The Forgiven' and 'Mr. Malcolm’s List.'
Rapper, producer and entrepreneur Kanye West, who legally changed his name to Ye last year, was sued on Wednesday for allegedly sampling a song by musician Marshall Jefferson without permission.
Sam Asghari opened up about his marriage to the 'amazing' Britney Spears in his first interview since their June wedding.
Two of Canada's largest airlines announced steps this week to cope with delays, cancellations and service issues. Head to CTVNews.ca to read about the changes announced by Air Canada and WestJet.
European shares edged higher after Asian benchmarks finished lower Friday, as a quarterly report by Japan's central bank rekindled worries about the world's third largest economy.
The Canada Day long weekend is the perfect time for burgers on the grill, cold drinks and time with family and friends. Yet a backyard barbecue comes with a bigger price tag this year as food prices soared 9.7 per cent in May.
The May Garden Chinese Restaurant in Bedford, N.S., has introduced 'Bella' to its team -- a robot that helps deliver customers' orders to their tables.
Two northern Vancouver Island photographers captured some stunning images of a passing lightning storm this week.
U.S. basketball star Brittney Griner is set to go on trial in a Moscow-area court Friday, about 4 1/2 months after she was arrested on cannabis possession charges at an airport while travelling to play for a Russian team.
Canadians Bianca Andreescu and Denis Shapovalov were both eliminated from Wimbledon after suffering second -round losses at the All England Tennis Club on Thursday.
A stolen Olympic gold medal belonging to a member of the 2020 U.S. Women's Volleyball Team has been found in Southern California, authorities said Wednesday.
Former Formula One supremo Bernie Ecclestone drew condemnation on Thursday after the 91-year-old defended Russian President Vladimir Putin in a television interview as a 'first class person' he would 'take a bullet' for.
Ontario gas prices are about to take a huge drop and one expert says it will be 'well worth waiting' if drivers can hold off on filling up.
The car experts at Edmunds compare and contrast two electric newcomers - 2022 Mercedes-Benz EQS and the 2022 Audi e-tron GT- to help you decide which premium battery-powered four-door is right for you.