PCMag editors select and review products independently. If you buy through affiliate links, we may earn commissions, which help support our testing.

Facebook Turns its AI to Offensive Post Detection

Algorithms are already scanning Facebook Live videos to root out nudity and violence.

 & Tom Brant Managing Editor

Our team tests, rates, and reviews more than 1,500 products each year to help you make better buying decisions and get more from technology.

Our Expert
LOOK INSIDE PC LABS HOW WE TEST
65 EXPERTS
43 YEARS
41,500+ REVIEWS

Facebook on Thursday announced that it is developing artificial intelligence algorithms to root out offensive content.

It also released a series of videos aimed at getting students interested in pursuing AI research in college.

The algorithms can detect nudity, violence, and other content that doesn't conform to Facebook's community guidelines, Reuters reports. Facebook has long relied on users to flag offensive posts, but following outcry over the removal of an iconic Vietnam war photograph and its role in spreading fake news, among other controversies, adding AI algorithms could one day help it police everything its users upload.

For now, the algorithms are in a limited testing phase on the Facebook Live video-streaming platform, and humans still have the final say on which streams get removed. The tests are designed to overcome two challenges, according to Joaquin Candela, the company's director of applied machine learning.

"One, your computer vision algorithm has to be fast, and I think we can push there, and the other one is you need to prioritize things in the right way so that a human looks at it, an expert who understands our policies, and takes it down," Candela told Reuters.

Of course, to continue its investment in AI, Facebook will need talented engineers, people who are in chronically short supply in Silicon Valley. So its AI promotional videos, hosted by head of AI research Yann LeCun, are designed to pique students' curiosity by touting the societal benefits of convolutional neural networks, deep learning, and other AI phenomena.

"Artificial intelligence is not magic, but we have already seen how it can make seemingly magical advances in scientific research and contribute to the everyday marvel of identifying objects in photos, recognizing speech, driving a car, or translating an online post into dozens of languages," Facebook wrote in a blog post.

About Our Expert

Tom Brant

Tom Brant

Managing Editor

I’m a managing editor at PCMag.com focused on PC hardware. Reading this during the day? Then you've caught me testing gear and editing reviews of Wi-Fi routers, printers, laptops, and tons of other personal tech. (Reading this at night? Then I’m probably dreaming about all those cool products.) I’ve covered the consumer tech world as an editor, reporter, and analyst since 2015.

I've covered most major consumer tech events, including CES, Computex, Google I/O, and IFA. I've also appeared on CBS News, in USA Today, and at many other outlets to offer analysis on breaking technology news.

Before I joined the tech-journalism ranks, I wrote on topics as diverse as Borneo's rainforests, Middle Eastern airlines, and Big Data's role in presidential elections. A graduate of Middlebury College, I also have a master's degree in journalism and French Studies from New York University.

The Technology I Use

While most people buy a phone or laptop and stick with it for years, I’m lucky enough to use devices based on Android, iOS, macOS, and Windows daily as part of my job. As a result, I cycle through lots of tech in addition to my IT-issue work laptop. (Yes, that's a ThinkPad.) Personally, I’ve also owned a lot of tech products both cutting-edge and cringeworthy, from the Nintendo GameCube and the original MacBook to the Palm m105 and the CueCat.

Read full bio