Facebook’s Rosetta AI detects offensive memes

A figurine is seen in front of the Facebook logo in this illustration taken

[Image: courtesy of Facebook] Now, though, Facebook says it has a new arrow in its quiver-a tool known as Rosetta that uses machine learning to better understand text embedded in imagery or videos. We are therefore exploring ways to bridge the domain gap between our synthetic engine and real-world distribution of text on images. And now, the company is deploying an artificial intelligence (AI) based tool to take on the issue heads on.

Named Rosetta, the system is already live and is extracting text from nearly one billion images and video frames posted on Facebook and Instagram daily, according to the social media giant.

The procedure basically comes down to two stages: Rosetta checks pictures for content, and afterward utilizes content acknowledgment to distinguish what the content really says. It can add the search results, and it can also scan for the harmful content.

From memes to street signs to restaurant menus, the machine-learning system is already extracting text from more than 1 billion public Facebook and Instagram images and video frames, daily and in real-time.


The system that approaches the text analysis which is as so-called sequence prediction problem. It analyzes images and uses historical data, rather than just the visual profile of the individual characters, to understand the writing. In other words, Facebook developed an AI that can tell if a meme is offensive. So while Rosetta isn't committed to images, their pervasiveness on Facebook and Instagram will without a doubt make them a noteworthy utilize case, particularly in Facebook's discovery of hostile material. It then uses a convolutional neural network to recognize and transcribe what's written in that region, even non-English words or non-Latin alphabets, such as Arabic and Hindi.

While Rosetta has been created to scan and read images and video frame, a particularly interesting use case of the technology is in scanning the memes, which appear frequently on the company's two platforms. The company plans to extend it to yet more areas over time.

In the future, Facebook says it could apply the same technology toward understanding text that appears in video as well, though that requires a more complex system.

Related News:

  • Aussie schoolgirl protests against national anthem, Latest World News

    Aussie schoolgirl protests against national anthem, Latest World News

    Her parents insisted they had no influence over their daughter's actions, however a number of politicians weren't convinced. Pauline Hanson posted a video in which she criticized Harper.
    Three New Species Discovered in the Depths of the Pacific

    Three New Species Discovered in the Depths of the Pacific

    Without the pressure of the water and the chill of the deep ocean, they appear to melt on reaching the surface. The trench is almost 6000km long and more than 8km deep, running along the west coast of South America.
    Meet the new iPhones

    Meet the new iPhones

    Others found the company's lack of creativity to be a bigger issue, with many simply calling the new names "dumb" and 'lazy'. Like the iPhone X , the XS has a 5.8-inch OLED screen, while the XS Max boasts a mammoth 6.5-inch OLED display.
  • Student killed in twin bomb attack near Afghanistan girls' school

    Student killed in twin bomb attack near Afghanistan girls' school

    The Taliban has denied any involvement and so far, no group has claimed responsibility for the attack. He said the locals had gathered for a demonstration when the lone attacker detonated his explosives.
    Hurricane Florence bears down on Carolinas

    Hurricane Florence bears down on Carolinas

    National Guard soldiers from the state, North Carolina and Virginia are mobilizing to prepare for hurricane recovery efforts. As serene as the images are, it's hard to imagine what conditions are like in the storm and on the water under it.
    CDC Issues Guidance to Travelers as Influenza Season Nears

    CDC Issues Guidance to Travelers as Influenza Season Nears

    Sometimes you might not get the flu because everyone around you has the flu shot, and so you haven't been exposed to it. Scientists conduct studies each year to determine how well the influenza ( flu ) vaccine protects against flu illness.
  • The Nintendo Switch just became a Final Fantasy machine

    The Nintendo Switch just became a Final Fantasy machine

    And so is World of Final Fantasy , as a new version called World of Final Fantasy Maxima (also coming to PC, PS4 and Xbox One). Final Fantasy 15: Pocket Edition is kicking off this string of Final Fantasy releases for the Switch, and it is available now.
    The New $1,449 iPhone Won't Include A Free Headphone Dongle

    The New $1,449 iPhone Won't Include A Free Headphone Dongle

    This has led to the iPhone XR being variously described as " cheap ", " entry-level ", or the " budget " iPhone for this year. But beware that if you're planning to buy an iPhone 8, it won't come with a dongle, either.

    Hurricane Florence closes in on USA east coast

    Utility officials have warned that widespread power outages are likely and that it could take weeks to restore electricity. More than 1.5 million people have been ordered to evacuate along 300 miles of coastline.
  • IPhone XS, XS Max: First Impression

    IPhone XS, XS Max: First Impression

    The base level iPhone is now the iPhone 7 with a 4.7-inch display, A10 Fusion chip, water proofing and stereo speaker setup. The XR has a 6.1-inch screen, which lands it right between the XS and XS Max in terms of size.
    Missy Elliott performs with her

    Missy Elliott performs with her "funky white sister" on "Ellen"

    Later, Halsey got a gift from the Ellen show: a rhinestone-encrusted jacket that read "Missy's funky white sister" on the back. Halsey, clearly stunned, quickly shakes off the surprise, throws her arm around Elliott and keeps on working it.
    Federation Internationale de Football Association  19: Messi, Ronaldo share rating, Salah 27th best player

    Federation Internationale de Football Association 19: Messi, Ronaldo share rating, Salah 27th best player

    Carlos Tevez has revealed just how hard Cristiano Ronaldo worked at Manchester United to become the best player in the World. FIFA's rankings might have something to do with Ronaldo being their cover star, though.


Most liked

Hurricane Florence weakens slightly as it moves toward US coast: NHC
Elder relatives carry as much weight as meteorologists in a tight-knit community of slave descendants on the SC coast. Matthews Motors is using its cars to hopefully shield the business from Hurricane Florence's devastation.

Assassin's Creed III & Liberation Remastered Coming In The AC Odyssey Season Pass
We were pretty impressed by what we discovered, so here are 7 Things you can do when you start Assassin's Creed Odyssey . Ubisoft will bring an episodic format to the future content of Assassin's Creed: Odyssey shortly after its release.

Marshall vs. SC game cancelled due to Hurricane Florence
Wilmington, North Carolina , just north of where Florence appeared headed for shore, grew empty and quiet on Wednesday. The hurricane center said Florence will approach the coast Friday and linger for a while before rolling ashore.

The Coolest Features in the iPhone Xs, Xs Max, and XR
There's no home button on any of them - love it or hate it, Apple is putting the fingerprint reader permanently out to pasture . Apple confirmed that all band colours and styles will fit all generations, so existing straps can be fitted to the Watch 4.

Donald Trump: China 'Under Pressure' to Make a Deal with United States
Beebe said that could be the consequences of price increases or the psychology around how people make purchasing decisions. The Trump administration is poised to hit China, America's largest trading partner, with another $200 billion in tariffs.

Spurs duo Lloris, Alli to miss Liverpool, Inter clashes
Lloris, who was sentenced for a drink-driving charge on Wednesday, could be out of action for several weeks with a thigh injury. He made a mistake and he's suffering all the punishment of society.

United Nations chief calls for prevention of full-scale attack on Syria's Idlib - USA
Last month, 14 moderate opposition factions unified under a single umbrella group dubbed the National Liberation Front (NLF). The United States will use the "false flag" poisoning as a casus belli for retaliation, the Russian Defense Ministry said.

Two Sets of Remains from North Korea ID'd as US Soldiers
The Pentagon said USA and North Korean military officials held negotiations last week on surrendering more remains. Almost 7,700 USA service members were listed as missing and unaccounted for from the 1950-53 Korean War.

Pochettino confirms Lloris will remain Spurs captain after drink-drive sentence
The staff, the club, the fans, us, and he said "Any decision that you take gaffer, or the club, I think is fair". All that happened (in court) is not good and he does not feel great.

Kavanaugh Nomination Reviewed by Committee
Today's times are different, they are undoubtedly decisive, and the gap of division competes in size with the Grand Canyon. Some Democratic senators weren't reassured, pointing to mass school shootings committed with semi-automatic rifles.

Keegan Bradley captures BMW Championship, more with playoff victory
Only the top 30 advance to the Tour Championship, marking the first time Spieth has missed the event since turning pro. Schauffele was considered a top contender to be US Ryder Cup leader Jim Furyk's captain's choice final pick.

Google has some serious plans in store for its Pixel 3 launch
As well as making a previously back-breaking 5.3g cable a feather-light 4.9g, Google has managed to improve its performance too. I'd hate to imagine the markup on these things, but you can grab the updated version from Google's store directly below.

Tonight’s Nintendo Direct has been postponed following devastating natural disaster
According to official reports from CNN , there are at least seven dead from the disaster, and 32 people now missing because of it. Nintendo was scheduled to host a Nintendo Direct today, but the broadcast had to be delayed because of an natural disaster .

Rat Wipes $190M Off Restaurant Chain's Value
Hotpots are prepared with a simmering pot of soup stock at the dining table and contain a variety of east Asian foodstuffs. Ms Gao said the chain had always taken great care over the quality and safety of its food.

Oil slips as economic concerns counter tighter supply
US crude inventories fell by 5.3 million barrels in the last week, the US Energy Information Administration said on Wednesday. Benchmark Brent crude futures rose 47 cents to $79.53 a barrel, by 1649 (GMT).