Facebook’s Rosetta AI detects offensive memes

5 Must Have Biking Gears For An Urban Rider

[Image: courtesy of Facebook] Now, though, Facebook says it has a new arrow in its quiver-a tool known as Rosetta that uses machine learning to better understand text embedded in imagery or videos. We are therefore exploring ways to bridge the domain gap between our synthetic engine and real-world distribution of text on images. And now, the company is deploying an artificial intelligence (AI) based tool to take on the issue heads on.

Named Rosetta, the system is already live and is extracting text from nearly one billion images and video frames posted on Facebook and Instagram daily, according to the social media giant.

The procedure basically comes down to two stages: Rosetta checks pictures for content, and afterward utilizes content acknowledgment to distinguish what the content really says. It can add the search results, and it can also scan for the harmful content.

From memes to street signs to restaurant menus, the machine-learning system is already extracting text from more than 1 billion public Facebook and Instagram images and video frames, daily and in real-time.


The system that approaches the text analysis which is as so-called sequence prediction problem. It analyzes images and uses historical data, rather than just the visual profile of the individual characters, to understand the writing. In other words, Facebook developed an AI that can tell if a meme is offensive. So while Rosetta isn't committed to images, their pervasiveness on Facebook and Instagram will without a doubt make them a noteworthy utilize case, particularly in Facebook's discovery of hostile material. It then uses a convolutional neural network to recognize and transcribe what's written in that region, even non-English words or non-Latin alphabets, such as Arabic and Hindi.

While Rosetta has been created to scan and read images and video frame, a particularly interesting use case of the technology is in scanning the memes, which appear frequently on the company's two platforms. The company plans to extend it to yet more areas over time.

In the future, Facebook says it could apply the same technology toward understanding text that appears in video as well, though that requires a more complex system.

Related News:

  • The Coolest Features in the iPhone Xs, Xs Max, and XR

    The Coolest Features in the iPhone Xs, Xs Max, and XR

    There's no home button on any of them - love it or hate it, Apple is putting the fingerprint reader permanently out to pasture . Apple confirmed that all band colours and styles will fit all generations, so existing straps can be fitted to the Watch 4.

    Pochettino confirms Lloris will remain Spurs captain after drink-drive sentence

    The staff, the club, the fans, us, and he said "Any decision that you take gaffer, or the club, I think is fair". All that happened (in court) is not good and he does not feel great.

    Bracing for Hurricane Florence | Don't Miss This

    The port in Charleston, South Carolina , though, was suspending operations from Thursday through Saturday and possibly on Sunday . Hiring is likely to be especially strong in construction and at retailers that sell building materials and supplies.
  • Hurricane Florence weakens slightly as it moves toward US  coast: NHC

    Hurricane Florence weakens slightly as it moves toward US coast: NHC

    Elder relatives carry as much weight as meteorologists in a tight-knit community of slave descendants on the SC coast. Matthews Motors is using its cars to hopefully shield the business from Hurricane Florence's devastation.
    Meet the new iPhones

    Meet the new iPhones

    Others found the company's lack of creativity to be a bigger issue, with many simply calling the new names "dumb" and 'lazy'. Like the iPhone X , the XS has a 5.8-inch OLED screen, while the XS Max boasts a mammoth 6.5-inch OLED display.
    Hurricane Florence: 'Monster' storm on collision course with Carolinas

    Hurricane Florence: 'Monster' storm on collision course with Carolinas

    The Category 4 storm's approach led to a series of schedule adjustments Tuesday for teams in the Carolinas and Virginia. Hurricane watches and storm surge watches are expected to be issued Tuesday morning ahead of the arrival of Florence.
  • Nintendo Switch Online service launches September 18

    Nintendo Switch Online service launches September 18

    Nintendo has revealed new games and a new control method for the NES games on Nintendo Switch Online. What was the standout moment for you? Some of the games that will be available at launch include Dr.
    Federation Internationale de Football Association  19: Messi, Ronaldo share rating, Salah 27th best player

    Federation Internationale de Football Association 19: Messi, Ronaldo share rating, Salah 27th best player

    Carlos Tevez has revealed just how hard Cristiano Ronaldo worked at Manchester United to become the best player in the World. FIFA's rankings might have something to do with Ronaldo being their cover star, though.

    Hurricane Florence closes in on USA east coast

    Utility officials have warned that widespread power outages are likely and that it could take weeks to restore electricity. More than 1.5 million people have been ordered to evacuate along 300 miles of coastline.
  • Three New Species Discovered in the Depths of the Pacific

    Three New Species Discovered in the Depths of the Pacific

    Without the pressure of the water and the chill of the deep ocean, they appear to melt on reaching the surface. The trench is almost 6000km long and more than 8km deep, running along the west coast of South America.
    United Nations  chief calls for prevention of full-scale attack on Syria's Idlib - USA

    United Nations chief calls for prevention of full-scale attack on Syria's Idlib - USA

    Last month, 14 moderate opposition factions unified under a single umbrella group dubbed the National Liberation Front (NLF). The United States will use the "false flag" poisoning as a casus belli for retaliation, the Russian Defense Ministry said.
    Despite Opposition, Carney Extends Leadership of Bank of England to 2020

    Despite Opposition, Carney Extends Leadership of Bank of England to 2020

    Sir Jon Cunliffe, the deputy governor with responsibility for financial stability, has also been re-appointed, it added. Carney has already extended his term once at the Bank in a move to ensure continuity through the Brexit negotiations.


Most liked

Australian cartoonist criticized over 'racist' Serena Williams sketch
Cartoonist Mark Knight put together a cartoon depicting Serena Williams acting like a child at the U.S. It published the cartoon and headline, " Welcome to PC World ", on its front page for September 12.

Assassin's Creed III & Liberation Remastered Coming In The AC Odyssey Season Pass
We were pretty impressed by what we discovered, so here are 7 Things you can do when you start Assassin's Creed Odyssey . Ubisoft will bring an episodic format to the future content of Assassin's Creed: Odyssey shortly after its release.

Student killed in twin bomb attack near Afghanistan girls' school
The Taliban has denied any involvement and so far, no group has claimed responsibility for the attack. He said the locals had gathered for a demonstration when the lone attacker detonated his explosives.

Mets' David Wright To Play One More Game Before Retiring
He earned $20 million this season, a portion of which the Mets have recouped via insurance while he's been on the disabled list. Wright has salaries of $20 million this year, $15 million next season and $12 million in 2020, the final year of his deal.

Donald Trump: China 'Under Pressure' to Make a Deal with United States
Beebe said that could be the consequences of price increases or the psychology around how people make purchasing decisions. The Trump administration is poised to hit China, America's largest trading partner, with another $200 billion in tariffs.

IPhone XS, XS Max: First Impression
The base level iPhone is now the iPhone 7 with a 4.7-inch display, A10 Fusion chip, water proofing and stereo speaker setup. The XR has a 6.1-inch screen, which lands it right between the XS and XS Max in terms of size.

NHC downgrades Florence to still unsafe Category 3 hurricane
Alexander Gerst, a German astronaut who's now orbiting Earth from 250 miles up, has a warning for humans on the planet below him. As soon as Deal made the declaration, Coweta County Emergency Management Agency director Jay Jones said he sprang into action.

Cuomo holds 41-point lead over Nixon in NY
It was addressed to Jewish voters, and it called Nixon anti-Semitic and said she "won't stand strong for our Jewish communities". Cuomo controls the state Democratic Party and recently transferred $2.5 million to its account for election-related expenses.

Hurricane Florence starts its prolonged assault on the Carolinas
People look out over the surf before Hurricane Florence comes ashore on Carolina Beach, North Carolina, Sept. 13, 2018. Storm surge is why many of you have been placed under evacuation and we are asking citizens to please heed a warning .

Apple's $29 iPhone battery replacements will cost $69 after December
At a packed event yesterday Apple introduced three new iPhones and a re-designed Watch Series 4 so there's plenty to digest. The two phones are nearly identical in design and features, with the XS being a refinement of last year's phone.

Kavanaugh Nomination Reviewed by Committee
Today's times are different, they are undoubtedly decisive, and the gap of division competes in size with the Grand Canyon. Some Democratic senators weren't reassured, pointing to mass school shootings committed with semi-automatic rifles.

The New $1,449 iPhone Won't Include A Free Headphone Dongle
This has led to the iPhone XR being variously described as " cheap ", " entry-level ", or the " budget " iPhone for this year. But beware that if you're planning to buy an iPhone 8, it won't come with a dongle, either.

Missy Elliott performs with her "funky white sister" on "Ellen"
Later, Halsey got a gift from the Ellen show: a rhinestone-encrusted jacket that read "Missy's funky white sister" on the back. Halsey, clearly stunned, quickly shakes off the surprise, throws her arm around Elliott and keeps on working it.

CDC Issues Guidance to Travelers as Influenza Season Nears
Sometimes you might not get the flu because everyone around you has the flu shot, and so you haven't been exposed to it. Scientists conduct studies each year to determine how well the influenza ( flu ) vaccine protects against flu illness.

Oil slips as economic concerns counter tighter supply
US crude inventories fell by 5.3 million barrels in the last week, the US Energy Information Administration said on Wednesday. Benchmark Brent crude futures rose 47 cents to $79.53 a barrel, by 1649 (GMT).