Google’s Training Its AI Overviews On TikTok. It’s Going As Well As You Would Expect

Views: 1379

A satirical video from American gymnast Ian Gunther about “John Backflip” unintentionally exposed some of the design flaws in Google’s AI-generated search summaries.

Anadolu Agency via Getty Images

Six months after Google’s Gemini AI model suggested people use glue as an ingredient in pizza, the feature is still struggling to separate fact from fiction.

Search for “who invented the backflip,” and up until a few weeks ago, Gemini would tell you all about John Backflip, who apparently first mastered the move in Medieval Europe in 1316. And if you search “who is John Backflip,” Google’s AI credits him with inventing the gymnastic skill. But the source for this information is a TikTok video from American gymnast Ian Gunther, who made up the story entirely.

“I like making satirical videos on gymnastics and you can get away with goofing and making some jokes about the sport,” he told Forbes.

Google’s Gemini AI produces an “overview” that’s been embedded at the top of search results for six months, and it’s gotten off to a rocky start. The AI Overview’s claim that eating rocks had nutritional benefits and Barack Obama was the United States’ first Muslim President not only made the company the butt of online jokes but became a watchword for the limitations of large language models.

Gunther, who was formerly on Team USA and won the NCAA championship in 2023, cooked up the back story for John Backflip after a training session at his Bay Area gym back in May 2023. “Most skills in gymnastics are named after the first person to compete it internationally,” said Gunther. “I went home and made a goofy backstory for someone inventing the backflip.”

If anyone missed the joke , Gunter also goes on to cite ‘Henry MuscleUp’, ‘Richard Presshandstand’ and ‘Alfonso El Grip’ as other early gymnastics pioneers. The video was a modest hit on Gunther’s YouTube and TikTok, where he posts clips from training sessions and competitions, but he had mostly forgotten about the clip until he got a text in July. “It was a screenshot of the AI and I was like, ‘oh no, what have I done?’ Am I the spreader of disinformation?”

Screenshots of the AI summary about John Backflip were shared on Reddit and other social networks … Read More