- Fans hail Trump's 'guts' as he returns to site of rally shooting
- Lebanon state media says 'very violent' Israeli strikes hit south Beirut
- Guardians maul Tigers, miracle Mets rally in MLB series openers
- Lebanon state media says Israeli strikes hit south Beirut
- Miami on track for MLS record points after win in Toronto
- Madrid beat Villarreal but Carvajal suffers knee injury
- Madrid beat Villarreal to move level with Liga leaders Barcelona
- Monaco take top spot in Ligue 1 with win at Rennes
- French rugby player on rape charge whistled but 'serene' on return
- Madrid beat Villarreal to level Liga leaders Barca
- Thuram treble fires Inter past Torino and up to second
- 'Fight': defiant Trump jets in to site of rally shooting
- Toddler among 3 dead in migrant Channel crossings
- Mexico City's new mayor sworn in with pledges on water, housing
- Israel on alert ahead of Hamas attack anniversary
- Guardians maul Tigers in MLB playoff series opener
- Macron criticises Israel on Gaza, Lebanon operations
- French rugby player whistled but 'serene' on return amid ongoing rape case
- Kovacic stars as Man City sink Fulham to get title bid back on track
- Retegui hat-trick fires five-star Atalanta to hammering of Genoa
- Heavyweights Australia, England off to World Cup winning starts
- Visiting UN refugee agency chief decries 'terrible crisis' in Lebanon
- Spinners come to party as England defeat Bangladesh at T20 World Cup
- Search continues for missing in deadly Bosnia floods
- Man City sink Fulham to get title bid back on track
- France's Auradou whistled on Pau return in Perpignan loss amid ongoing rape case
- A 'forgotten' valley in storm-hit North Carolina, desperate for help
- Arsenal hit back in style after Southampton scare
- Thousands march for Palestinians ahead of Oct 7 anniversary
- Hezbollah heir apparent Safieddine out of contact after strikes
- Liverpool stay top of Premier League as Arsenal, Man City win
- In dank Tour of Emilia, Pogacar shines in rainbow jersey
- DR Congo launches mpox vaccination drive, hoping to curb outbreak
- Trump returns to site of failed assassination
- Careless Leverkusen held to Bundesliga draw
- O'Brien's 'superstar' Kyprios posts landmark win on Arc weekend
- Toddler crushed to death in migrant Channel crossing
- Liverpool suffer Alisson injury blow
- Habosi helps Racing beat Vannes before Auradou's playing return
- Thousands march in London in support of Palestinians, 1 year after Oct 7
- Israel readying response to Iran missile attack
- Schutt, Mooney help Australia beat Sri Lanka in Women's T20 World Cup
- Liverpool extend Premier League lead with win at Palace
- Djokovic 'shakes rust off' to make third round of Shanghai Masters
- 'Imperfect' PSG fighting on all fronts - Luis Enrique
- Struggling Pakistan look to thwart adaptable England
- Child 'trampled to death' in asylum seekers' Channel crossing: minister
- Gauff fights back to set up Beijing final against Muchova
- Guardiola claims Premier League won't delay season for Man City
- Israel to mark October 7 attack as Gaza war spreads
Inbred, gibberish or just MAD? Warnings rise about AI models
When academic Jathan Sadowski reached for an analogy last year to describe how AI programs decay, he landed on the term "Habsburg AI".
The Habsburgs were one of Europe's most powerful royal houses, but entire sections of their family line collapsed after centuries of inbreeding.
Recent studies have shown how AI programs underpinning products like ChatGPT go through a similar collapse when they are repeatedly fed their own data.
"I think the term Habsburg AI has aged very well," Sadowski told AFP, saying his coinage had "only become more relevant for how we think about AI systems".
The ultimate concern is that AI-generated content could take over the web, which could in turn render chatbots and image generators useless and throw a trillion-dollar industry into a tailspin.
But other experts argue that the problem is overstated, or can be fixed.
And many companies are enthusiastic about using what they call synthetic data to train AI programs. This artificially generated data is used to augment or replace real-world data. It is cheaper than human-created content but more predictable.
"The open question for researchers and companies building AI systems is: how much synthetic data is too much," said Sadowski, lecturer in emerging technologies at Australia's Monash University.
- 'Mad cow disease' -
Training AI programs, known in the industry as large language models (LLMs), involves scraping vast quantities of text or images from the internet.
This information is broken into trillions of tiny machine-readable chunks, known as tokens.
When asked a question, a program like ChatGPT selects and assembles tokens in a way that its training data tells it is the most likely sequence to fit with the query.
But even the best AI tools generate falsehoods and nonsense, and critics have long expressed concern about what would happen if a model was fed on its own outputs.
In late July, a paper in the journal Nature titled "AI models collapse when trained on recursively generated data" proved a lightning rod for discussion.
The authors described how models quickly discarded rarer elements in their original dataset and, as Nature reported, outputs degenerated into "gibberish".
A week later, researchers from Rice and Stanford universities published a paper titled "Self-consuming generative models go MAD" that reached a similar conclusion.
They tested image-generating AI programs and showed that outputs become more generic and strafed with undesirable elements as they added AI-generated data to the underlying model.
They labelled model collapse "Model Autophagy Disorder" (MAD) and compared it to mad cow disease, a fatal illness caused by feeding the remnants of dead cows to other cows.
- 'Doomsday scenario' -
These researchers worry that AI-generated text, images and video are clearing the web of usable human-made data.
"One doomsday scenario is that if left uncontrolled for many generations, MAD could poison the data quality and diversity of the entire internet," one of the Rice University authors, Richard Baraniuk, said in a statement.
However, industry figures are unfazed.
Anthropic and Hugging Face, two leaders in the field who pride themselves on taking an ethical approach to the technology, both told AFP they used AI-generated data to fine-tune or filter their datasets.
Anton Lozhkov, machine learning engineer at Hugging Face, said the Nature paper gave an interesting theoretical perspective but its disaster scenario was not realistic.
"Training on multiple rounds of synthetic data is simply not done in reality," he said.
However, he said researchers were just as frustrated as everyone else with the state of the internet.
"A large part of the internet is trash," he said, adding that Hugging Face already made huge efforts to clean data -- sometimes jettisoning as much as 90 percent.
He hoped that web users would help clear up the internet by simply not engaging with generated content.
"I strongly believe that humans will see the effects and catch generated data way before models will," he said.
J.Williams--AMWN