I dette afsnit fortæller jeg om, hvordan AI-modeller som f.eks. ChatGPT kan bryde sammen og holde op med at virke, hvis de trænes på deres eget eller andre store sprogmodellers output.
Ilia Shumailov og hans kollegers artikel “The Curse of Recursion” kan findes her:
https://arxiv.org/pdf/2305.17493
Hector Zenils “On The Limits of Self-Improving in Large Language Models” er her:
https://arxiv.org/pdf/2601.05280
Jeg har i dette afsnit søgt inspiration og lånt eksempler fra George Montañez’ foredrag “Model Collapse ends AI Hype”, som kan findes her:
https://www.youtube.com/watch?v=ShusuVq32hc
Her omtales Shumailov et als resultater, men ikke Zenils, som først er kommet senere.
De tre eksempler, som jeg ikke læste op i deres helhed, er:
Den tekst, der skal genereres en fortsættelse af:
[…] some started before 1360 — was typically accomplished by a master
mason and a small team of itinerant masons, supplemented by local
parish labourers, according to Poyntz Wright. But other authors reject
this model, suggesting instead that leading architects designed the
parish church towers based on early examples of Perpendicular […]
0. generation, kun trænet på originale data
Revival architecture such as St. John’s Cathedral in London. The
earliest surviving example of Perpendicular Revival architecture is
found in the 18th-century Church of Our Lady of Guernsey, which
dates from the late 19th century. There are two types of perpendicular
Originale data + 1. generation forurenede data:
architecture such as St. Peter’s Basilica in Rome or St. Peter’s
Basilica in Buenos Aires. There is no evidence that any of these
buildings were built during the reign of Pope Innocent III, but it is
possible that they may have been built during the reign of his
successor, Pope Innocent […]
Originale data + 9. generation forurenede data:
architecture. In addition to being home to some of the world’s largest
populations of black-tailed jackrabbits, white-tailed jackrabbits,
blue-tailed jackrabbits, red-tailed jackrabbits, yellow- […]
Hvis du ønsker at støtte mit arbejde, så køb bogen “Ada & Zangemann”, der fortæller om fordelene ved fri og open source software og digital suverænitet. Den kan fås hos boghandleren, f.eks. her:
https://www.bog-ide.dk/produkt/5528958/matthias-kirschner-og-sandra-brandstatter-ada-zangemann
Hvis du allerede har købt bogen eller ikke har råd, så del denne podcast. På forhånd tak :-)