Let's say your goal is to train a Large Language Model only on European Portuguese. Where do you start? What datasets are out there? What websites are being scraped for the large black box? <a href="https://huggingface.co/datasets/duarteocarmo/fineweb2-bagaco">Bagaço</a> - named after the popular Portuguese moonshine - is a small step in that direction. 
<img alt="Domain scatter" src="https://duarteocarmo.com/images/96/domain_scatter.webp" />
In June …

Let's say your goal is to train a Large Language Model only on European Portuguese. Where do you start? What datasets are out there? What websites are being scraped for the large black box? Bagaço - named after the popular Portuguese moonshine - is a small step in that direction. In June …

Let's say your goal is to train a Large Language Model only on European Portuguese. Where do you start? What datasets are out there? What websites are being scraped for the large black box? <a href="https://huggingface.co/datasets/duarteocarmo/fineweb2-bagaco" rel="noopener noreferrer">Bagaço</a> - named after the popular Portuguese moonshine - is a small step in that direction. 

In June …

#59 Bagaço: A pretraining dataset for European Portuguese

A podcast version of my personal website. All the episodes are generated from a text to speech model.

Share #59 Bagaço: A pretraining dataset for European Portuguese

Sign up to save your podcasts

#59 Bagaço: A pretraining dataset for European Portuguese

#59 Bagaço: A pretraining dataset for European Portuguese