<center>
<a href="https://duarteocarmo.com/images/103/semester_educational_score_summary.webp" target="_blank">
<img alt="Semester educational score summary for Bagaço v2" src="https://duarteocarmo.com/images/103/semester_educational_score_summary.webp" style="border-radius: 2px;" />
</a>
<figcaption>
Educational score over time vs. document count for Bagaco v2
</figcaption>
</center>
A couple of months ago I released <a href="https://duarteocarmo.com/blog/bagaco-a-pretraining-dataset-for-european-portuguese.html">Bagaço</a> - a pretraining dataset for European Portuguese. The idea was simple: take the <a href="https://huggingface.co/datasets/HuggingFaceFW/fineweb-2">FineWeb 2</a> dataset, limit it to web pages that look like they came from Portugal, and classify them into categories …

Educational score over time vs. document count for Bagaco v2 A couple of months ago I released Bagaço - a pretraining dataset for European Portuguese. The idea was simple: take the FineWeb 2 dataset, limit it to web pages that look like they came from Portugal, and classify them into categories …

<a href="https://duarteocarmo.com/images/103/semester_educational_score_summary.webp" rel="noopener noreferrer">

</a>

Educational score over time vs. document count for Bagaco v2


A couple of months ago I released <a href="https://duarteocarmo.com/blog/bagaco-a-pretraining-dataset-for-european-portuguese.html" rel="noopener noreferrer">Bagaço</a> - a pretraining dataset for European Portuguese. The idea was simple: take the <a href="https://huggingface.co/datasets/HuggingFaceFW/fineweb-2" rel="noopener noreferrer">FineWeb 2</a> dataset, limit it to web pages that look like they came from Portugal, and classify them into categories …

#66 The largest open pretraining dataset for European Portuguese

A podcast version of my personal website. All the episodes are generated from a text to speech model.

Share #66 The largest open pretraining dataset for European Portuguese

Sign up to save your podcasts

#66 The largest open pretraining dataset for European Portuguese

#66 The largest open pretraining dataset for European Portuguese