OpusCleaner is a web interface that helps you select, clean and schedule your data for training machine translation models.

HPLT Analytics

Information and pipelines on WP4: language models training

Step-by-step schematic description of data processing in HPLT

Set of scripts to run monotextor-like pipeline under slurm HPCs

Curriculum training

This contains the configuration and scripts for HPLT MT model releases.

Marian machine translation training pipeline for thousands of models

Scripts for parallelized extraction of plain texts from WARC archieves. Aiming at common and reproducible extraction approach.