Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Setswana-English #192

Merged
merged 1 commit into from
Jan 25, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
46 changes: 46 additions & 0 deletions benchmarks/tn-en/jw300-baseline/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
# Setswana to English

Author: Rambevha Vhukhudo

## Data

- The JW300 Setswana - English.

## Model

- Default Masakhane Transformer translation model.
- Link to google drive folder with model(https://drive.google.com/drive/folders/1-iQ2fRiX5UbrzgvLuQxh0vVBkC-sHvCq?usp=sharing)

## Analysis

Example 1
```sh
Source: Mme fa re tlhaloganya se metsi a a tshelang a tla re direlang sone , ga re kitla re bona fela botlhokwa jwa go a nwa mme gape re tla batla go a nwa .
Reference: And when we understand what the living waters can mean for us , not only will we see the need to partake of them but we will also want to drink them .
Hypothesis: But if we understand what the water will do , we will not see only the importance of drinking and again will want to drink .
```

Example 2
```sh
Source: Ke Boela Lovech
Reference: Coming Back to Lovech
Hypothesis: I Way Lovech
```

Example 3
```sh
Source: Mo lekgetlhong lengwe , ditsala dingwe tse di rategang tsa ga moaposetoloi Paulo di ile tsa tsamaya sekgala sa dikilometara tse di ka nnang 50 go tswa kwa Efeso go ya kwa Mileto go ya go kopana le ene .
Reference: On one occasion , dear friends of the apostle Paul traveled about 30 miles [ 50 km ] from Ephesus to Miletus to meet him .
Hypothesis: On one occasion , some dear friends of the apostle Paul have walked about 50 miles [ 50 km ] from Ephesus to Mileto meet him .
```

Example 4
```sh
Source: “ Go ne ga isiwa manoko a kola , ga tlhajwa phelehu , ya apewa mme ya jewa ke botlhe ba ba neng ba le teng .
Reference: “ Kola nuts were offered , and a ram was slaughtered , boiled , and eaten by all those present .
Hypothesis: “ It was made up , the smoking of the smoke , and the smoke of all those who were there .
```

# Results
- BLEU dev : 28.55
- BLEU test : 34.80
Loading