Question Answering
Transformers
Safetensors
Amharic
extractive-qa
xlm-roberta
vexmlm
geez
low-resource
Instructions to use Hailay/VEXMLM-AmQA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Hailay/VEXMLM-AmQA with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "question-answering" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("question-answering", model="Hailay/VEXMLM-AmQA")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Hailay/VEXMLM-AmQA", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Align model card text with the corrected paper
Browse filesText only; no metric changed. New paper title and co-author name in the citation; QA scores described as development-split results; pretraining-data statement corrected; loss/perplexity pairing clarified.
README.md
CHANGED
|
@@ -38,7 +38,8 @@ Extractive QA: the answer is always a span copied from the supplied context.
|
|
| 38 |
|
| 39 |
Fine-tuned independently under seeds 42–46 with one configuration (hash
|
| 40 |
`ce27cc194946`) on an A100-PCIE-40GB. Reported as mean ± standard deviation over
|
| 41 |
-
the five runs, on the dataset's **
|
|
|
|
| 42 |
|
| 43 |
| Metric | Score |
|
| 44 |
|---|---|
|
|
@@ -50,7 +51,7 @@ described above — **not** from interactive use.
|
|
| 50 |
|
| 51 |
### Interactive inference vs. benchmark
|
| 52 |
|
| 53 |
-
**Benchmark evaluation** is the five-seed measurement on the held-out
|
| 54 |
shown in the table above.
|
| 55 |
|
| 56 |
**Interactive inference** is what the usage example below performs: Supply an Amharic context and question; the model returns an extracted span.
|
|
@@ -121,8 +122,9 @@ print(tokenizer.decode(enc.input_ids[0][start:end + 1], skip_special_tokens=True
|
|
| 121 |
languages, domains or label schemes is not characterised.
|
| 122 |
- The base model covers Amharic and Tigrinya; other Ge'ez-script languages were
|
| 123 |
not part of pretraining.
|
| 124 |
-
-
|
| 125 |
-
|
|
|
|
| 126 |
- Single-configuration study: no hyperparameter search was performed, and
|
| 127 |
baseline comparisons in the paper are single-seed.
|
| 128 |
|
|
@@ -140,9 +142,9 @@ python3 evaluation/export_spm_results.py # regenerates the metrics table
|
|
| 140 |
|
| 141 |
```bibtex
|
| 142 |
@inproceedings{teklehaymanot2026vexmlm,
|
| 143 |
-
title = {
|
| 144 |
-
A
|
| 145 |
-
author = {Teklehaymanot, Hailay Kidu and Yadeta,
|
| 146 |
Nejdl, Wolfgang},
|
| 147 |
booktitle = {Proceedings of the Workshop on Language Models for
|
| 148 |
Underserved Communities (LM4UC) at IJCAI},
|
|
|
|
| 38 |
|
| 39 |
Fine-tuned independently under seeds 42–46 with one configuration (hash
|
| 40 |
`ce27cc194946`) on an A100-PCIE-40GB. Reported as mean ± standard deviation over
|
| 41 |
+
the five runs, on the dataset's **development** split (the fine-tuning script
|
| 42 |
+
evaluates QA on the validation split when one exists).
|
| 43 |
|
| 44 |
| Metric | Score |
|
| 45 |
|---|---|
|
|
|
|
| 51 |
|
| 52 |
### Interactive inference vs. benchmark
|
| 53 |
|
| 54 |
+
**Benchmark evaluation** is the five-seed measurement on the held-out development split,
|
| 55 |
shown in the table above.
|
| 56 |
|
| 57 |
**Interactive inference** is what the usage example below performs: Supply an Amharic context and question; the model returns an extracted span.
|
|
|
|
| 122 |
languages, domains or label schemes is not characterised.
|
| 123 |
- The base model covers Amharic and Tigrinya; other Ge'ez-script languages were
|
| 124 |
not part of pretraining.
|
| 125 |
+
- The pretraining text is of undocumented origin (licence unknown); samples contain religious
|
| 126 |
+
translations alongside general web prose, and the model may reflect those distributions
|
| 127 |
+
and any biases present in them.
|
| 128 |
- Single-configuration study: no hyperparameter search was performed, and
|
| 129 |
baseline comparisons in the paper are single-seed.
|
| 130 |
|
|
|
|
| 142 |
|
| 143 |
```bibtex
|
| 144 |
@inproceedings{teklehaymanot2026vexmlm,
|
| 145 |
+
title = {Vocabulary Expansion for Low-Resource African Languages:
|
| 146 |
+
A Case Study in Amharic and Tigrinya},
|
| 147 |
+
author = {Teklehaymanot, Hailay Kidu and Yadeta, Debela Desalegn and
|
| 148 |
Nejdl, Wolfgang},
|
| 149 |
booktitle = {Proceedings of the Workshop on Language Models for
|
| 150 |
Underserved Communities (LM4UC) at IJCAI},
|