Evaluating Faroese: Towards Developing a Benchmarking Evaluation Framework

The project investigates the assessment of Faroese language technology and develop an evaluation framework with specific tasks in Natural Language Understanding and Natural Language Generation, with a focus on cultural and linguistic specificity. This evaluation framework will serve as a benchmark for Faroese language technology and will enable evaluation of tools and language models.
Evaluation results are valuable and provide a basis for comparison. A consistent baseline for comparison fosters quality development and ensures transparency.
In the development process, various approaches will be explored that are particularly well suited for small languages.