FEMTI (Framework for Machine Translation Evaluation in ISLE) is a structured repertoire of methods used to evaluate MT systems.
The first part of FEMTI enables
evaluators to specify a context of use for the MT system to be evaluated, while
the second part defines
relevant quality characteristics and metrics.
FEMTI is a result of the ISLE Project, funded by the US National Science Foundation and the Swiss and Danish Governments.
FEMTI is available for consultation at the following mirrored URLs:
A series of workshops provided valuable input to the framework (see http://www.issco.unige.ch/projects/isle/ewg.html).
The framework is discussed in the following article:
Eduard Hovy, Margaret King and Andrei Popescu-Belis (2002):
93 Principles of Context-Based Machine Translation Evaluation 94, Machine Translation, 17:1, p. 43-75, 2002.
Users are welcome to browse the framework at the above URLs and to use the feedback buttons to provide comments.
The FEMTI co-ordinators:
Eduard Hovy
Margaret King
Andrei Popescu-Belis