FEVER - Framework for EValuating Entity Resolution
FEVER is a new evaluation platform for entity resolution
approaches. The modular structure of the FEVER framework
supports the incorporation or reconstruction of many previously
proposed approaches for entity resolution. A distinctive feature of
FEVER is that it not only evaluates traditional measures such as
precision and recall but also the effort for configuring (e.g., parameter
tuning, training) a good entity resolution approach.
The above figure illustrates the architecture of FEVER consisting of modules
for the definition and execution of entity resolution approaches
or so-called match workflows. A GUI-based workflow
editor allows to interactively specify match workflows utilizing
operator trees. The FEVER runtime executes a specified workflow
and, thus, generates evaluation data.
Comparative evaluation of entity resolution approaches with FEVER
Analysis of entity resolution publications
For our comparative evaluation of entity resolution approaches
in  we have analyzed numerous research publications w.r.t. their
evaluation of entity resolution approaches. The complete list can be found here.
The datasets used in the evaluation can be downloaded here