FEVER - Framework for EValuating Entity Resolution
FEVER is a new evaluation platform for entity resolution approaches. The modular structure of the FEVER framework supports the incorporation or reconstruction of many previously proposed approaches for entity resolution. A distinctive feature of FEVER is that it not only evaluates traditional measures such as precision and recall but also the effort for configuring (e.g., parameter tuning, training) a good entity resolution approach.
The above figure illustrates the architecture of FEVER consisting of modules for the definition and execution of entity resolution approaches or so-called match workflows. A GUI-based workflow editor allows to interactively specify match workflows utilizing operator trees. The FEVER runtime executes a specified workflow and, thus, generates evaluation data.
Comparative evaluation of entity resolution approaches with FEVER
Analysis of entity resolution publications
For our comparative evaluation of entity resolution approaches in  we have analyzed numerous research publications w.r.t. their evaluation of entity resolution approaches. The complete list can be found here.
The datasets used in the evaluation can be downloaded here