Skip to main content

User account menu

  • Log in
DBS-Logo

Database Group Leipzig

within the department of computer science

ScaDS-Logo Logo of the University of Leipzig

Main navigation

  • Home
  • Study
    • Exams
      • Hinweise zu Klausuren
    • Courses
      • Current
    • Modules
    • LOTS-Training
    • Abschlussarbeiten
    • Masterstudiengang Data Science
    • Oberseminare
    • Problemseminare
    • Top-Studierende
  • Research
    • Projects
      • Benchmark datasets for entity resolution
      • FAMER
      • HyGraph
      • Privacy-Preserving Record Linkage
      • GRADOOP
    • Publications
    • Prototypes
    • Annual reports
    • Cooperations
    • Graduations
    • Colloquia
    • Conferences
  • Team
    • Erhard Rahm
    • Member
    • Former employees
    • Associated members
    • Gallery

Block-based Load Balancing for Entity Resolution with MapReduce

Breadcrumb

  • Home
  • Research
  • Publications
  • Block-based Load Balancing for Entity Resolution with MapReduce

Kolb, L. ; Thor, A. ; Rahm, E.

Block-based Load Balancing for Entity Resolution with MapReduce

Proc. 20th Intl. Conference on Information and Knowledge Management (CIKM), 2011

2011 / 10

Andere

Abstract

<p style="text-align:justify;">
The effctiveness and scalability of MapReduce-based implementations of complex data-intensive tasks depend on an even redistribution of data between map and reduce tasks. In the presence of skewed data, sophisticated redistribution approaches thus become necessary to achieve load balancing among all reduce tasks to be executed in parallel. For the complex problem of entity resolution with blocking, we propose BlockSplit, a load balancing approach that supports blocking techniques to reduce the search space of entity resolution. The evaluation on a real cloud infrastructure shows the value and effctiveness of the proposed approach.
</p>

<a href="/file/CIKM_LB_poster.pdf" style="float:left; margin-left:20px;">
<img title="Poster@CIKM 2011" src="file/CIKM_LB_poster.png" width="200" height="289" alt="Poster" style="border:1px solid grey;"/>
</a>
<br style="clear:left;"/>

<h2>Keywords</h2>
<ul>
<li>MapReduce, Hadoop</li>
<li>Entity Resolution, Object matching, Similarity Join, Pair-wise comparison</li>
<li>Clustering, Blocking</li>
<li>Data Skew, Load Balancing</li>
</ul>

<h2 id="bibtex_heading">BibTex</h2>
<pre id="bibtex_listing">
@inproceedings{DBLP:conf/cikm/KolbTR11,
author = {Lars Kolb and
Andreas Thor and
Erhard Rahm},
title = {{Block-based Load Balancing for Entity Resolution with MapReduce}},
booktitle = {CIKM},
year = {2011},
pages = {2397-2400},
ee = {http://doi.acm.org/10.1145/2063576.2063976},
crossref = {DBLP:conf/cikm/2011},
bibsource = {DBLP, http://dblp.uni-trier.de}
}
</pre>

Recent publications

  • 2025 / 9: Generating Semantically Enriched Mobility Data from Travel Diaries
  • 2025 / 8: Slice it up: Unmasking User Identities in Smartwatch Health Data
  • 2025 / 7: MPGT: Multimodal Physics-Constrained Graph Transformer Learning for Hybrid Digital Twins
  • 2025 / 6: Leveraging foundation models and goal-dependent annotations for automated cell confluence assessment
  • 2025 / 6: SecUREmatch: Integrating Clerical Review in Privacy-Preserving Record Linkage

Footer menu

  • Directions
  • Contact
  • Impressum