Skip to main content

User account menu

  • Log in
DBS-Logo

Database Group Leipzig

within the department of computer science

ScaDS-Logo Logo of the University of Leipzig

Main navigation

  • Home
  • Study
    • Exams
      • Hinweise zu Klausuren
    • Courses
      • Current
    • Modules
    • LOTS-Training
    • Abschlussarbeiten
    • Masterstudiengang Data Science
    • Oberseminare
    • Problemseminare
    • Top-Studierende
  • Research
    • Projects
      • Benchmark datasets for entity resolution
      • FAMER
      • HyGraph
      • Privacy-Preserving Record Linkage
      • GRADOOP
    • Publications
    • Prototypes
    • Annual reports
    • Cooperations
    • Graduations
    • Colloquia
    • Conferences
  • Team
    • Erhard Rahm
    • Member
    • Former employees
    • Associated members
    • Gallery

Parallel Sorted Neighborhood Blocking with MapReduce

Breadcrumb

  • Home
  • Research
  • Publications
  • Parallel Sorted Neighborhood Blocking with MapReduce

Kolb, L. ; Thor, A. ; Rahm, E.

Parallel Sorted Neighborhood Blocking with MapReduce

Proc. 14th GI-Fachtagung für Datenbanksysteme in Business, Technologie und Web (BTW), 2011

2011 / 03

Paper

Abstract

Cloud infrastructures enable the efficient parallel execution of data-intensive tasks such as entity resolution on large datasets. We investigate challenges and possible solutions of using the MapReduce programming model for parallel entity resolution. In particular, we propose and evaluate two MapReduce-based implementations for Sorted Neighborhood blocking that either use multiple MapReduce jobs or apply a tailored data replication.

<a href="file/Kolb_BTW_2011.pptx" style="float:left; margin-left:20px;">
<img title="Presentation@BTW 2011" src="file/Kolb_BTW_2011.png" width="180" height="135" alt="Presentation" style="border:1px solid grey;"/>
</a>
<br style="clear:left;"/>

<h2>Keywords</h2>
<ul>
<li>MapReduce, Hadoop</li>
<li>Entity Resolution, Object matching, Similarity Join, Pair-wise comparison</li>
<li>Blocking, Sliding Window, Sorted Neighborhood</li>
</ul>

<h2 id="bibtex_heading">BibTex</h2>
<pre id="bibtex_listing">
@inproceedings{DBLP:conf/btw/KolbTR09,
author = {Lars Kolb and
Andreas Thor and
Erhard Rahm},
title = {{Parallel Sorted Neighborhood Blocking with MapReduce}},
booktitle = {BTW},
year = {2011},
pages = {45-64},
crossref = {DBLP:conf/btw/2011},
bibsource = {DBLP, http://dblp.uni-trier.de}
}
</pre>

Recent publications

  • 2025 / 9: Generating Semantically Enriched Mobility Data from Travel Diaries
  • 2025 / 8: Slice it up: Unmasking User Identities in Smartwatch Health Data
  • 2025 / 7: MPGT: Multimodal Physics-Constrained Graph Transformer Learning for Hybrid Digital Twins
  • 2025 / 6: Leveraging foundation models and goal-dependent annotations for automated cell confluence assessment
  • 2025 / 6: SecUREmatch: Integrating Clerical Review in Privacy-Preserving Record Linkage

Footer menu

  • Directions
  • Contact
  • Impressum