ACM DL

ACM Journal of

Data and Information Quality (JDIQ)

Menu
Latest Articles

An Introduction to Dynamic Data Quality Challenges

The Challenge of Test Data Quality in Data Processing

From Content to Context

Research in data and information quality has made significant strides over the last 20 years. It has become a unified body of knowledge incorporating techniques, methods, and applications from a variety of disciplines including information systems, computer science, operations management, organizational behavior, psychology, and statistics. With... (more)

A Probabilistically Integrated System for Crowd-Assisted Text Labeling and Extraction

The amount of text data has been growing exponentially in recent years, giving rise to automatic information extraction methods that store text... (more)

NEWS

Jan. 2016 -- New book announcement

 

Carlo Batini and Monica Scannapieco have a new book:

Data and Information Quality: Dimensions, Principles and Techniques 

Springer Series: Data-Centric Systems and Applications, soon available from the Springer shop

The Springer flyer is available here


Experience and Challenge papers:  JDIQ now accepts two new types of papers. Experience papers describe real-world applications, datasets and other experiences in handling poor quality data. Challenges papers briefly describe a novel problem or challenge for the IQ community. See Author Guidelines for details.

An Exploratory Case Study to Understand Primary Care Users and Their Data Quality Tradeoffs

Primary care data is an important piece of the evolving healthcare ecosystem. In addition to supporting the provision of patient care, primary care data can be used for a number of important secondary purposes. Understanding the tradeoffs between timeliness, accuracy, completeness and usefulness of primary care data is important to design systems that generate high quality data. As a case study, data quality measures and metrics are developed with a focus group of managers from a primary care organization. After calculating and extracting measurements of data quality, each measure was modeled with logit binomial regression to characterize tradeoffs and data quality interactions. Measures for accuracy, completeness and timeliness were calculated for 196,967 patient encounters. Report generation was measured as a proxy for the usefulness dimension. Based on the analysis, there was a positive relationship between accuracy and completeness, and a negative relationship between timeliness and usefulness. Importantly, the use of data was associated with an increase in completeness and accuracy. There were limitations to the measures and metrics developed with the focus group, however it was agreed that the measures were reasonable proxies for the data quality dimensions under study. The results provide meaningful insight on user tradeoffs and can be used in the design of systems in primary care.

QDflows: A System Driven by Knowledge Bases for Designing Quality-aware Data Flows

In the Big data era, data integration is becoming increasingly important. It is usually handled by data flows processes that extract, transform, and clean data from several sources, and populate the Data Integration System (DIS). Designing data flows is facing several challenges. In this paper, we deal with data quality issues such as: (1) expressing a set of quality rules, (2) enforcing them on the DIS to detect violations, and (3) repairing inconsistencies. We propose QDflows, a system for designing quality-aware data flows that considers as input: (1) a high quality Knowledge Base (KB) as the global schema of integration, (2) a set of data sources and a set of validated users requirements, (3) a set of defined mappings between data sources and the KB, and (4) a set of quality rules specified by the users. QDflows uses an ontology to design the DIS schema. It offers the ability to define the DIS ontology as a module of the knowledge base, based on the validated users requirements. The DIS ontology model is then extended with multiple types of quality rules specified by users. QDflows extracts and transforms data from the sources in order to populate the DIS. It detects violations of the quality rules enforced on the DIS, constructs repair patterns, searches for horizontal and vertical matches in the knowledge base, and performs an automatic repair when possible or generates possible repairs. It interactively involves users to validate the repair process before loading the clean data into the DIS. Using real-life and synthetic datasets, DBpedia and Yago knowledge bases, we experimentally evaluate the generality, effectiveness, and efficiency of QDflows. We also showcase an interactive tool implementing our system.

Bibliometrics

Publication Years 2009-2017
Publication Count 117
Citation Count 196
Available for Download 117
Downloads (6 weeks) 1533
Downloads (12 Months) 12403
Downloads (cumulative) 75342
Average downloads per article 644
Average citations per article 2
First Name Last Name Award
Peter Aiken ACM Senior Member (2011)
Ahmed Elmagarmid ACM Distinguished Member (2009)
Daniel S Katz ACM Senior Member (2011)
Beth A. Plale ACM Senior Member (2006)

First Name Last Name Paper Counts
Yang Lee 4
Stuart Madnick 3
G Shankaranarayanan 3
Peter Christen 3
John Talburt 3
Daisyzhe Wang 2
Ross Gayler 2
Ali Sunyaev 2
Nan Tang 2
Vassilios Verykios 2
Carolyn Matheus 2
Xiaobai Li 2
Roger Blake 2
Dinusha Vatsalan 2
Christan Grant 2
Arnon Rosenthal 2
Sherali Zeadally 2
Wolfgang Lehner 2
Roman Lukyanenko 2
Eitel LauríA 2
Mario Mezzanzanica 1
Roberto Boselli 1
Christoph Lange 1
Sören Auer 1
Luvai Motiwalla 1
Sandra Geisler 1
Daniel Katz 1
Douglas Hodson 1
Dov Biran 1
Edward Anderson 1
Chris Baillie 1
Peter Edwards 1
Beth Plale 1
Pierpaolo Vittorini 1
Karthikeyan Ramamurthy 1
Ralf Tönjes 1
Laurent Lecornu 1
Shelly Sachdeva 1
Sharad Mehrotra 1
Stuart Madnick 1
Monica Tremblay 1
Debra Vandermeer 1
Foster Provost 1
Nicola Ferro 1
Christian Becker 1
Sandra Sampaio 1
Jianyong Wang 1
Wenfei Fan 1
Dustin Lange 1
Therese Williams 1
Chintan Amrit 1
John Krogstie 1
Banda Ramadan 1
John O’Donoghue 1
Venkata Meduri 1
Axel Polleres 1
Wenjun Li 1
Davide Ceolin 1
Khoi Tran 1
Lan Cao 1
Jeffrey Vaughan 1
Melanie Herschel 1
Payam Barnaghi 1
Jean Caillec 1
Rashid Ansari 1
Arputharaj Kannan 1
Anupkumar Sen 1
Hubert Österle 1
Suzanne Embury 1
Lizhu Zhou 1
Erhard Rahm 1
Shuai Ma 1
Nigel Martin 1
Huizhi Liang 1
Paolo Coletti 1
Mirko Cesarini 1
Hongjiang Xu 1
Vincenzo Maltese 1
Yuheng Hu 1
Yi Chen 1
Robert Meusel 1
Xiaoping Liu 1
Paul Groth 1
Valentina Maccatrozzo 1
Maurice Van Keulen 1
Stephen Chong 1
Edoardo Pignotti 1
Mohamed Yakout 1
A Borthick 1
Sara Tonelli 1
Kush Varshney 1
Ashfaq Khokhar 1
Fred Morstatter 1
Rahul Basole 1
Jimeng Sun 1
Dmitry Chornyi 1
Danilo Montesi 1
Omar Alonso 1
Alan Labouseur 1
Irit Askira Gelman 1
Alexandra Poulovassilis 1
Eric Medvet 1
Fabiano Tarlao 1
John Herbert 1
Juan Augusto 1
Maurice Mulvenna 1
Paul Mccullagh 1
Fabio Mercorio 1
Fei Chiang 1
Siddharth Sitaramachandran 1
J Jha 1
Laure Berti-Équille 1
Jürgen Umbrich 1
Sven Weber 1
Fabian Panse 1
Fumiko Kobayashi 1
Richard Briotta 1
Johann Freytag 1
María Bermúdez-Edo 1
Maria Alvarez 1
Kristin Weber 1
Panagiotis Ipeirotis 1
Paolo Missier 1
Xu Pu 1
Benjamin Ngugi 1
Beverly Kahn 1
Paul Glowalla 1
Wenyuan Yu 1
Felix Naumann 1
Wenyuan Yu 1
Fausto Giunchiglia 1
Jeremy Debattista 1
Sushovan De 1
Dominique Ritze 1
Heiko Paulheim 1
Christoph Quix 1
Matthias Jarke 1
Wan Fokkink 1
Jeffrey Fisher 1
Adriane Chapman 1
Jeremy Millar 1
Hilko Donker 1
Dezhao Song 1
Rabia Nuray-Turan 1
Yinle Zhou 1
Heiko Müller 1
Youwei Cheah 1
Adir Even 1
Steven Brown 1
Terry Clark 1
Dmitri Kalashnikov 1
H Nehemiah 1
Matthew Jensen 1
Jay Nunamaker, 1
Daniel Dalip 1
Tobias Vogel 1
Arvid Heise 1
Uwe Draisbach 1
Fons Wijnhoven 1
Pável Calado 1
Olivier Curé 1
Ioannis Anagnostopoulos 1
Claire Collins 1
Patricia Franklin 1
Willem Van Hage 1
Len Seligman 1
Gilbert Peterson 1
Robert Ulbricht 1
Martin Hahmann 1
Eric Nelson 1
Hongwei Zhu 1
Michael Zack 1
Nitin Joglekar 1
Ulf Leser 1
Irit Gelman 1
Mikhail Atallah 1
Yanjuan Yang 1
Paul Bowen 1
Dennis Wei 1
Aleksandra Mojsilović 1
Ion Todoran 1
Ali Khenchaf 1
Valerie Sessions 1
Trent Rosenbloom 1
Shawn Hardenbrook 1
Subhash Bhalla 1
Huan Liu 1
Peter Aiken 1
D Elizabeth 1
Kaushik Dutta 1
M Kaiser 1
Jeffrey Parsons 1
Kresimir Duretec 1
Manoranjan Dash 1
Xiaoming Fan 1
Floris Geerts 1
Thomas Redman 1
David Becker 1
Wenfei Fan 1
Pim Dietz 1
Giannis Haralabopoulos 1
Sebastian Neumaier 1
Kyle Niemeyer 1
Arfon Smith 1
Archana Nottamkandath 1
Darryl Ahner 1
Claudio Hartmann 1
Hongwei Zhu 1
Norbert Ritter 1
Cihan Varol 1
Coşkun Bayrak 1
David Robb 1
Rosella Gennari 1
Craig Fisher 1
Sufyan Ababneh 1
Peter Elkin 1
Mark Braunstein 1
Marta Zárraga-Rodríguez 1
C Raj 1
Amitava Bagchi 1
Hema Meda 1
Matteo Magnani 1
Bernd Heinrich 1
Mathias Klier 1
R Greenwood 1
Ayush Singhania 1
George Moustakides 1
Bing Lv 1
Paul Mangiameli 1
Jianing Wang 1
Dirk Ahlers 1
Marcos Gonçalves 1
Alberto Bartoli 1
Hongwei Zhu 1
James McNaull 1
Judith Gelernter 1
Mouhamadoulamine Ba 1
Ciro D'Urso 1
Kelly Janssens 1
Subbarao Kambhampati 1
Hua Zheng 1
Jeff Heflin 1
Christian Skalka 1
Ahmed Elmagarmid 1
Michael Mannino 1
Fiona Rohde 1
Kewei Sha 1
Marco Valtorta 1
Elliot Fielstein 1
Theodore Speroff 1
Yang Lee 1
Judee Burgoon 1
Boris Otto 1
Josh Attenberg 1
Sean Goldberg 1
Andreas Rauber 1
Alun Preece 1
Anja Klein 1
Marilyn Tremaine 1
Alan March 1
Felix Naumann 1
Marco Cristo 1
Andrea Lorenzo 1
Richard Wang 1
Maurizio Murgia 1

Affiliation Paper Counts
University of Padua 1
Universite Paris-Est 1
Federal University of Amazonas 1
Florida State University 1
Virginia Commonwealth University 1
Vanderbilt University 1
Instituto Superior Tecnico 1
Google Inc. 1
University of Leipzig 1
Hospital Universitario Austral 1
Harvard University 1
University of Colorado at Denver 1
Oklahoma City University 1
University of Rhode Island 1
State University of New York at Albany 1
Georgia State University 1
University of Antwerp 1
University of Texas at Austin 1
Oregon State University 1
University of Massachusetts System 1
Indian Institute of Science 1
Elsevier 1
University of Augsburg 1
Vienna University of Technology 1
University of South Carolina 1
Memorial University of Newfoundland 1
Boston University 1
Technical University of Munich 1
Butler University 1
New Jersey Institute of Technology 1
National Institute of Standards and Technology 1
Cardiff University 1
Sam Houston State University 1
University College Cork 1
Microsoft Corporation 1
Ben-Gurion University of the Negev 1
University of Edinburgh 1
Charleston Southern University 1
Commonwealth Scientific and Industrial Research Organization 1
Rutgers, The State University of New Jersey 1
University of Patras 1
Hellenic Open University 1
University of Illinois at Urbana-Champaign 1
Lehigh University 2
Humboldt University of Berlin 2
Fraunhofer Institute for Applied Information Technology 2
Nanyang Technological University 2
Old Dominion University 2
Suffolk University 2
Free University of Bozen-Bolzano 2
University of Innsbruck 2
University of Arizona 2
Norwegian University of Science and Technology 2
University of Kentucky 2
University of Trento 2
RWTH Aachen University 2
University of Toronto 2
University of Surrey 2
Indiana University 2
New York University 2
Massachusetts Institute of Technology 2
University of Massachusetts Boston 2
University of Bologna 2
University of Hamburg 2
Federal University of Minas Gerais 2
University of Oklahoma 2
University of Queensland 2
University of Aizu 2
McMaster University 2
Universidad de Navarra 2
Indian Institute of Management Calcutta 2
Vienna University of Economics and Business Administration 3
University of Massachusetts Medical School 3
Qatar Computing Research institute 3
Northeastern University 3
University of St. Gallen 3
University of Thessaly 3
Babson College 3
University of Cologne 3
Georgia Institute of Technology 3
University of Aberdeen 3
Beihang University 3
Telecom Bretagne 3
Purdue University 3
Birkbeck University of London 3
University of Bonn 3
University of California, Irvine 3
University of Mannheim 3
University of Twente 4
University of Ulster 4
Vrije Universiteit Amsterdam 4
United States Air Force Institute of Technology 4
University of Trieste 4
University of Manchester 4
Anna University 4
University of Illinois at Chicago 4
IBM Thomas J. Watson Research Center 4
Technical University of Dresden 4
University of Milan - Bicocca 4
United States Department of Veterans Affairs 4
University of Florida 4
MITRE Corporation 5
University of Massachusetts Lowell 5
Marist College 5
Florida International University 5
Tsinghua University 5
Arizona State University 5
Hasso-Plattner-Institut fur Softwaresystemtechnik GmbH 6
University of Arkansas at Little Rock 8
Australian National University 9
 
All ACM Journals | See Full Journal Index

Search JDIQ
enter search term and/or author name