Science & Technology Review
|
2014, 32(34): 78-84
Big Data Quality Management: Problems and Progress
Full
WANG Hongzhi
Affiliations
Department of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
Published: 2014-12-08
doi: 10.3981/j.issn.1000-7857.2014.34.011
Outline
Big data have wide applications. Since the quality of big data plays a crucial role in these data-centric applications, data quality management techniques for big data are in demand. Although some theories and techniques for data quality management have been proposed, due to the volume, variety and velocity of big data, current methods could hardly be applied to data management for big data. This paper discusses the problems and challenges for error detection, error repair and query processing of dirty data in big data management, and identifies intractability, mixed errors and the lack of knowledge as three new challenges to data quality management. The progress of big data quality management in these three aspects is reviewed and open problems for future research are proposed.
data quality
/
big data
/
data cleaning
王宏志.
大数据质量管理:问题与研究进展.
科技导报,
2014
, 32
(34)
: 78
-84
.
DOI: 10.3981/j.issn.1000-7857.2014.34.011
WANG Hongzhi.
Big Data Quality Management: Problems and Progress[J].
Science & Technology Review,
2014
, 32
(34)
: 78
-84
.
DOI: 10.3981/j.issn.1000-7857.2014.34.011
Year 2014 volume 32 Issue 34
PDF
1387
196
Cite this Article
BibTeX
Article Info
doi: 10.3981/j.issn.1000-7857.2014.34.011
- Receive Date:2014-09-25
- Online Date:2014-12-17
- Published:2014-12-08