Internet Archives as a Tool for Research: Decay in Large Scale Archival Records

Hai Nguyen; Matthew S. Weber

doi:10.1109/BigDataCongress.2015.118

Internet Archives as a Tool for Research: Decay in Large Scale Archival Records

Hai Nguyen, Matthew S. Weber

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Scopus citations

Abstract

Web archiving provides social scientists and digital humanities researchers with a data source that enables the study of a wealth of historical phenomena. One of the most notable efforts to record the history of the World Wide Web is the Internet Archive (IA) project, which maintains the largest repository of archived data in the world. Understanding the quality of archived data and the completeness of each record of a single website is a central issue for scholarly research, and yet there is no standard record of the provenance of digital archives. Indeed, although present day records tend to be quite accurate, archived Web content deteriorates as one moves back in time. This paper analyzes a subset or archived Web data, measures the degree of degradation in a subset of data, and proposes statistical inference to such overcome limitations.

Original language	English (US)
Title of host publication	Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015
Editors	Latifur Khan, Carminati Barbara
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	724-727
Number of pages	4
ISBN (Electronic)	9781467372787
DOIs	https://doi.org/10.1109/BigDataCongress.2015.118
State	Published - Aug 17 2015
Externally published	Yes
Event	4th IEEE International Congress on Big Data, BigData Congress 2015 - New York City, United States Duration: Jun 27 2015 → Jul 2 2015

Publication series

Name	Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015

Other

Other	4th IEEE International Congress on Big Data, BigData Congress 2015
Country/Territory	United States
City	New York City
Period	6/27/15 → 7/2/15

Bibliographical note

Publisher Copyright:
© 2015 IEEE.

Keywords

analytics
archival data
big data
research
statistical validity

Publisher link

10.1109/BigDataCongress.2015.118

Find It

Find It at U of M Libraries

Cite this

Nguyen, H., & Weber, M. S. (2015). Internet Archives as a Tool for Research: Decay in Large Scale Archival Records. In L. Khan, & C. Barbara (Eds.), Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015 (pp. 724-727). Article 7207302 (Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/BigDataCongress.2015.118

Internet Archives as a Tool for Research: Decay in Large Scale Archival Records. / Nguyen, Hai; Weber, Matthew S.
Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015. ed. / Latifur Khan; Carminati Barbara. Institute of Electrical and Electronics Engineers Inc., 2015. p. 724-727 7207302 (Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Nguyen, H & Weber, MS 2015, Internet Archives as a Tool for Research: Decay in Large Scale Archival Records. in L Khan & C Barbara (eds), Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015., 7207302, Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015, Institute of Electrical and Electronics Engineers Inc., pp. 724-727, 4th IEEE International Congress on Big Data, BigData Congress 2015, New York City, United States, 6/27/15. https://doi.org/10.1109/BigDataCongress.2015.118

Nguyen H, Weber MS. Internet Archives as a Tool for Research: Decay in Large Scale Archival Records. In Khan L, Barbara C, editors, Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015. Institute of Electrical and Electronics Engineers Inc. 2015. p. 724-727. 7207302. (Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015). doi: 10.1109/BigDataCongress.2015.118

Nguyen, Hai ; Weber, Matthew S. / Internet Archives as a Tool for Research : Decay in Large Scale Archival Records. Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015. editor / Latifur Khan ; Carminati Barbara. Institute of Electrical and Electronics Engineers Inc., 2015. pp. 724-727 (Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015).

@inproceedings{7c63dea98e50491a8e6ea826182e2aee,

title = "Internet Archives as a Tool for Research: Decay in Large Scale Archival Records",

abstract = "Web archiving provides social scientists and digital humanities researchers with a data source that enables the study of a wealth of historical phenomena. One of the most notable efforts to record the history of the World Wide Web is the Internet Archive (IA) project, which maintains the largest repository of archived data in the world. Understanding the quality of archived data and the completeness of each record of a single website is a central issue for scholarly research, and yet there is no standard record of the provenance of digital archives. Indeed, although present day records tend to be quite accurate, archived Web content deteriorates as one moves back in time. This paper analyzes a subset or archived Web data, measures the degree of degradation in a subset of data, and proposes statistical inference to such overcome limitations.",

keywords = "analytics, archival data, big data, research, statistical validity",

author = "Hai Nguyen and Weber, {Matthew S.}",

note = "Publisher Copyright: {\textcopyright} 2015 IEEE.; 4th IEEE International Congress on Big Data, BigData Congress 2015 ; Conference date: 27-06-2015 Through 02-07-2015",

year = "2015",

month = aug,

day = "17",

doi = "10.1109/BigDataCongress.2015.118",

language = "English (US)",

series = "Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "724--727",

editor = "Latifur Khan and Carminati Barbara",

booktitle = "Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015",

}

TY - GEN

T1 - Internet Archives as a Tool for Research

T2 - 4th IEEE International Congress on Big Data, BigData Congress 2015

AU - Nguyen, Hai

AU - Weber, Matthew S.

PY - 2015/8/17

Y1 - 2015/8/17

N2 - Web archiving provides social scientists and digital humanities researchers with a data source that enables the study of a wealth of historical phenomena. One of the most notable efforts to record the history of the World Wide Web is the Internet Archive (IA) project, which maintains the largest repository of archived data in the world. Understanding the quality of archived data and the completeness of each record of a single website is a central issue for scholarly research, and yet there is no standard record of the provenance of digital archives. Indeed, although present day records tend to be quite accurate, archived Web content deteriorates as one moves back in time. This paper analyzes a subset or archived Web data, measures the degree of degradation in a subset of data, and proposes statistical inference to such overcome limitations.

AB - Web archiving provides social scientists and digital humanities researchers with a data source that enables the study of a wealth of historical phenomena. One of the most notable efforts to record the history of the World Wide Web is the Internet Archive (IA) project, which maintains the largest repository of archived data in the world. Understanding the quality of archived data and the completeness of each record of a single website is a central issue for scholarly research, and yet there is no standard record of the provenance of digital archives. Indeed, although present day records tend to be quite accurate, archived Web content deteriorates as one moves back in time. This paper analyzes a subset or archived Web data, measures the degree of degradation in a subset of data, and proposes statistical inference to such overcome limitations.

KW - analytics

KW - archival data

KW - big data

KW - research

KW - statistical validity

UR - http://www.scopus.com/inward/record.url?scp=84959525002&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84959525002&partnerID=8YFLogxK

U2 - 10.1109/BigDataCongress.2015.118

DO - 10.1109/BigDataCongress.2015.118

M3 - Conference contribution

AN - SCOPUS:84959525002

T3 - Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015

SP - 724

EP - 727

BT - Proceedings - 2015 IEEE International Congress on Big Data, BigData Congress 2015

A2 - Khan, Latifur

A2 - Barbara, Carminati

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 27 June 2015 through 2 July 2015

ER -

Internet Archives as a Tool for Research: Decay in Large Scale Archival Records

Abstract

Publication series

Other

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this