short-paper

The Influence of Pre-processing on the Estimation of Readability of Web Documents

Authors:

João Rafael de Moura Palotti,

Allan HanburyAuthors Info & Claims

CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management

Pages 1763 - 1766

https://doi.org/10.1145/2806416.2806613

Published: 17 October 2015 Publication History

Abstract

This paper investigates the effect that text pre-processing approaches have on the estimation of the readability of web pages. Readability has been highlighted as an important aspect of web search result personalisation in previous work. The most widely used text readability measures rely on surface level characteristics of text, such as the length of words and sentences. We demonstrate that different tools for extracting text from web pages lead to very different estimations of readability. This has an important implication for search engines because search result personalisation strategies that consider users reading ability may fail if incorrect text readability estimations are computed.

References

[1]

M. Baroni, F. Chantree, A. Kilgarriff, and S. Sharoff. Cleaneval: a competition for cleaning web pages. In LREC, 2008.

[2]

M. Coleman and T. L. Liau. A Computer Readability Formula Designed for Machine Scoring. JAP, 1975.

[3]

K. Collins-Thompson, P. N. Bennett, R. W. White, S. de la Chica, and D. Sontag. Personalizing Web Search Results by Reading Level. In CIKM, 2011.

Digital Library

[4]

W. H. Dubay. The principles of readability. Costa Mesa, CA: Impact Information, 2004.

[5]

S. Dumais. Putting searchers into search. In SIGIR, 2014.

Digital Library

[6]

L. Goeuriot, L. Kelly, et al. Share/clef ehealth evaluation lab 2014, task 3: User-centred health information retrieval. In Working Notes of CLEF, 2014.

[7]

A. Graesser, D. McNamara, M. Louwerse, and Z. Cai. Coh-Metrix: Analysis of Text on Cohesion and Language. Behav Res Meth Instrum Comput, 2004.

[8]

R. Gunning. The Technique of Clear Writing. McGraw-Hill, 1952.

[9]

A. Jatowt and K. Tanaka. Is wikipedia too difficult?: Comparative analysis of readability of wikipedia, simple wikipedia and britannica. In CIKM, 2012.

Digital Library

[10]

J. Kincaid, R. Fishburne, R. Rogers, and B. Chissom. Derivation of New Readability Formulas for Navy Enlisted Personnel. Technical report, 1975.

[11]

C. Kohlschütter, P. Fankhauser, and W. Nejdl. Boilerplate detection using shallow text features. In WSDM, 2010.

Digital Library

[12]

G. H. McLaughlin. SMOG Grading - a New Readability Formula. Journal of Reading, 1969.

[13]

J. Pomikálek. Removing Boilerplate and Duplicate Content from Web Corpora. PhD thesis, 2011.

[14]

E. A. Smith and R. J. Senter. Automated Readability Index. Technical report, 1967.

[15]

C. Tan, E. Gabrilovich, and B. Pang. To Each His Own: Personalized Content Selection based on Text Comprehensibility. In WSDM, 2012.

Digital Library

[16]

R. C. Wiener and R. Wiener-Pla. Literacy, pregnancy and potential oral health changes: The internet and readability levels. Maternal and child health journal, 2013.

[17]

X. Yan, D. Song, and X. Li. Concept-based document readability in domain specific information retrieval. In CIKM'06, 2006.

Digital Library

[18]

G. Zuccon and B. Koopman. Integrating Understandability in the Evaluation of Consumer Health Search Engines. In MedIR, 2014.

Cited By

Ghafourian YHanbury AKnoth P(2023)Readability Measures as Predictors of Understandability and Engagement in Searching to LearnLinking Theory and Practice of Digital Libraries10.1007/978-3-031-43849-3_15(173-181)Online publication date: 22-Sep-2023
Lin JWang CZhou LJiang X(2022)Converting consumer-generated content into an innovation resource: A user ideas processing framework in online user innovation communitiesTechnological Forecasting and Social Change10.1016/j.techfore.2021.121266174(121266)Online publication date: Jan-2022
Saggion H(2022)Automatic Text SimplificationundefinedOnline publication date: 22-Mar-2022
Show More Cited By

Index Terms

The Influence of Pre-processing on the Estimation of Readability of Web Documents
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
2. Information systems
  1. Information retrieval
    1. Document representation
      1. Content analysis and feature selection

Recommendations

Design Guidelines for Web Readability
DIS '17: Proceedings of the 2017 Conference on Designing Interactive Systems

Reading is fundamental to interactive-system use, but around 800 million of people might struggle with it due to literacy difficulties. Few websites are designed for high readability, as readability remains an underinvestigated facet of User Experience. ...
Assessing the Readability of Web Search Results for Searchers with Dyslexia
SIGIR '18: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval

Standards organizations, (e.g., the World Wide Web Consortium), are placing increased importance on the cognitive accessibility of online systems, including web search. Previous work has shown an association between query-document relevance judgments, ...
Enhancing readability of web documents by text augmentation for deaf people
WIMS '13: Proceedings of the 3rd International Conference on Web Intelligence, Mining and Semantics

Deaf people have particular difficulty in understanding text-based web documents because their mother language, or sign language, is essentially visually oriented. To enhance the readability of text-based web documents for deaf people, we propose a news ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CIKM '15: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management

October 2015

1998 pages

ISBN:9781450337946

DOI:10.1145/2806416

General Chairs:
James Bailey
The University of Melbourne
,
Alistair Moffat
The University of Melbourne
,
Program Chairs:
Charu C. Aggarwal
IBM
,
Maarten de Rijke
University of Amsterdam
,
Ravi Kumar
Google
,
Vanessa Murdock
Microsoft
,
Timos Sellis
RMIT University
,
Jeffrey Xu Yu
Chinese University of Hong Kong

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 October 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Conference

CIKM'15

Sponsor:

CIKM'15: 24th ACM International Conference on Information and Knowledge Management

October 18 - 23, 2015

Melbourne, Australia

Acceptance Rates

CIKM '15 Paper Acceptance Rate 165 of 646 submissions, 26%;

Overall Acceptance Rate 1,861 of 8,427 submissions, 22%

Upcoming Conference

CIKM '25

Sponsor:
sigir
sigir

The 34th ACM International Conference on Information and Knowledge Management

November 10 - 14, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
248
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)2

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ghafourian YHanbury AKnoth P(2023)Readability Measures as Predictors of Understandability and Engagement in Searching to LearnLinking Theory and Practice of Digital Libraries10.1007/978-3-031-43849-3_15(173-181)Online publication date: 22-Sep-2023
Lin JWang CZhou LJiang X(2022)Converting consumer-generated content into an innovation resource: A user ideas processing framework in online user innovation communitiesTechnological Forecasting and Social Change10.1016/j.techfore.2021.121266174(121266)Online publication date: Jan-2022
Saggion H(2022)Automatic Text SimplificationundefinedOnline publication date: 22-Mar-2022
Zhang XYang YQiao SZhang Z(2020)Responsive and Responsible: Customizing Management Responses to Online Traveler ReviewsJournal of Travel Research10.1177/004728752097104661:1(120-135)Online publication date: 3-Dec-2020
Solovyev VSolnyshkina MIvanov VBatyrshin I(2019)Prediction of reading difficulty in Russian academic textsJournal of Intelligent & Fuzzy Systems10.3233/JIFS-17900736:5(4553-4563)Online publication date: 14-May-2019
Palotti JZuccon GHanbury A(2019)Consumer Health Search on the Web: Study of Web Page Understandability and Its Integration in Ranking AlgorithmsJournal of Medical Internet Research10.2196/1098621:1(e10986)Online publication date: 30-Jan-2019
Santos TLemmerich FStrohmaier MHelic D(2019)What's in a ReviewProceedings of the ACM on Human-Computer Interaction10.1145/33592423:CSCW(1-22)Online publication date: 7-Nov-2019
Terblanche ROzumba ORoot D(2019)Enhancing Financial Communication in Quantity Surveying PracticeThe Construction Industry in the Fourth Industrial Revolution10.1007/978-3-030-26528-1_27(276-286)Online publication date: 10-Aug-2019
Suominen HKelly LGoeuriot L(2019)The Scholarly Impact and Strategic Intent of CLEF eHealth Labs from 2012 to 2017Information Retrieval Evaluation in a Changing World10.1007/978-3-030-22948-1_14(333-363)Online publication date: 14-Aug-2019
Albrecht UHasenfuß Gvon Jan U(2018)Description of Cardiological Apps From the German App Store: Semiautomated Retrospective App Store AnalysisJMIR mHealth and uHealth10.2196/117536:11(e11753)Online publication date: 20-Nov-2018
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents