research-article

Cognitive map or medium materiality? Reading on paper and screen

Authors:

Kwan Min LeeAuthors Info & Claims

Computers in Human Behavior, Volume 67, Issue C

Pages 84 - 94

https://doi.org/10.1016/j.chb.2016.10.014

Published: 01 February 2017 Publication History

Abstract

The present study examined two common mechanisms that are used to explain why reading on an electronic screen versus paper result in different reading outcomes: The Cognitive Map Mechanism and the Medium Materiality Mechanism. A laboratory experiment (N=45), was conducted using a three-group comparison design (paper book vs. digital equivalent vs. digital disrupted view). Our hypotheses that were based on the cognitive map mechanism were largely supported. On the other hand, our hypotheses following the medium materiality mechanism were not sufficiently evidenced. Specifically, our results showed that the paper book was similar to its digital equivalent, and both were better than the digital disrupted view in terms of reading comprehension, feelings of fatigue, and psychological immersion. The findings implied that it is not the materiality of the presentation medium that influences reading outcomes, rather it is the extent to which the text presentation facilitates, or impedes, the reader's ability to construct a cognitive map that influences the reading process. Implications for future research and practice are discussed. We tested the difference between reading on an electronic screen versus paper.Our findings supported the cognitive map mechanism.Our findings failed to show evidence for the medium materiality mechanism.Readers' ability to construct a cognitive map of text affected reading outcomes.

References

[1]

American Optometric Association, Computer vision syndrome, 2015. http://www.aoa.org/patients-and-public/caring-for-your-vision/protecting-your-vision/computer-vision-syndrome?sso=y

[2]

S. Askwall, Computer supported reading vs reading text on paper: A comparison of two reading situations, International Journal of Man-Machine Studies, 22 (1985) 425-439.

[3]

P. Barker, S. Richard, I. Benest, Humancomputer interface design for electronic books, in: Proceedings of the 18th international online information meeting, 1994, pp. 213-225.

[4]

N. Baron, The impact of digital technologies. The end of the Book? Maybe. Does it Matter? Mobile communication, in: Paper presented at mobile internet, locative media, mobility and place, Aarhus University, 2012.

[5]

S. Belmore, Reading computer presented text, Bulletin of the Psychonomic Society, 23 (1985) 12-14.

[6]

S. Benedetto, V. Drai-Zerbib, M. Pedrotti, G. Tissier, T. Baccino, E-readers and visual fatigue, PLoS One, 8 (2013).

[7]

I.D. Benest, Ahypertext system with controlled hype, Hypertext: State of the Art (1990) 52-63.

[8]

N. Bevan, Is there an optimum speed for presenting text on VDUs?, International Journal of Man-Machine Studies, 14 (1981) 59-76.

[9]

M.G. Cataldo, J. Oakhill, Why are poor comprehenders inefficient searchers? An investigation into the effects of text, Journal of Educational Psychology, 92 (2000) 791-799.

[10]

N. Chen, F. Guimbretiere, M. Dixon, C. Lewis, M. Agrawala, Navigation techniques for dual display e-book readers, in: Proceedings of CHI08, 2008, pp. 1779-1788.

Digital Library

[11]

J. Chen, J. Xiao, J. Fan, E. O'Brien-Strain, PageSpark: An e-magazine reader with enhanced reading experiences on handheld devices, in: Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems, ACM, 2011, pp. 149-152.

Digital Library

[12]

N. Chomsky, Rules and representations, Cognitive Science, 14 (1980).

[13]

M.M. Chun, Y. Jiang, Contextual cueing: Implicit learning and memory of visual context guides spatial attention, Cognitive Psychology, 36 (1998) 28-71.

[14]

J. Conklin, Hypertext: An introductory and survey, IEEE Computers, 20 (1987) 17-41.

Digital Library

[15]

E. Conlon, M. Sanders, The reading rate and comprehension of adults with impaired reading skills or visual discomfort, Journal of Research in Reading, 34 (2011) 205-209.

[16]

L. Cosmides, J. Tooby, Cognitive adaptations for social exchange, in: The adapted mind: Evolutionary psychology and the generation of culture, Oxford University Press, New York, 1992.

[17]

L. Cosmides, J. Tooby, Origins of domain specificity: The evolution of functional organization, in: Mapping the mind: Domain specificity in cognition and culture, Cambridge University Press, New York, 1994, pp. 85-116.

[18]

F. Crestani, S.P. Ntioudis, User centered evaluation of an automatically constructed Hyper-Textbook, Journal of Educational Multimedia and Hypermedia (2001) 3-19.

[19]

W.H. Cushman, Reading from microfiche, VDT and the printed page: Subjective fatigue and performance, Human Factors, 28 (1986) 63-73.

Digital Library

[20]

D. DeStefano, J. LeFevre, Cognitive load in hypertext reading: A review, Computers in Human Behavior, 23 (2007) 1616-1641.

Digital Library

[21]

J.J. DiCarlo, D. Zoccolan, N.C. Rust, How does the brain solve visual object recognition?, Neuron, 73 (2012) 415-434.

[22]

A. Dillon, Reading from paper versus screens: A critical review of the empirical literature, Ergonomics, 35 (1992) 1297-1326.

[23]

A. Dillon, C. McKnight, J. Richardson, Reading from paper versus reading from screens, The Computer Journal, 31 (1988) 457-464.

Digital Library

[24]

K.S. Eklundh, Problems in achieving a global perspective of the text in computer-based writing, Instructional Science, 21 (1992) 73-84.

[25]

W.C. Elm, D.D. Woods, Getting lost: A case study in user interface design, in: Proceedings of the human factors society, 1985, pp. 927-931.

[26]

J.J. Gibson, The theory of affordances, in: Perceiving, acting, and knowing, Lawrence Erlbaum Associates, Hillsdale, NJ, 1977.

[27]

J.J. Gibson, The ecological approach to visual perception, Houghton Mifflin, Boston, 1979.

[28]

J.D. Gould, L. Alfaro, V. Barnes, R. Finn, N. Grischkowsky, A. Minuto, Reading is slower from CRT displays than from paper: Attempts to isolate a single-variable explanation, Human Factors, 29 (1987) 269-299.

Digital Library

[29]

J.D. Gould, N. Grischkowsky, Doing the same work with hard copy and cathode-ray tube (CRT) computer terminals, Human Factors, 26 (1984) 323-337.

[30]

J.D. Gould, N. Grischkowsky, Does visual angle of a line of characters affect reading speed?, Human Factors, 28 (1986) 165-173.

[31]

S.H. Gray, Information search with dynamic text vs. paper text: An empirical comparison, International Journal of ManMachine Studies, 35 (1991) 575-586.

Digital Library

[32]

T.D. Green, R.A. Perera, L.A. Dance, E.A. Myers, Impact of presentation mode on recall of written text and numerical information: Hard copy versus electronic, North American Journal of Psychology, 12 (2010) 233-242.

[33]

C. Haas, W. Hansen, Factors which affect reading and writing on personal computers and on workstations, Communications of the ACM, 31 (1988) 1080-1089.

Digital Library

[34]

J. Heikenfeld, P. Drzaic, J. Yeo, T. Koch, Review paper: A critical review of the present and future prospects for electronic paper, Journal of the Society for Information Display, 9 (2011) 129-156.

[35]

H. Henke, Are electrons better than papyrus? Or can Adobe Acrobat Reader files replace hardcopy?, in: ACM SIGDOC conference on scaling the heights, 1998, pp. 29-37.

Digital Library

[36]

A. Holzinger, M. Baernthaler, W. Pammer, H. Katz, V. Bjelic-Radisic, M. Jiefle, Investigating paper vs. screen in real-life hospital workflows: Performance contradicts perceived superiority of paper in the user experience, International Journal of Human-Computer Studies, 69 (2011) 563-570.

Digital Library

[37]

J. Hou, Y. Nam, W. Peng, K. Lee, Effects of screen size, viewing angle, and players' immersion tendencies on game experience, Computers in Human Behavior, 28 (2012) 617-623.

Digital Library

[38]

H. Huang, Do print and Web surveys provide the same results?, Computers in Human Behavior, 22 (2006) 334-350.

Digital Library

[39]

F. Jabr, The reading brain in the digital age: The science of paper versus screens, Scientific American, 2013, April.

[40]

M.A. Kerr, S.E. Symons, Computerized presentation of text: Effects on children's reading of informational materials, Reading and Writing, 19 (2006) 1-19.

[41]

H. Kim, J. Kim, Reading from an LCD monitor versus paper: Teenagers' reading performance, International Journal of Research Studies in Educational Technology, 2 (2013) 1-10.

Digital Library

[42]

F. Kretzschmar, D. Pleimling, J. Hosemann, S. Fssel, I. Bornkessel-Schlesewsky, M. Schlesewsky, Subjective impressions do not mirror online reading effort: Concurrent EEG-Eyetracking evidence from the reading of books and digital media, PLoS One, 8 (2013).

[43]

S.H. Kurniawan, P. Zaphiris, Reading online or on Paper: Which is faster?, in: Proceedings of the 9th international conference on human computer interaction, 2001.

[44]

M. Landoni, R. Wilson, F. Gibb, From the visual book to the WEB book: The importance of good design, Research and Advanced Technology for Digital Libraries (2000) 305-314.

Digital Library

[45]

N. Le Bigot, J.M. Passerault, T. Olive, Memory for words location in writing, Psychological Research, 73 (2009) 89-97.

[46]

L. Leventhal, B. Teasley, I. Instone, D. Rohlman, J. Farhat, Sleuthing in HyperHolmes: An evaluation of using hypertext vs. a book to answer questions, Behavior and Information Technology, 12 (1993) 149-164.

[47]

L. Li, G. Chen, S. Yang, Construction of cognitive maps to improve e-book reading and navigation, Computers & Education, 60 (2013) 32-39.

Digital Library

[48]

V. Liesaputra, I.H. Witten, Realistic electronic books, International Journal of Human-Computer Studies, 70 (2012) 588-610.

Digital Library

[49]

P.H. Lin, Y.T. Lin, S.L. Hwang, S.C. Jeng, C.C. Liao, Effects of anti-glare surface treatment, ambient illumination and bending curvature on legibility and visual fatigue of electronic papers, Displays, 29 (2008) 25-32.

[50]

M. Mackey, Literacies across Media: Playing the Text, Routledge, London, 2007.

[51]

A. Mangen, Hypertext fiction reading: Haptics and immersion, Journal of Research in Reading, 31 (2008) 404-419.

[52]

A. Mangen, D. Kuiken, Lost in the iPad: Narrative engagement on paper and tablet, Scientific Study of Literature, 4 (2014) 150-177.

[53]

A. Mangen, P. Robinet, G. Olivier, J.L. Velay, Mystery story reading in pocket print book and on chronological events memory, in: Paper presented at the international society for the empirical study of literature and media, Turin, Italy, 2014.

[54]

A. Mangen, T. Schilhab, An embodied view of reading: Theoretical considerations, empirical findings, and educational implications, in: Skriv! Les!, Akademika, Trondheim, 2012, pp. 285-300.

[55]

A. Mangen, B.R. Walgermo, K. Brnnick, Reading linear texts on paper versus computer screen: Effects on reading comprehension, International Journal of Educational Research, 58 (2013).

[56]

S.J. Margolin, C. Driscoll, M.J. Toland, J.L. Kegler, E-readers, computer screens, or paper: Does reading comprehension change across media platforms?, Applied Cognitive Psychology, 27 (2013) 512-519.

[57]

R.E. Mayer, J. Heiser, S. Lonn, Cognitive constraints on multimedia learning: When presenting more material results in less understanding, Journal of Educational Psychology, 93 (2001) 187-198.

[58]

D.K. Mayes, V.K. Sims, J.M. Koonce, Comprehension and workload differences for VDT and paper-based reading, International Journal of Industrial Ergonomics, 28 (2001) 367-378.

[59]

S. McDonald, R.J. Stevenson, Effects of text structure and prior knowledge of the learner on navigation in hypertext, Human Factors, 40 (1998) 18-27.

[60]

C. Mercer, A. Mercer, Teaching students with learning problems, columbus, Merrill, Ohio, 1993.

[61]

G. Merchant, Writing the future in the digital age, Literacy, 41 (2007) 118-128.

[62]

C.B. Mills, L.J. Weldon, Reading text from computer screens, ACM Computing Surveys, 19 (1987) 329-358.

Digital Library

[63]

D. Moore, K. Zabrucky, Adult age differences in comprehension and memory for computer-displayed and printed text, Educational Gerontology, 21 (1995) 139-150.

[64]

T. Morineau, C. Blanche, L. Tobin, N. Guguen, The emergence of the contextual role of the e-book in cognitive processes through an ecological and functional analysis, International Journal of Human-Computer Studies, 62 (2005) 329-348.

Digital Library

[65]

N. Murphy, Amultisensory vs. Conventional approach to teaching spelling, Kean College, New Jersey, USA, 1997.

[66]

P. Muter, S.A. Latremouille, W.C. Treurniet, P. Beam, Extended reading of continuous text on television screens, Human factors, 24 (1982) 501-508.

[67]

P. Muter, P. Maurutto, Reading and skimming from computer screens and books: The paperless office revisited, Behaviour & Information Technology, 10 (1991) 257-266.

[68]

K. Nakamura, W.J. Kuo, F. Pegado, L. Cohen, O.J. Tzeng, S. Dehaene, Universal brain systems for recognizing word shapes and handwriting gestures during reading, Proceedings of National Academy of Sciences of the USA, 109 (2012) 20762-20767.

[69]

V. Nell, Lost in a Book: The Psychology of Reading for Pleasure, Yale University Press, New Haven and London, 1988.

[70]

D. Norman, The design of everyday things, The MIT Press, 2002.

Digital Library

[71]

J.M. Noyes, K.J. Garland, VDT versus paper-based text: Reply to Mayes, Sims and Koonce, International Journal of Industrial Ergonomics, 31 (2003) 411-423.

[72]

K. O'Hara, A. Sellen, Acomparison of reading paper and on-line documents, in: Proceedings of SIGCHI conference on human factors in computing systems, 1997, pp. 335-342.

Digital Library

[73]

J. Paczkowski, Rumor mill ramps up production of cheaper and smaller iPads, 2012. http://allthingsd.com/20120301/rumor-mill-ramps-up-production-of-cheaper-and-smaller-ipads/

[74]

S. Payne, W. Reader, Constructing structure maps of multiple on-line texts, International Journal of Human-Computer Studies, 64 (2006) 461-474.

Digital Library

[75]

B.G. Pearce, Health hazards of VDTs?, John Wiley & Sons, New York, 1984.

Digital Library

[76]

A. Piolat, J.Y. Roussey, O. Thunin, Effects of screen presentation on text reading and revising, International Journal of HumanComputer Studies, 47 (1997) 565-589.

Digital Library

[77]

J. Pynte, A. Kennedy, S. Ducrot, The influence of parafoveal typographical errors on eye movements in reading, European Journal of Cognitive Psychology, 16 (2004) 178-202.

[78]

E.Z. Rothkopf, Incidental memory for location of information in text, Journal of Verbal Learning and Verbal Behavior, 10 (1971) 608-613.

[79]

C. Scharinger, Y. Kammerer, P. Gerjets, Pupil Dilation and EEG alpha frequency band power reveal load on executive functions for link-selection processes during text reading, PLoS One, 10 (2015).

[80]

L. Shams, A. Seitz, Benefits of multisensory learning, Trends Cognitive Sciences, 12 (2008) 411-417.

[81]

D.F. Sherry, D.L. Schacter, The evolution of multiple memory systems, Psychological Review, 94 (1987) 439-454.

[82]

A. Simpson, C. McKnight, Navigation in Hypertext: Structural cues and mental maps, in: Hypertext: State of the art, Intellect Book Ltd, Oxford, 1990, pp. 74-83.

[83]

H. Smedshammar, K. Frenckner, C. Nordquist, S. Romberger, Why is the difference in reading speed when reading from VDUs and from paper bigger for fast readers than for slow readers?, in: Paper presented at WWDU 1989, second international scientific conference, Montreal, 1989.

[84]

N. Stanton, A.P. Correia, P. Dias, Efficacy of a map on search, orientation and access behaviour in a hypermedia system, Computers and Education, 35 (2000) 263-279.

Digital Library

[85]

N. Stone, The e-reader industry: Replacing the book or enhancing the reader experience?, Design of Electronic Text, 1 (2008).

[86]

M.J. Tanner, Digital vs. print: Reading comprehension and the future of the book, SJSU School of Information Student Research Journal, 4 (2014). http://scholarworks.sjsu.edu/slissrj/vol4/iss2/6

[87]

A. Thayer, C.P. Lee, L.H. Hwang, H. Sales, P. Sen, N. Dalal, The imposition and superimposition of digital reading technology: The academic potential of e-readers, in: Proceedings of CHI 11, ACM, 2011, pp. 2917-2926.

Digital Library

[88]

R.H. Waller, Skimming, scanning and browsing: Problems of studying from electronic text, in: IEEE computing and control division colloquium on paper versus screen: The human factors issues digest No. 1985/80, 1985.

[89]

E. Wstlund, Experimental studies of human-computer interaction: Working memory and mental workload in complex cognition, Gothenburg University, Gteborg, 2007. https://gupea.ub.gu.se/bitstream/2077/4693/1/gupea_2077_4693_1.pdf

[90]

Norlander Wstlund, & Archer, The effect of page layout on mental workload: A dual-task experiment, Computers in Human Behavior, 24 (2008) 1229-1245.

Digital Library

[91]

E. Wstlund, H. Reinikka, T. Norlander, T. Archer, Effects of VDT and paper presentation on consumption and production of information: Psychological and physiological factors, Computers in Human Behavior, 21 (2005) 377-394.

[92]

N. Withers, Reading devices - comprende? Can the device that you read from really change your reading speed and comprehension?, Optometry Today, 53 (2013).

[93]

B. Witmer, M. Singer, Measuring presence in virtual environments: A presence questionnaire, Presence: Teleoperators and Virtual Environments, 7 (1998) 225-240.

Digital Library

[94]

M. Wolf, Proust and the Squid: The Story and Science of the Reading Brain, Harper Perennial, New York, 2007.

[95]

P. Wright, A. Lickorish, Proof-reading texts on screen and paper, Behaviour and Information Technology, 2 (1983) 227-235.

[96]

D. Zambarbieri, E. Carniglia, Eye movement analysis of reading from computer displays, eReaders and printed books, Ophthalmic Physiological Optics, 32 (2012) 390-396.

[97]

H. Zhang, H.-M. Yan, K. Kendrick, C. Li, Both lexical and Non-Lexical characters are processed during saccadic eye movements, PLoS One, 7 (2012).

[98]

M. Ziefle, Effects of display resolution on visual performance, Human Factors, 40 (1998) 554-568.

Cited By

Liu YZhao LFang QSong M(2024)The Cognitive Map Mechanism in Digital ReadingProceedings of the Association for Information Science and Technology10.1002/pra2.106261:1(581-585)Online publication date: 15-Oct-2024
Murciano Hueso ATorrijos Fincias PSerrate González S(2020)Youth Perception of Connectivity: Times and UsesEighth International Conference on Technological Ecosystems for Enhancing Multiculturality10.1145/3434780.3436566(909-914)Online publication date: 21-Oct-2020
https://dl.acm.org/doi/10.1145/3434780.3436566
Martiniello N(2020)Factors related to braille reading acquisition among aging braille learnersACM SIGACCESS Accessibility and Computing10.1145/3386402.3386407(1-1)Online publication date: 3-Mar-2020
https://dl.acm.org/doi/10.1145/3386402.3386407
Show More Cited By

Cognitive map or medium materiality? Reading on paper and screen
1. Human-centered computing

Recommendations

Establishing a Cognitive Map of Public Place for Blind and Visual Impaired by Using IVEO Hands-On Learning System
Proceedings, Part III, of the 15th International Conference on Human-Computer Interaction. Users and Contexts of Use - Volume 8006

In recent years, there has been an escalation of orientation and way- finding technologies and systems for the blind visually impaired people. The purpose of this study was to help visual impaired to access and explore spatial information by ...
The influence of reading speed and line length on the effectiveness of reading from screen

With such a large volume of material accessible from the World Wide Web, there is an urgent need to increase our knowledge of factors influencing reading from screen. We investigate the effects of two reading speeds (normal and fast) and different line ...
Children's reading comprehension and metacomprehension on screen versus on paper
Abstract
On-screen reading is becoming increasingly prevalent in educational settings, and children are now are expected to comprehend texts that they read on screens. However, research suggests that reading on screen impairs comprehension ...
Highlights
- Reading on screen impaired children's comprehension compared to reading on paper.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computers in Human Behavior

Computers in Human Behavior Volume 67, Issue C

February 2017

313 pages

ISSN:0747-5632

Issue’s Table of Contents

Copyright © Elsevier Ltd.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 February 2017

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Liu YZhao LFang QSong M(2024)The Cognitive Map Mechanism in Digital ReadingProceedings of the Association for Information Science and Technology10.1002/pra2.106261:1(581-585)Online publication date: 15-Oct-2024
Murciano Hueso ATorrijos Fincias PSerrate González S(2020)Youth Perception of Connectivity: Times and UsesEighth International Conference on Technological Ecosystems for Enhancing Multiculturality10.1145/3434780.3436566(909-914)Online publication date: 21-Oct-2020
https://dl.acm.org/doi/10.1145/3434780.3436566
Martiniello N(2020)Factors related to braille reading acquisition among aging braille learnersACM SIGACCESS Accessibility and Computing10.1145/3386402.3386407(1-1)Online publication date: 3-Mar-2020
https://dl.acm.org/doi/10.1145/3386402.3386407
Brishtel IIshimaru SAugereau OKise KDengel A(2018)Assessing Cognitive Workload on Printed and Electronic Media using Eye-Tracker and EDA WristbandCompanion Proceedings of the 23rd International Conference on Intelligent User Interfaces10.1145/3180308.3180354(1-2)Online publication date: 5-Mar-2018
https://dl.acm.org/doi/10.1145/3180308.3180354

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents