Cognitive Personalization in Microtask Design
Authors: 
Dennis Paulino, António Correia, Arsénio Reis, Diogo Guimarães, Roman Rudenko, Carlos Nunes, Tarcila Silva, João Barroso, 
Hugo ParedesAuthors Info & Claims
Pages 79 - 96
Abstract
Today digital labor increasingly advocates for the inclusion of people who are excluded from society in some way. The proliferation of crowdsourcing as a new form of digital labor consisting mainly of microtasks that are characterized by a low level of complexity and short time periods in terms of accomplishment has allowed a wide spectrum of people to access the digital job market. However, there is a long-recognized mismatch between the expectations of employers and the capabilities of workers in microwork crowdsourcing marketplaces. Cognitive personalization has the potential to tailor microtasks to crowd workers, thus ensuring increased accessibility by providing the necessary coverage for individuals with disabilities and special needs. In this paper an architecture for a crowdsourcing system intended to support cognitive personalization in the design of microtasks is introduced. The architecture includes an ontology built for the representation of knowledge on the basis of the concepts of microtasks, cognitive abilities, and types of adaptation in order to personalize the interface to the crowd worker. The envisioned system contains a backend and a frontend that serve as an intermediary layer between the crowdsourcing platform and the workers. Finally, some results obtained to evaluate the proposed system are presented.
References
[1]
Burchardt T, Le Grand J, and Piachaud D Social exclusion in Britain 1991–1995 Soc. Policy Adm. 1999 33 3 227-244
[2]
Barnes C and Mercer G Disability, work, and welfare: challenging the social exclusion of disabled people Work Employ Soc. 2005 19 3 527-545
[3]
Rohmer O and Louvet E Implicit stereotyping against people with disability Group Process. Intergroup Relat. 2018 21 1 127-140
[4]
Schur L The difference a job makes: the effects of employment among people with disabilities J. Econ. Issues 2002 36 2 339-347
[5]
Abberley P Work, Disability, Disabled People and European Social Theory 2002 Disability Studies Today Polity Press, Oxford
[6]
Simplican SC, Leader G, Kosciulek J, and Leahy M Defining social inclusion of people with intellectual and developmental disabilities: an ecological model of social networks and community participation Res. Dev. Disabil. 2015 38 18-29
[7]
Nota L, Santilli S, Ginevra MC, and Soresi S Employer attitudes towards the work inclusion of people with disability J. Appl. Res. Intellect. Disabil. 2014 27 6 511-520
[8]
Ramsey W Must cognition be representational? Synthese 2017 194 11 4197-4214
[9]
Miller EK and Wallis JD Executive function and higher-order cognition: definition and neural substrates Encycl. Neurosci. 2009 4 99-104
[10]
Montello DR Cognitive research in GIScience: recent achievements and future prospects Geogr. Compass 2009 3 5 1824-1840
[11]
Gauthier S, Reisberg B, Zaudig M, Petersen RC, Ritchie K, Broich K, et al. Mild cognitive impairment Lancet 2006 367 9518 1262-1270
[12]
Wimo A, Guerchet M, Ali GC, Wu YT, Prina AM, Winblad B, et al. The worldwide costs of dementia 2015 and comparisons with 2010 Alzheimer’s Dementia 2017 13 1 1-7
[13]
Lopresti EF, Mihailidis A, and Kirsch N Assistive technology for cognitive rehabilitation: state of the art Neuropsychol. Rehabil. 2004 14 1–2 5-39
[14]
World Health Organization: International Classification of Functioning, Disability and Health: ICF, Geneva, Switzerland (2001)
[15]
Larkins B The application of the ICF in cognitive-communication disorders following traumatic brain injury Semin. Speech Lang. 2007 28 4 334-342
[16]
Üstün TB, Chatterji S, Bickenbach J, Kostanjsek N, and Schneider M The international classification of functioning, disability and health: a new tool for understanding disability and health Disabil. Rehabil. 2003 25 11–12 565-571
[17]
Cieza A, Fayed N, Bickenbach J, and Prodinger B Refinements of the ICF linking rules to strengthen their potential for establishing comparability of health information Disabil. Rehabil. 2019 41 5 574-583
[18]
Gillespie A, Best C, and O'Neill B Cognitive function and assistive technology for cognition: a systematic review J. Int. Neuropsychol. Soc. 2012 18 1 1-19
[19]
Adolfsson P, Lindstedt H, Pettersson I, Hermansson LN, and Janeslätt G Perception of the influence of environmental factors in the use of electronic planning devices in adults with cognitive disabilities Disabil. Rehabil. Assist. Technol. 2016 11 6 493-500
[20]
de Joode E, van Heugten C, Verhey F, and van Boxtel M Efficacy and usability of assistive technology for patients with cognitive deficits: a systematic review Clin. Rehabil. 2010 24 8 701-714
[21]
Stephanidis C and Salvendy G Toward an information society for all: an international research and development agenda Int. J. Hum. Comput. Interact. 1998 10 2 107-134
[22]
Harper S Is there design-for-all? Univ. Access Inf. Soc. 2007 6 1 111-113
[23]
Ringbauer, B., Peissner, M., Gemou, M.: From “design for all” towards “design for one” - a modular user interface approach. In: Proceedings of the International Conference on Universal Access in Human-Computer Interaction, pp. 517–526 (2007)
[24]
Wobbrock JO, Kane SK, Gajos KZ, Harada S, and Froehlich J Ability-based design: concept, principles and examples ACM Trans. Accessible Comput. 2011 3 3 1-27
[25]
Morash-Macneil V, Johnson F, and Ryan JB A systematic review of assistive technology for individuals with intellectual disability in the workplace J. Spec. Educ. Technol. 2018 33 1 15-26
[26]
Miller, P., Parker, S., Gillinson, S.: Disablism: how to tackle the last prejudice. Demos (2004)
[27]
Tomczak MT Employees with autism spectrum disorders in the digitized work environment: perspectives for the future J. Disability Policy Stud. 2021 31 4 195-205
[28]
Lodovici, M.S.: The impact of teleworking and digital work on workers and society. Eur. Parliament (2021)
[29]
Assemi B, Jafarzadeh H, Abedin E, Rabhi F, and Mathies C Who gets the job? Synthesis of literature findings on provider success in crowdsourcing marketplaces Pacific Asia J. Assoc. Inf. Syst. 2022 14 1 4
[30]
Graham, M., Hjorth, I., Lehdonvirta, V.: Digital labour and development: impacts of global digital labour platforms and the gig economy on worker livelihoods. Transfer Eur. Rev. Labour Res. 23(2), 135–162 (2017)
[31]
Vyas L and Butakhieo N The impact of working from home during COVID-19 on work and life domains: an exploratory study on Hong Kong Policy Des. Pract. 2021 4 1 59-76
[32]
Noy I, Doan N, Ferrarini B, and Park D Measuring the economic risk of COVID-19 Global Pol. 2020 11 4 413-423
[33]
Bhatti, S.S., Gao, X., Chen, G.: General framework, opportunities and challenges for crowdsourcing techniques: a comprehensive survey. J. Syst. Softw. 167, 110611 (2020)
[34]
Zyskowski, K., Morris, M.R., Bigham, J.P., Gray, M.L., Kane, S.K.: Accessible crowdwork? Understanding the value in and challenge of microtask employment for people with disabilities. In: Proceedings of the ACM Conference on Computer Supported Cooperative Work & Social Computing, pp. 1682–1693 (2015)
[35]
Hettiachchi D, Van Berkel N, Kostakos V, and Goncalves J CrowdCog: a cognitive skill based system for heterogeneous task assignment and recommendation in crowdsourcing Proc. ACM Hum. Comput. Interact. 2020 4 CSCW2 1-22
[36]
Westerberg H et al. Computerized working memory training after stroke - a pilot study Brain Inj. 2007 21 1 21-29
[37]
De Luca R, Bramanti A, De Cola MC, Leonardi S, Torrisi M, Aragona B, et al. Cognitive training for patients with dementia living in a Sicilian nursing home: a novel web-based approach Neurol. Sci. 2016 37 10 1685-1691
[38]
Mansbach WE, Mace RA, and Clark KM The efficacy of a computer-assisted cognitive rehabilitation program for patients with mild cognitive deficits: a pilot study Exp. Aging Res. 2017 43 1 94-104
[39]
Dethlefs N, Milders M, Cuayáhuitl H, Al-Salkini T, and Douglas L A natural language-based presentation of cognitive stimulation to people with dementia in assistive technology: a pilot study Inform. Health Soc. Care 2017 42 4 349-360
[40]
Rego PA, Rocha R, Faria BM, Reis LP, and Moreira PM A serious games platform for cognitive rehabilitation with preliminary evaluation J. Med. Syst. 2017 41 1 1-15
[41]
De Luca R, Portaro S, Le Cause M, De Domenico C, Maggio MG, Cristina Ferrera M, et al. Cognitive rehabilitation using immersive virtual reality at young age: a case report on traumatic brain injury Appl. Neuropsychol. Child 2020 9 3 282-287
[42]
Gamito, P., Oliveira, J., Lopes, P., Brito, R., Morais, D., Silva, D., et al.: Executive functioning in alcoholics following an mHealth cognitive stimulation program: randomized controlled trial. J. Med. Internet Res. 16(4), e2923 (2014)
[43]
Burdea G, Polistico K, Krishnamoorthy A, House G, Rethage D, Hundal J, et al. Feasibility study of the BrightBrainer™ integrative cognitive rehabilitation system for elderly with dementia Disabil. Rehabil. Assist. Technol. 2015 10 5 421-432
[44]
Imbeault H, Langlois F, Bocti C, Gagnon L, and Bier N Can people with Alzheimer’s disease improve their day-to-day functioning with a tablet computer? Neuropsychol. Rehabil. 2018 28 5 779-796
[45]
Evald L Prospective memory rehabilitation using smartphones in patients with TBI: what do participants report? Neuropsychol. Rehabil. 2015 25 2 283-297
[46]
Seelye AM, Schmitter-Edgecombe M, Cook DJ, and Crandall A Naturalistic assessment of everyday activities and prompting technologies in mild cognitive impairment J. Int. Neuropsychol. Soc. 2013 19 4 442-452
[47]
Mihailidis A, Boger JN, Craig T, and Hoey J The COACH prompting system to assist older adults with dementia through handwashing: an efficacy study BMC Geriatr. 2008 8 1 1-18
[48]
Kwan RYC, Cheung DSK, and Kor PPK The use of smartphones for wayfinding by people with mild dementia Dementia 2020 19 3 721-735
[49]
Alm N, Astell A, Ellis M, Dye R, Gowans G, and Campbell J A cognitive prosthesis and communication support for people with dementia Neuropsychol. Rehabil. 2004 14 1–2 117-134
[50]
Abiri, R., McBride, J., Zhao, X., Jiang, Y.: A real-time brainwave based neuro-feedback system for cognitive enhancement. In: Proceedings of the Dynamic Systems and Control Conference (2015)
[51]
Braley R, Fritz R, Van Son CR, and Schmitter-Edgecombe M Prompting technology and persons with dementia: the significance of context and communication Gerontologist 2019 59 1 101-111
[52]
Sakurai, Y., Takada, K., Kawabe, T., Knauf, R., Tsuruta, S.: Evaluation of enriched cyberspace for adaptive support of remote collaboration. In: Proceedings of the IEEE International Conference on Signal-Image Technology and Internet Based Systems, pp. 225–232 (2010)
[53]
Erskine MA, Gregg DG, Karimi J, and Scott JE Individual decision-performance using spatial decision support systems: a geospatial reasoning ability and perceived task-technology fit perspective Inf. Syst. Front. 2019 21 6 1369-1384
[54]
Eickhoff, C.: Cognitive biases in crowdsourcing. In: Proceedings of the ACM International Conference on Web Search and Data Mining, pp. 162–170 (2018)
[55]
Sampath, A.H., Rajeshuni, R., Indurkhya, B.: Cognitively inspired task design to improve user performance on crowdsourcing platforms. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 3665–3674 (2014)
[56]
Graf, S., Lin, T., Jeffrey, L.: An exploratory study of the relationship between learning styles and cognitive traits. In: Proceedings of the European Conference on Technology Enhanced Learning, pp. 470–475 (2006)
[57]
Turner ML and Engle RW Is working memory capacity task dependent? J. Mem. Lang. 1989 28 2 127-154
[58]
Nguyen NN, Nham PT, and Takahashi Y Relationship between ability-based emotional intelligence, cognitive intelligence, and job performance Sustainability 2019 11 8 2299
[59]
Murtza, M.H., Gill, S.A., Aslam, H.D., Noor, A.: Intelligence quotient, job satisfaction, and job performance: the moderating role of personality type. J. Public Aff. 21(3), e2318 (2021)
[60]
Erskine MA, Gregg DG, Karimi J, and Scott JE Geospatial reasoning ability: definition, measurement and validation Int. J. Hum. Comput. Interact. 2015 31 6 402-412
[61]
Engin A and Vetschera R Information representation in decision making: the impact of cognitive style and depletion effects Decis. Support Syst. 2017 103 94-103
[62]
Ellsberg, D.: Risk, ambiguity, and the Savage axioms. Q. J. Econ., 643–669 (1961)
[63]
Tversky A and Kahneman D Judgment under uncertainty: heuristics and biases Science 1974 185 4157 1124-1131
[64]
Bikhchandani S, Hirshleifer D, and Welch I A theory of fads, fashion, custom, and cultural change as informational cascades J. Polit. Econ. 1992 100 5 992-1026
[65]
Huber J, Payne JW, and Puto C Adding asymmetrically dominated alternatives: violations of regularity and the similarity hypothesis J. Consum. Res. 1982 9 1 90-98
[66]
Stewart, A.E., et al.: I say, you say, we say: using spoken language to model socio-cognitive processes during computer-supported collaborative problem solving. Proc. ACM Hum. Comput. Interact. 3(CSCW), 1–19 (2019)
[67]
Kosinski, M., Bachrach, Y., Kasneci, G., Van-Gael, J., Graepel, T.: Crowd IQ: measuring the intelligence of crowdsourcing platforms. In: Proceedings of the Annual ACM Web Science Conference, pp. 151–160 (2012)
[68]
Raven J The Raven’s progressive matrices: change and stability over culture and time Cogn. Psychol. 2000 41 1 1-48
[69]
Hettiachchi D, van Berkel N, Hosio S, Kostakos V, and Goncalves J Lamas David, Loizides Fernando, Nacke Lennart, Petrie Helen, Winckler Marco, and Zaphiris Panayiotis Effect of cognitive abilities on crowdsourcing task performance Human-Computer Interaction – INTERACT 2019 2019 Cham Springer 442-464
[70]
MacLeod CM Half a century of research on the Stroop effect: an integrative review Psychol. Bull. 1991 109 2 163
[71]
Eriksen BA and Eriksen CW Effects of noise letters upon the identification of a target letter in a nonsearch task Percept. Psychophys. 1974 16 1 143-149
[72]
Monsell S Task switching Trends Cogn. Sci. 2003 7 3 134-140
[73]
Owen AM, McMillan KM, Laird AR, and Bullmore E N-back working memory paradigm: a meta-analysis of normative functional neuroimaging studies Hum. Brain Mapp. 2005 25 1 46-59
[74]
Petrides M, Alivisatos B, Meyer E, and Evans AC Functional activation of the human frontal cortex during the performance of verbal working memory tasks Proc. Natl. Acad. Sci. 1993 90 3 878-882
[75]
Mourelatos, E., Tzagarakis, M.: Worker’s cognitive abilities and personality traits as predictors of effective task performance in crowdsourcing tasks. In: Proceedings of the ISCA/DEGA Workshop on Perceptual Quality of Systems (2016)
[76]
Mourelatos, E., Giannakopoulos, N., Tzagarakis, M.: Personality traits and performance in online labour markets. Behav. Inf. Technol., 1–17 (2020)
[77]
Saab F, Elhajj IH, Kayssi A, and Chehab A Modelling cognitive bias in crowdsourcing systems Cogn. Syst. Res. 2019 58 1-18
[78]
Ponciano, L., Brasileiro, F.: Finding volunteers’ engagement profiles in human computation for citizen science projects. arXiv preprint arXiv:1501.02134 (2015)
[79]
Goncalves, J., Feldman, M., Hu, S., Kostakos, V., Bernstein, A.: Task routing and assignment in crowdsourcing based on cognitive abilities. In: Proceedings of the International Conference on World Wide Web Companion, pp. 1023–1031 (2017)
[80]
Paulino, D., Correia, A., Guimarães, D., Barroso, J., Paredes, H.: Towards a cognitive personalization framework for UI adaptation in crowd work. In: Proceedings of the IEEE International Conference on Computer Supported Cooperative Work in Design (2022)
[81]
Chaudhuri A Internet of things data protection and privacy in the era of the general data protection regulation J. Data Prot. Priv. 2016 1 1 64-75
[82]
Navon D Forest before trees: the precedence of global features in visual perception Cogn. Psychol. 1977 9 3 353-383
[83]
Paulino, D., et al.: Assessment of wizards for eliciting users’ accessibility preferences. In: Proceedings of the International Conference on Software Development and Technologies for Enhancing Accessibility and Fighting Info-Exclusion, pp. 135–140 (2020)
[84]
George, G., Lal, A.M.: Review of ontology-based recommender systems in e-learning. Comput. Educ. 142, 103642 (2019)
[85]
Gruber TR A translation approach to portable ontology specifications Knowl. Acquis. 1993 5 2 199-220
[86]
Chandrasekaran B, Josephson JR, and Benjamins VR What are ontologies, and why do we need them? IEEE Intell. Syst. Their Appl. 1999 14 1 20-26
[87]
Group, O.W.: OWL 2 web ontology language document overview: W3C recommendation 27 October 2009 (2009)
[88]
Allemang, D., Hendler, J.: RDF - The basis of the semantic web. In: Semantic Web for the Working Ontologist, 2nd edn. (2011)
[89]
World-Wide Web Consortium: RDF 1.1 Primer (2014)
[90]
Mariño BDR, RodríGuez-FóRtiz MJ, Torres MVH, and Haddad HM Accessibility and activity-centered design for ICT users: accesibilitic ontology IEEE Access 2018 6 60655-60665
[91]
Gadiraju, U., Kawase, R., Dietze, S.: A taxonomy of microtasks on the web. In: Proceedings of the ACM Conference on Hypertext and Social Media, pp. 218–223 (2014)
[92]
Riding RJ On the nature of cognitive style Educ. Psychol. 1997 17 1–2 29-49
[93]
Riding R and Cheema I Cognitive styles - an overview and integration Educ. Psychol. 1991 11 3–4 193-215
[94]
Shepard RN and Metzler J Mental rotation of three-dimensional objects Science 1971 171 3972 701-703
[95]
Šašinka Č, Stachoň Z, Kubíček P, Tamm S, Matas A, and Kukaňová M The impact of global/local bias on task-solving in map-related tasks employing extrinsic and intrinsic visualization of risk uncertainty maps Cartogr. J. 2019 56 2 175-191
Index Terms
- Cognitive Personalization in Microtask Design
Index terms have been assigned to the content through auto-classification.
Recommendations
Toward microtask crowdsourcing software design work
CSI-SE '16: Proceedings of the 3rd International Workshop on CrowdSourcing in Software EngineeringThe use of crowdsourcing as an approach for performing software engineering work is slowly but surely gaining foothold. Different models of crowdsourcing, however, have had varying levels of success to date. This paper contributes to the discussion a ...
Modus Operandi of Crowd Workers: The Invisible Role of Microtask Work Environments
The ubiquity of the Internet and the widespread proliferation of electronic devices has resulted in flourishing microtask crowdsourcing marketplaces, such as Amazon MTurk. An aspect that has remained largely invisible in microtask crowdsourcing is that ...
Cognitive personalization for online microtask labor platforms: A systematic literature review
AbstractOnline microtask labor has increased its role in the last few years and has provided the possibility of people who were usually excluded from the labor market to work anytime and without geographical barriers. While this brings new opportunities ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Jun 2022
576 pages
ISBN:978-3-031-05027-5
DOI:10.1007/978-3-031-05028-2
- Editors:
- Margherita Antona,
- Constantine Stephanidis
© The Author(s), under exclusive license to Springer Nature Switzerland AG 2022.
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 26 June 2022
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 02 Oct 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in