Europe PMC
Nothing Special   »   [go: up one dir, main page]

Europe PMC requires Javascript to function effectively.

Either your web browser doesn't support Javascript or it is currently turned off. In the latter case, please turn on Javascript support in your web browser and reload this page.

This website requires cookies, and the limited processing of your personal data in order to function. By using the site you are agreeing to this as outlined in our privacy notice and cookie policy.

Abstract 


Online recruitment via social media for health-related research is increasing. Metrics regarding social media recruitment may increase its use in this field. This study evaluates the feasibility of recruiting individuals with a smoking history through targeted advertising on Facebook for a randomized study focused on lung cancer screening. Individuals completed eligibility questions and were randomized to one of two groups. We analyzed advertisement reach and response patterns, advertisement cost, data integrity and sample representativeness. The advertisement was active for 34 days and resulted in 2111 unique clicks on the survey link. Four hundred thirty-three eligibility entries were collected, and 61 entries were excluded due to failure to correctly answer the data integrity check. Two hundred eighty-two participants met eligibility criteria and were randomized, 191 participants completed questionnaires and 10 entries were subsequently excluded due to a failed attention check. Recruitment utilizing targeted advertising on Facebook is an effective and efficient strategy for health-related research.

Free full text 


Logo of nihpaLink to Publisher's site
J Health Psychol. Author manuscript; available in PMC 2023 Jun 9.
Published in final edited form as:
PMCID: PMC10251309
NIHMSID: NIHMS1899978
PMID: 36416197

Using social media to recruit individuals for health-related research: Feasibility and lessons learned

Abstract

Online recruitment via social media for health-related research is increasing. Metrics regarding social media recruitment may increase its use in this field. This study evaluates the feasibility of recruiting individuals with a smoking history through targeted advertising on Facebook for a randomized study focused on lung cancer screening. Individuals completed eligibility questions and were randomized to one of two groups. We analyzed advertisement reach and response patterns, advertisement cost, data integrity and sample representativeness. The advertisement was active for 34 days and resulted in 2111 unique clicks on the survey link. Four hundred thirty-three eligibility entries were collected, and 61 entries were excluded due to failure to correctly answer the data integrity check. Two hundred eighty-two participants met eligibility criteria and were randomized, 191 participants completed questionnaires and 10 entries were subsequently excluded due to a failed attention check. Recruitment utilizing targeted advertising on Facebook is an effective and efficient strategy for health-related research.

Keywords: Facebook, lung cancer, lung cancer screening, recruitment, social media

Introduction

Researchers are constantly challenged to connect with participants in new and innovative ways. While traditional in-person recruitment has been successful in behavioral medicine, finding ways to connect with people outside of one’s immediate network can improve the generalizability of results to individuals who may not present in clinic. In particular, the COVID-19 pandemic drove researchers who may have previously relied on in-person recruitment to the internet to connect with potential participants.

There are many benefits to online recruitment for health-related research including cost-effectiveness (Ryan, 2013), the potential for a broader reach to individuals who may have less contact with their healthcare system (Benedict et al., 2019), and as a platform to reach historically hard-to-reach populations (Wozney et al., 2019). Social media recruitment like Facebook may reach more diverse samples—including age, race, and educational status—than traditional recruitment methods in large hospitals and academic centers. Despite these benefits, leveraging social media for recruitment in health research has lagged in the medical setting. A scoping review of 30 studies which used social media recruitment for medical research studies showed that almost half of included studies (n = 12) found social media to be more effective than other recruitment methods (Topolovec-Vranic and Natarajan, 2016). However, researchers may be hesitant to use social media for recruitment due to lack of knowledge of the efficiency of this recruitment strategy.

Online recruitment methodology has been used in various contexts. For example, recruitment utilizing Facebook has been used to reach samples regarding smoking cessation (Frandsen et al., 2014; Heffner et al., 2013; Sadasivam et al., 2013), condom use (Bull et al., 2012), diabetes (Balfe et al., 2012; Barnard et al., 2015), and cancer screenings (Kapp et al., 2013; Miyagi et al., 2014). While Facebook recruitment has often been used to target adolescents (Amon et al., 2014), more than half of adults over age 65 who use the internet are active Facebook users (Auxier and Anderson, 2021; Duggan et al., 2015). Little research utilizing targeted advertising on Facebook targets the older adult populations, representing a potential missed opportunities for researchers focused on adults and older adults (Thornton et al., 2016). More research is needed that targets older adults using Facebook to assess whether this is a viable recruitment strategy.

In the context of lung cancer screening, utilizing the Facebook platform to reach and target current and former smokers has proven efficacious. Lung cancer is one of the most stigmatized cancers and individuals may be less likely to present to care face-to-face in a timely manner (Carter-Harris et al., 2014). Facebook can provide a new way to reach individuals who are current or former smokers and has successfully reached this population in previous work (Carter-Harris et al., 2016; Strong and Renaud, 2020). However, research that utilizes targeted advertising using Facebook still represents just a sliver of the overall research in lung cancer screening and in the broader umbrella of health research.

Drawing attention to the strengths of social media recruitment for behavioral health research can help researchers leverage such platforms appropriately and efficiently. This paper describes recruitment for a study of current and former smokers focused on lung cancer screening. The aim of the current paper is to describe steps taken to recruit participants and to provide metrics about recruitment, including advertisement reach and participant demographics.

Methods

Recruitment

Participants were recruited online using targeted advertising on Facebook. Facebook has certain features which allow researchers to “target” the advertisement to individuals using demographics and keywords listed in the Facebook user’s profile or selected interests. For example, when setting up and maintaining a Facebook profile, users have the option of selecting certain hobbies, groups, organizations, and interests they may have which is then included in their public and non-public Facebook profile. This allows an individual designing a Facebook advertisement to purposively sample individuals based on specific variables endorsed in the users’ profile. For this study, the ad was set to only be seen by individuals who had selected their place of residence as the United States and whose language settings were set to English. Further, only individuals whose age on Facebook was greater than 55 and who had endorsed one of the following “likes” and “interests”: cigarettes, smoking, tobacco.

Facebook advertisement

The Facebook platform was chosen for recruitment as it has been used in similar studies (Carter-Harris et al., 2016). The advertisement was distributed from the principal investigator’s account (L.C.H.) and $600 was allotted for advertisement cost. The advertisement informed individuals that the study was about lung screening and that participation would include completing two short (approximately 20 minutes each) online questionnaires 6 months apart. The advertisement provided a link that would direct individuals to the study homepage (see Supplemental Materials 1). As part of Facebook’s advertising platform, the ad was delivered based upon the type of device the individual was using (i.e. desktop/laptop vs mobile device). For Facebook users’ accessing Facebook with a mobile device, the advertisement appeared in the middle of the newsfeed. For Facebook users’ accessing Facebook with a desktop or laptop, the advertisement either appeared in the right-hand column next to the newsfeed or in the middle of the newsfeed on the user’s homepage. Individuals were able to click on the ad which provided brief information regarding the study opportunity and, if clicked, led them to an introductory page using the Research Electronic Data Capture (REDCap) database.

Eligibility criteria

The Facebook advertisement was disseminated in a targeted manner, such that only individuals who were living in the United States and spoke English (per their Facebook profile) could see the ad. Further, eligible participants were those who were 55 years of age or older and currently or formerly smoked were eligible for participation. Age and smoking status were screened for in the eligibility questionnaire, and other screening-eligible information (i.e. pack-years) were determined through demographic information collected later in the study process. Please note, this study was approved prior to the updated guidelines for lung cancer screening released in 2021 which lowered the minimum age from 55 to 50 years (United States Preventive Services Task Force, 2021). Therefore, only participants aged 55 and older were eligible for participation in this study. The overall aim of the larger study was to examine the role of intolerance of uncertainty on lung cancer screening engagement in individuals eligible for lung cancer screening.

Participants provided an email address that study personnel used to distribute surveys. Once the screening questionnaire was complete, study personnel confirmed eligibility and, if eligible, randomized each participant to the control or intervention group. Eligible participants were then sent a link to complete the study questionnaires in REDCap. Up to three reminder emails spaced 3 days apart were sent to participants who had yet to complete the survey. This study was reviewed and approved as an exempt protocol at Memorial Sloan Kettering Cancer Center (IRB #X20-071) therefore, participants provided written consent by agreeing to participate and completing study questionnaires.

Description of intervention

Participants randomized to the intervention group received information about the lung cancer screening process (i.e. what it is, how long it takes) and additionally received information about the benefits (i.e. decreased mortality, earlier detection of lung cancer) and risks (false positive, subsequent potentially unnecessary and harmful testing) of lung cancer screening. The control group only received general information as to what the process of lung cancer screening entails. All information in both groups was adapted from the Agency for Healthcare Research and Quality (AHRQ, 2020).

Maintaining integrity

Data that is accurate (i.e. completed by individuals who meet eligibility criteria and by individuals appropriately attending to survey prompts) and complete is considered to have high integrity. We ensured data integrity using two different “checkpoints”: (1) a data integrity check during the eligibility screening, and (2) an attention check after receiving either the control or intervention information. First, we used an informal checking question to ensure that no internet bots were completing the survey (data integrity check). An internet bot is a software which runs automated tasks over the internet with the intent of emulating human behavior. Participants were queried during the screening process for eligibility and instructed to complete a simple subtraction math problem (i.e. “What is 7–4?”) that served as a data integrity check. If answered incorrectly, participants were deemed ineligible. In addition, an attention check was used to ensure that participants who did not pay attention to the intervention were excluded from analysis (Fieder et al., 2021). After receiving either intervention group, participants were asked to choose the answer that best fit what they just read about (information about lung cancer, information about pancreatic cancer, information about politics, information about the weather). Participants who answered incorrectly were deemed ineligible.

Data analysis

Metrics about the advertisement reach were downloaded from Facebook and ad cost per individual click and completed participant were calculated using descriptive statistics. Demographic information about participants were also calculated using descriptive statistics.

Results

Facebook advertisement reach

The ad was active for 34 days, with a brief pause to fix a problem with the study link. 46,153 unique Facebook users saw the ad on their web-page and 29,187 unique Facebook users clicked on the recruitment ad. Of those individuals, 2,111 clicked on the actual survey link which brought them to the REDCap introductory page. The total cost of the advertisement campaign was $600, with each click on the survey link costing approximately $0.28. A total of 433 entries were collected through REDCap. Out of those entries, 151 were excluded for various reasons (Figure 1). These reasons include failing the data integrity check, previous participation in the study, incomplete screening information including missing email, below age eligibility, not agreeing to participate, and never having smoked cigarettes. Two hundred eighty-two participants were randomized to either the control or intervention group. In total, 191 participants completed study questionnaires. The cost of the advertisement per completing participant was $3.14.

Maintaining integrity

The subtraction math problem was used to identify internet bots successfully identified 61 users who did not correctly answer the subtraction question. Out of all participants who completed the survey, 10 were excluded due to a failed attention check (nine answered incorrectly and one person omitted this question), resulting in 181 participants with complete data.

Participant demographics

Demographic information is described in Table 1. Participants primarily identified as White (n = 168, 93.3%) and few identified as Black or African American (n = 6, 3.3%), American Indian or Alaska Native (n = 5, 2.8%), or Asian/Pacific Islander (n = 1, 0.6%). Participant age ranged from 55 to 77 years old (M = 62.9, SD = 5.1). Participants educational status ranged, with most individuals completing high school or equivalent diploma (n = 39, 21.7%), completing partial college (n = 73, 40.6%), standard college (n = 42, 23.3%), or a graduate degree (n = 24, 13.3%). Most participants were retired (n = 71, 39.7%) or employed full-time (n = 34, 19.0%) or disabled (n = 34, 19.0%). The majority of individuals reported being married/living with a partner (n = 80, 45.4%) or divorced/separated (n = 58, 33.0%). Over half of participants reported their annual income status between $10,000 and $40,000 (n = 95, 52.8%), and one-quarter reported their annual income status to be between $40,000 and $75,000 (n = 45, 25.0%).

Table 1.

Demographic characteristics of participants.

Demographic characteristicN (%)
Gender
 Female148 (82.2)
 Male32 (17.8)
Age
 55–64120 (67.1)
 65–7455 (30.7)
 >754 (2.2)
Race
 American Indian or Alaska Native5 (2.8)
 Asian/Pacific Islander1 (0.6)
 Black or African American6 (3.3)
 White168 (93.3)
Ethnicity
 Hispanic176 (98.9)
 Non-Hispanic2 (1.1)
Marital Status
 Divorced/Separated58 (33.0)
 Married/Living with partner80 (45.4)
 Single19 (10.8)
 Widowed19 (10.8)
Educational Status
 Partial high school2 (1.1)
 High school graduate or GED39 (21.7)
 Partial college73 (40.6)
 Standard college or university42 (23.3)
 Graduate degree or professional training24 (13.3)
Employment status
 Employed (full time)34 (19.0)
 Employed (part time)16 (8.9)
 Disabled34 (19.0)
 Homemaker10 (5.6)
 Retired71 (39.7)
 Unemployed12 (6.7)
 Other2 (1.1)
Income status
 Less than $10,00014 (7.7)
 $10,000–$40,00095 (52.8)
 $40,000–$75,00045 (25.0)
 $75,000–$150,00021 (11.7)
 $150,000 or more5 (2.8)

Percent values represent valid percents.

Discussion

This paper outlines steps taken in recruitment using targeted advertising on Facebook and displays metrics about ad reach with the aim of providing transparency. We successfully targeted and acquired data from individuals using Facebook targeted advertisement as our recruitment platform. Attention and data integrity checkpoints helped ensure the integrity of the final dataset.

The single ad generated 29,187 clicks from unique Facebook users over 34 days and 2,111 individuals clicked on the ad and were led to the introductory page. Ramo et al. (2014) tested 36 unique ads over 7 weeks manipulating the ad image (i.e. logo, cartoon, photo) and placement on Facebook (i.e. newsfeed, sponsored stories, promoted posts) with the aim to quantify the success of each distinct ad. Their total results culminated in 5,895 clicks between all ads and found that ads using a logo were the most successful. The success of the current study in generating ad clicks and responses suggests the growing viability of Facebook to recruit individuals for health-related research. Additionally, our randomized intervention design supports the feasibility of online recruitment for intervention studies in behavioral health which have previously proven difficult amongst researchers (Topolovec-Vranic and Natarajan, 2016).

Results from this study show that online recruitment using targeted advertising on Facebook is a successful platform for recruiting individuals with a smoking history and further provides support for recruitment via social media for health-related research. The advertisement reached its target audience and 20.5% of the clicks on the study link resulted in data entries, with almost two-thirds (65.1%) of entries resulting in randomized participants. Almost two-thirds (64.2%) of randomized participants completed the study surveys with valid data (i.e. did not fail the data integrity check). Findings show that utilizing a checking question to identify “bots” successfully identified a considerable number (n = 61) of responses which may have been fraudulent. Further, utilizing an attention check to ensure participant engagement with study information identified 10 participants whose data could be excluded to improve data integrity.

Overall, it cost $0.28 per click and $3.14 per completed participant. In a systematic review of recruitment using Facebook for health and psychosocial research, the mean cost per completing participant was $17.48 (range: 1.36, $110) (Thornton et al., 2016). Our mean ad cost falls within the lower end of the range of ad cost, suggesting that our ad efficiently reached individuals who were interested in participation. Utilizing targeted advertising on Facebook can be a cost-effective way to recruit individuals, and specifically targeting your sample as was done in this study can help improve efficiency.

This study is not without limitations. The sample was primarily White and does not mirror the racial representation of Facebook—about 74% and 72% of all Black and Hispanic U.S. adults, respectively, report utilizing Facebook across all age categories (Auxier and Anderson, 2021). Additionally, across all age groups about 14.4% of all smokers identify as Black, about 8.0% identify as Asian, about 27.1% identify as American Indian or Alaska Native, and about 8.0% identify as Hispanic (Centers for Disease Control and Prevention, 2022). The current study did not capture the racial representation of tobacco users and calls for increased research on recruiting adult and older adult tobacco users on Facebook.

Implications for practice and research

These findings join the growing body of literature recruiting individuals for health-related research using social media (Carter-Harris et al., 2016; Naslund et al., 2017; Sedrak et al., 2020). Additionally, the successful recruitment of individuals leveraging a social media platform like Facebook provides further evidence that this is a viable method of recruitment, particularly in the adult and older adult population. The inclusion of survey questions to ensure records are, first, completed by legitimate individuals and, second, completed by participants who are accurately attending to the questionnaires, increases the reliability and validity of the data. The transparency about the ad and its successful reach and retention of participants can aid not only researchers interested in leveraging social media to reach potential participants, but also for practitioners who may want to find new ways to access clients for health-related interventions.

Supplementary Material

Supplement 2

Supplement 1

Supplement 3

Supplement 4

Supplement 5

Supplement 6

Click here to view.(103 bytes, sps)

Supplement 7

Supplement 8

Funding

The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was funded by the National Institute of Health (P30 CA 008748) and the National Cancer Institute (T32 CA009461).

Footnotes

Declaration of conflicting interests

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Ethics approval statement

This study was approved as an exempt protocol at Memorial Sloan Kettering Cancer Center (IRB #X20-071).

All information in both groups was adapted from the Agency for Healthcare Research and Quality (AHRQ, 2020).

Clinical trial registration

N/A

Data sharing statement

The current article is accompanied by the relevant raw data generated during and/or analysed during the study, including files detailing the analyses and either the complete database or other relevant raw data. These files are available in the Figshare repository and accessible as Supplemental Material via the Sage Journals platform. Ethics approval, participant permissions, and all other relevant approvals were granted for this data sharing.

References

  • Agency for Healthcare Research and Quality (2020) Overview: Is lung cancer screening right for me?. Available at: https://effectivehealthcare.ahrq.gov/products/lung-cancer-screening/overview (accessed 2 May 2021).
  • Amon KL, Campbell AJ, Hawke C, et al. (2014) Facebook as a recruitment tool for adolescent health research: A systematic review. Academic Pediatrics 14(5): 439–447. [Abstract] [Google Scholar]
  • Auxier B and Anderson M (2021) Social media use in 2021. Pew Research Center 1: 1–4. [Google Scholar]
  • Balfe M, Doyle F and Conroy R (2012) Using Facebook to recruit young adults for qualitative research projects: How difficult is it? CIN: Computers, Informatics, Nursing 30(10): 511–515. [Abstract] [Google Scholar]
  • Barnard KD, Pinsker JE, Oliver N, et al. (2015) Future artificial pancreas technology for type 1 diabetes: What do users want? Diabetes Technology & Therapeutics 17(5): 311–315. [Abstract] [Google Scholar]
  • Benedict C, Hahn AL, Diefenbach MA, et al. (2019) Recruitment via social media: Advantages and potential biases. Digital Health 5: 2055207619867223. [Europe PMC free article] [Abstract] [Google Scholar]
  • Bull SS, Levine DK, Black SR, et al. (2012) Social media-delivered sexual health intervention: A cluster randomized controlled trial. American Journal of Preventive Medicine 43(5): 467–474. [Europe PMC free article] [Abstract] [Google Scholar]
  • Carter-Harris L, Bartlett Ellis R, Warrick A, et al. (2016) Beyond traditional newspaper advertisement: Leveraging Facebook-targeted advertisement to recruit long-term smokers for research. Journal of Medical Internet Research 18(6): e117. [Europe PMC free article] [Abstract] [Google Scholar]
  • Carter-Harris L, Hermann CP, Schreiber J, et al. (2014) Lung cancer stigma predicts timing of medical help-seeking behavior. Oncology Nursing Forum 41(3): E203–E210. [Europe PMC free article] [Abstract] [Google Scholar]
  • Centers for Disease Control and Prevention (2022) Burden of cigarette use in the U.S. Available at: https://www.cdc.gov/tobacco/campaign/tips/resources/data/cigarette-smoking-in-united-states.html (accessed 5 August 2022).
  • Duggan M, Ellison NB, Lampe C, et al. (2015) Social media update 2014. Pew Research Center 19: 1–2. [Google Scholar]
  • Frandsen M, Walters J and Ferguson SG (2014) Exploring the viability of using online social media advertising as a recruitment method for smoking cessation clinical trials. Nicotine & Tobacco Research 16(2): 247–251. [Abstract] [Google Scholar]
  • Fieder K, McCaughey L and Prager J (2021) Quo vadis, methodology? The key role of manipulation checks for validity control and quality of science. Perspectives on Psychological Science 16(4): 816–826. [Europe PMC free article] [Abstract] [Google Scholar]
  • Heffner JL, Wyszynski CM, Comstock B, et al. (2013) Overcoming recruitment challenges of web-based interventions for tobacco use: The case of web-based acceptance and commitment therapy for smoking cessation. Addictive Behaviors 38(10): 2473–2476. [Europe PMC free article] [Abstract] [Google Scholar]
  • Kapp JM, Peters C and Oliver DP (2013) Research recruitment using Facebook advertising: Big potential, big challenges. Journal of Cancer Education 28(1): 134–137. [Abstract] [Google Scholar]
  • Miyagi E, Motoki Y, Asai-Sato M, et al. (2014) Web-based recruiting for asurvey on knowledge and awareness of cervical cancer prevention among young women living in Kanagawa prefecture, Japan. International Journal of Gynecologic Cancer 24(7): 1347–1355. [Europe PMC free article] [Abstract] [Google Scholar]
  • Naslund JA, Kim SJ, Aschbrenner KA, et al. (2017) Systematic review of social media interventions for smoking cessation. Addictive Behaviors 73: 81–93. [Europe PMC free article] [Abstract] [Google Scholar]
  • Ramo DE, Rodriguez TM, Chavez K, et al. (2014) Facebook recruitment of young adult smokers for a cessation trial: Methods, metrics, and lessons learned. Internet Interventions 1(2): 58–64. [Europe PMC free article] [Abstract] [Google Scholar]
  • Ryan GS (2013) Online social networks for patient involvement and recruitment in clinical research. Nurse Researcher 21(1): 35–39. [Abstract] [Google Scholar]
  • Sadasivam RS, Cutrona SL, Volz E, et al. (2013) Web-based peer-driven chain referrals for smoking cessation. Studies in Health Technology and Informatics 192: 357–361. [Europe PMC free article] [Abstract] [Google Scholar]
  • Sedrak MS, Sun CL, Hershman DL, et al. (2020) Investigator use of social media for recruitment of patients for cancer clinical trials. JAMA Network Open 3(12): e2031202. [Europe PMC free article] [Abstract] [Google Scholar]
  • Strong A and Renaud M (2020) Using social media as a platform for increasing knowledge of lung cancer screening in high-risk patients. Journal of the Advanced Practitioner in Oncology 11(5): 453–459. [Europe PMC free article] [Abstract] [Google Scholar]
  • Thornton L, Batterham PJ, Fassnacht DB, et al. (2016) Recruiting for health, medical or psychosocial research using Facebook: Systematic review. Internet Interventions 4: 72–81. [Europe PMC free article] [Abstract] [Google Scholar]
  • Topolovec-Vranic J and Natarajan K (2016) The use of social media in recruitment for medical research studies: A scoping review. Journal of Medical Internet Research 18(11): e286. [Europe PMC free article] [Abstract] [Google Scholar]
  • United States Preventive Services Task Force (2021) Lung Cancer Screening Guidelines. Available at: https://www.uspreventiveservicestaskforce.org/uspstf/recommendation/lung-cancer-screening (accessed 2 May 2021).
  • Wozney L, Turner K, Rose-Davis B, et al. (2019) Facebook ads to the rescue? Recruiting a hard to reach population into an Internet-based behavioral health intervention trial. Internet Interventions 17: 100246. [Europe PMC free article] [Abstract] [Google Scholar]

Citations & impact 


Impact metrics

Jump to Citations

Alternative metrics

Altmetric item for https://www.altmetric.com/details/139345515
Altmetric
Discover the attention surrounding your research
https://www.altmetric.com/details/139345515

Smart citations by scite.ai
Smart citations by scite.ai include citation statements extracted from the full text of the citing article. The number of the statements may be higher than the number of citations provided by EuropePMC if one paper cites another multiple times or lower if scite has not yet processed some of the citing articles.
Explore citation contexts and check if this article has been supported or disputed.
https://scite.ai/reports/10.1177/13591053221136928

Supporting
Mentioning
Contrasting
0
3
1

Article citations

Similar Articles 


To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.


Funding 


Funders who supported this work.

NCI NIH HHS (2)