4.2 RQ1: Misconceptions Around the World
The descriptive analysis of our misconceptions – to answer RQ1– revealed, that participants around the world are rather unsure about the queried misconceptions. The mean values for all misconception scores (see section
3.2.3) are located around the middle of the scale (“3 – neutral”). However, in the following sections we describe differences between countries and misconception topics and highlight specific misconceptions participants mostly agreed or disagreed to (
mean > 4 and
mean < 2).
4.2.1 Misconception Scores (Q9–Q16).
For all misconceptions we found moderate agreement, ranging around the middle of the scale with only very slight outliers. Figure
3 illustrates the score mean values for each misconception topic in all surveyed countries. For these score mean values, values closer to five show agreement with misconceptions and mean values closer to one indicate disagreement with the respective misconception topic.
Across all countries and topics, we observed score mean values from M = 2.51 up to M = 3.51 with standard deviations ranging from SD = 0.29 up to SD = 0.69. These results indicate that participants were more or less unsure about a lot of the posed misconceptions. The rather small standard deviations show that our data is gathered around the mean, hinting at a rather small amount of variation in the participants’ answers. This shows that participants from the same country rated the statements similar. German participants showed the least agreement with nearly all misconception topics, indicating that they least believed the misconceptions, even though most of the values were around the middle of the scale. Participants from China and India indicated the highest agreement with many misconceptions across topics, with some mean values, e. g., Q11 in China, leaning towards agreement (“4 – mainly agree”). We observed the smallest mean value for German participants on the topic of malware (Q15), with a score mean of M = 2.38 and a standard deviation of SD = 0.56. We found the highest score mean with M = 3.51 for Chinese participants and misconceptions relation for Wi-FI (Q11). The misconceptions for Wi-Fi (Q11) got the most agreement across all countries and misconceptions about malware (Q15) got the most disagreement.
4.2.2 Dominant Misconception Statements.
When looking at specific misconception statements, we found participants’ agreement (M > 4) or disagreement (M < 2) to thirteen statements compromising misconceptions as well as correct statements of digital security and privacy tools or concepts.
We closer investigated statements with mean values less than two and greater than four, indication clear disagreement and agreement with those (mis)conceptions.
One misconception that participants from all countries except Saudi Arabia (
M = 3.96) agreed with (
M > 4) was the importance of changing passwords regularly (Q13-6): “It is important for the security of my user accounts to regularly change the password.” This was an advice given to users for many years, but regularly changing the password only puts a burden on users and does rather not improve security [
6,
12,
25], except for when the account is compromised. We see that users still believed that this advice is true even though it is no longer given but rather discouraged. Another misconception participants from all countries agreed to was “My PC can get infected with malware by clicking on a link” (Q15-10) – which is only true in cases of sophisticated zero-click attacks like Pegasus [
24] that only aim at single high-value targets. In the vast majority of cases, when browser and operating system are kept up-to-date, clicking on a link is not sufficient to install malware on a computer. Only the download and further interaction with a file would be dangerous. Participants from India agreed (
M = 4.05) to the misconception that HTTPS indicates a websites’ trustworthiness (Q10-4), when in fact HTTPS only indicates a secure connection. Participants from other countries (except for Israel, Germany, and the US) also rather agreed to this statement (
M > 3.5). We rated this statement as a misconception as even fraudulent websites can set up HTTPS and thus, the user transmits their data over a secure connection to the offenders.
We observed agreement (M = 4.09) from Chinese participants for the misconception statement “When I am connected to a public Wi-Fi, it is easy to infect my device with malware” (Q11-3). We rated this statement as a misconception, as it does not consider the device configuration, like up-to-date anti-malware components, which will protect from being infected with malware. For this statement all other countries also tended to agree with mean values above M = 3.5.
We observed a misconception regarding two factor authentication for participants from Saudi Arabia and Germany, who agreed (
M = 4.03,
M = 4.10) to the statement “I have to log in to online banking with two processes so that the connection is encrypted, for example, with a password and TAN (transaction number)” (Q13-13). This shows participants misunderstand and confuse encryption and authentication, which was also found by Krombholz et al. [
22]. Participants from Saudi Arabia (
M = 4.03) as well as from China (
M = 4.3) believed that the content of a website reveals potential threats emerging from this website (“Is it more likely to pick up malware from visiting a porn website than visiting a website on the topic of sport” Q15-3).
We also observed disagreement with some misconception statements. Participants from South Africa disagreed (M = 1.83) to the statement that locking ones device is not necessary (Q14-6), indicating that they might think it is necessary security-wise, which is true. German participants disagreed (M = 1.74) to the statement “I can click on attached files without concern for an email that is addressed to me directly.” (15-11), revealing that they were familiar with phishing and the fact that phishing emails can be directly addressed to the recipient. We observed disagreement (M = 1, 87) from German participants to the statement “As long as a website looks official, I can enter my login data without concern” (Q15-12). As malicious websites often imitate real websites to phish people, the look and feel of a website is not a sufficient indication for a real or fake evaluation.
Similar to disagreeing to misconception statements we also observed agreement with true statements (M > 4). Participants from all countries agreed (means ranging from 4.19 to 4.51) to the statement that special characters and numbers lead to increased password security. We rated this statement as true, as generally speaking, the security of a password is enhanced when the number of possible combinations is increased by using additional digits like numbers or special characters. Shoulder-surfing is a security risk participants from all countries were aware of, with highest awareness (agreement values for Q14-1) in Germany, Poland, Sweden, UK, the US, and South Africa. The possibility for unnoticed malware on ones’ device was also familiar to all participants with highest awareness in Germany and Sweden (agreement with Q15-7). The concept of ransomware was somewhat known by all participants (mean values for all countries > 3.5) with highest agreement values in Germany, Israel, and Sweden (Q15-8). We observed the same for the concept of phishing (Q15-16), with mean values for all countries ranging between 4 (China) and 4.4 (Germany).
4.3 RQ2: Factors Predicting Misconceptions
In this section, we report on our results regarding RQ2, showing which factors predict security-related misconceptions. Even though we calculated the covariance models per misconception topic, we ordered results by predicting factors for better comprehension. Due to standardization of the predictors we were able to compare factors across models. All significant predictors with estimates and corresponding significant levels are listed in Table
3. Overall, we observed the highest estimate values for country of residence followed by security measures taken, attitudes regarding privacy and security as well as device usage. The adjusted
R2 values for every misconception topic are shown in Table
1. Adjusted
R2 represents the proportion of variance for the outcome variable, that is explained by the predictors (considering the number of predictors). We observed mixed results. For misconceptions regarding passwords and login processes (Q13), device security (Q14) as well as malware and deception (Q15), our prediction factors explained 30% – 40% of variance. For all other topics, however, our predictors only accounted for 8%-16% of the variance.
4.3.1 Country of Residence Predicts Belief in Misconceptions.
Country of residency proved to be the best predictor for the studied misconceptions – indicated by the largest significant estimates (except for Wi-Fi Q11), which showed participants had more (positive estimates) or less (negative estimates) misconceptions compared to participants from Germany.
We observed that Western and non-Western countries differed especially in magnitude of estimates. We found the largest estimates and thus greatest differences compared to Germany, for India, Saudi Arabia, and China.
For almost all misconception topics, except those related to Wi-Fi, the estimates were highest for either Chinese or Indian participants. For misconceptions related to Wi-Fi the highest estimate existed in South Africa. Chinese and US participants were more likely to believe in all misconceptions (positive significant estimates for all topics) than German participants. The same applied to the participants from India, Poland, and Sweden, who were significantly more likely to agree with not all but most of the misconception topics, compared to German participants. For all remaining countries at least one estimate was negative, showing that participants were less likely to believe (certain) misconceptions than German participants. We observed the smallest discrepancy between holding misconceptions for Israeli and German participants (estimates range from − 0.12 to 0.23). We generally found higher estimates for non-Western countries (China, India, Mexico, Saudi Arabia, South Africa) compared to Western countries. Compared to German participants, participants across all other countries were more likely to believe in misconceptions related to malware (Q15), device security (Q14), and passwords (Q13) indicated by higher positive estimates. For the predictor country we observed the lowest estimates for misconceptions related to Wi-Fi (Q11), HTTPS (Q10), and E2EE (Q9). For these topics the least differences existed between Germany and the other countries.
4.3.2 Demographics are Rather Small but Significant Predictors for Misconceptions.
For the demographic predictors age, gender, and education, we observed mixed results with age as a significant predictor for most cases (except for HTTPS) and gender as a significant predictor for only five misconception topics (E2EE, Wi-Fi, VPN, passwords and private browsing). Also the estimates for age were larger compared to gender and education.
Compared to younger participants, participants older than 25 were generally more likely to believe in misconceptions, with slightly larger estimates for older participants than for those between 25 − 39 years. Except for the topics malware and HTTPS, participants older than 25 were more likely to hold misconceptions than participants younger than 25. We observed highest estimates for the topics Wi-Fi and private browsing, with the biggest differences between very young (18-24) and older participants – the highest value was observed for participants 55+ (0.27). Participants older than 40 were less likely to believe in misconceptions regarding malware, compared to the young baseline.
Compared to men, women were more prone to hold misconceptions about E2EE, VPN, passwords, and private browsing. Misconceptions regarding Wi-Fi were found more frequently with men than women. Effects in all cases were – however – small.
Most estimate sizes for education were also rather small, with medium and low education as positive significant predictors for believing in misconceptions across topics, with an exception for Wi-Fi. We found no significant differences in believing misconceptions regarding end-to-end encryption and HTTPS between different levels of education. Participant with less than high education were less likely to believe in misconceptions regarding Wi-Fi. For the other misconceptions (VPN, passwords, device security, malware, private browsing), less than high education was associated with believing more in misconceptions.
For misconception statements related to HTTPS none of the demographic factors were significant predictors.
As shown in Table
2, we also considered device usage a demographic factors. The data showed only a few significant, but rather large estimates for the predictor device usage. Participants who used more than two of the listed devices were more likely to believe in misconceptions related to Wi-Fi than those who used none of the queried devices. Participants who used more than four devices were also more likely to believe in misconceptions regarding E2EE and VPN.
4.3.3 Experience with Cybercrime Predicts Disbelief in Misconceptions.
Our questionnaire assessed participants’ experiences with cybercrime (Q7) as well as their professional IT experience (Q25). Our data showed a positive association of prior cybercrime experience with believing less in misconceptions, whereas professional IT experience was a positive predictor for misconceptions. Prior experience with some sort of cybercrime (all participants indicating experience with at least one type of crime mentioned in Q7), was significantly associated with believing less in misconceptions about HTTPS, VPN, device security, malware, and private browsing. However, the estimate values were rather small (< 0.1). Contrary to this, we found that prior professional experience with IT predicted believing in misconceptions regarding HTTPS, VPN, passwords, device security, and malware, also with small estimates (< 0.1). Familiarity with security or privacy (Q7, Q25) does not predict misconceptions regarding the topics end-to-end encryption and Wi-Fi.
4.3.4 Protection of Devices and Data Predicts Disbelief in Misconceptions.
Questions Q17 and Q21 in our questionnaire both asked how important participants consider protecting their devices and data, e. g., from malware (Q17), and how important it is to them to protect specific data types, e. g., private photos. We found participants, who generally think it is important to protect their devices and data, were less likely to hold misconceptions regarding end-to-end encryption, passwords, device security, malware and private browsing. Participants who found it rather important to secure specific data types online were more likely to believe misconceptions of all topics, except for Wi-Fi. Despite their significance, both estimate values were rather small (< 0.1). Misconceptions regarding Wi-Fi were not predicted by protection importance as estimates for both question Q17 and Q21 are not significant.
4.3.5 Using Countermeasures Predicts Disbelief in Misconceptions.
Taking active measures for more privacy and security, like using end-to-end encryption, will increase users’ digital security and privacy but seeking information on these topics might also do so. Surprisingly, we found that participants who actively seek information on digital security were more likely to believe in misconceptions regarding all topics (except for Wi-Fi), than participants who did not look for this kind of information (baseline). Estimates were slightly higher than those for the aforementioned predictors, ranging from 0.08 (passwords Q13) to 0.13 (HTTPS Q10). However, we observed that using measures to stay safe online was a negative predictor for believing in most of the queried misconceptions, thus participants who took measures were less likely to believe misconceptions than those who did not take any security or privacy measures (baseline). These estimates were in the mid range compared to all estimate absolute values, ranging from − 0.09 to − 0.38. Most differences in believing in misconceptions existed between participants who did not take any security measures and those who took at least a moderate amount (5 or more) of protection measures, with highest negative estimates for the topics passwords (Q13) and malware (Q15). However on the contrary, participants taking moderate or many protection measures were more likely to hold misconceptions related to Wi-Fi (Q11) than those who took no such measures. Taking security and privacy protection measures was not a predictor for holding misconceptions regarding end-to-end encryption (Q9) and HTTPS (Q10).
4.3.6 Thinking Digital Security is Complicated Predicts Belief in Misconceptions.
The questionnaire also included questions on attitudes towards using digital security, that we grouped into three scales, see section
3.2.4 for details. Participants who agreed with more of the attitude statements, were also more likely to believe in misconceptions, regarding all misconception topics, except for the combination of participants having more attitudes related to E2EE and the misconceptions topic HTTPS. Participants who held attitudes like, e. g., end-to-end encryption is only for paranoid people and has more disadvantages than advantages were more likely to hold misconceptions across most topics. However, these effects were rather small, with estimates ranging from 0.03 to 0.12. Participants with these attitudes were less likely to believe misconceptions regarding HTTPS. We observed the highest estimates for attitudes related to third-party-interest in ones data. Participants who did not believe anybody was interested in their data and thus did not consider themselves at risk were more likely to believe misconceptions related to all topics, except for Wi-Fi. Participants who thought securing data and profiles was complicated, also tended to believe most misconceptions, but with smaller effects compared to the aforementioned attitudes (estimates < 0.1).
4.3.7 Being More Concerned Predicts Belief in Misconceptions.
We also queried participants about the amount of concern for different threats like data theft (Q18) and who they considered a risk to their security (Q22). We found that for both, participants who were more concerned and those who thought more groups pose a risk, to be more likely believing in almost all misconceptions. Participants who were more concerned (higher mean value Q18), were more likely to believe misconceptions regarding all topics, except for device security. Compared to other prediction factors, however, the estimate values were rather low (< = 0.1). Similarly, participants who viewed more groups of people (like hackers and companies) as risks for their digital security more likely believed misconceptions related to all queried topics (Q9-Q16), but only with slightly higher estimates (< = 0.14).