Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Translation and cross-cultural adaptation of the European Health Literacy Survey Questionnaire, HLS-EU-Q16: the Icelandic version

BMC Public Health volume 20, Article number: 61 (2020) Cite this article

Abstract

Background

Health literacy (HL) is defined as the knowledge and competences of people to meet the complex demands of health in modern society. It is an important factor in ensuring positive health outcomes, yet Iceland is one of many countries with limited knowledge of HL and no valid HL measurement. The aim of this study was to translate the European Health Literacy Survey Questionnaire- short version (HLS-EU-Q16) into Icelandic, adapt the version, explore its psychometric properties and establish preliminary norms.

Methods

The HLS-EU-Q16 translation model included three steps: 1) translation-back-translation of HLS-EU-Q16 including specialists’ review (n = 6); 2) cognitive interviewing of lay people (n = 17); and 3) psychometric analysis with survey participants. The HLS-EU-Q16 includes 16 items, with scores ranges from zero (low/no HL) to 16 (high HL). Statistics included were descriptive, internal consistency measured by Cronbach’s α, exploratory factor analysis, and multivariate linear regression.

Results

After the translation and cognitive interviewing, 11 of the HLS-EU-Q16 items were reworded to adapt the instrument to Icelandic culture while maintaining their conceptual objectives. Survey participants were 251. Internal consistency of the translated and adapted instrument was α = .88. Four factors with eigenvalues > 1.0 explained 62.6% of variance. Principal component analysis with Oblimin rotation presented four latent constructs, “Processing and Using Information from the Doctor” (4 items, α = .77), “Processing and Using Information from the Family and Media” (4 items, α = .85), “Processing Information in Connection to Healthy Lifestyle” (5 items, α = .76), and “Finding Information about Health Problems/Illnesses” (3 items, α = .73). Lower self-rated health was an independent predictor of lower HL (β = −.484, p = .008). Preliminary norms for HL ranged from five to 16 (M 13.7, SD ± 2.6) with 72.5% with sufficient HL (score 13–16), 22% with problematic HL (score 9–12) and 5.5% with inadequate HL (score 0–8).

Conclusions

The Icelandic version of HLS-EU-Q16 is psychometrically sound, with reasonably clear factor structure, and comparable to the original model. This opens possibilities to study HL in Iceland and compare the results internationally. The translation model introduced might be helpful for other countries where information on HL is missing based on lack of validated tools.

Peer Review reports

Background

Health literacy (HL), as a construct, was introduced within public health research almost 45 years ago [1] and since that time has become an increasingly relevant issue for global public health [2]. It has a broad and inclusive definition referring to “personal characteristics and social resources needed for individuals and communities to access, understand, appraise and use information and services to make decisions about health, or to have implications on health” [3]. HL represents a strong connection to social determinants of health and has been recognised as an important factor in ensuring positive health outcomes [4]. Although high HL does not entail empowerment [5], it is argued that that HL is critical to empowerment of people [6]. Based on this there is a need to improve public access to health information and people’s capacity to use it effectively.

Whereas HL has been researched for decades in native English-speaking countries, the field is still in its early stages in non-English speaking parts of Europe and is only marginally integrated in health research, policy and practice [7, 8]. However, HL gained relevance on the European Commission’s (EC) health agenda [9], and a working group, called the European Health Literacy (HLS-EU) Consortium, was established [10]. Based on content analysis, the HLS-EU Consortium developed an integrated conceptual model, capturing comprehensive evidence-based dimensions of HL, with definition of HL as “… people’s knowledge, motivation and competences to access, understand, appraise and apply health information …” [11]. The design and developmental process of the European Health Literacy Survey Questionnaire (HLS-EU-Q) was described in Sørensen et al. [10]. The Consortium’s work resulted in four versions of the questionnaire: [1] the core version (HLS-EU-Q47) [2]; the extended version Q86 (including additional 39 items relating to selected HL determinants and outcomes) [3]; the short version Q16 [12]; and short-short version Q6 [13]. Using the HLS-EU-Q86, in a survey of HL in eight countries in Europe (N = 8000), results indicated that subgroups within the population, defined by financial deprivation, low social status, low education, or old age, had higher proportions of people with limited HL [14]. The results demonstrated that the questionnaire was useful for identifying strengths and weaknesses in HL levels, both within and between countries [14]. In a critical review of population HL assessments, it was noted that the HLS-EU-Q differs from most others HL assessment tools as it is designed to measure HL of general populations rather than specific patient groups. However, an acknowledged limitation of the HLS-EU-Q is a continued emphasis on healthcare and disease prevention and less on health promotion [15].

The number of self-report questionnaires has increased rapidly [16] as has the growth in adapting health status measures to other languages and cultures [17]. Due to Iceland’s population of only 350,000 people, approximately [18], assessment tools are not commonly developed specifically for Icelandic circumstances. A more common approach is to translate and adapt foreign tools to the Icelandic context with a translation-back-translation procedure or with a specialist’s review [19]. Both methods have been criticised, mostly for leaving out the process where lay people respond to the instrument [20]. The term Cross-Cultural Adaptation (CCA) describes the process of viewing both language and cultural issues in preparing a questionnaire for use in another setting [17, 21]. A review of 31 different CCA methods [16] demonstrated that many different recommendations do exist, but a formal standard has not been established, and universal consensus on all aspects of the process has not been reached. As HL has been defined in an inclusive way, meaning it is more than transmitting information and is related to empowerment of lay people, the translation and adaptation of HL instruments should emphasise participation by the people they are intended for. As a part of the cross-cultural adaptation procedure, cognitive interviews are becoming increasingly important [20]. Cognitive interviews are methods to identify problematic survey items by asking research participants to report what is going through their mind, either during or after responding to the survey. The technique helps analyse the manner in which respondents understand, mentally process, and ultimately respond to the presented materials [20, 22]. The cognitive interview technique is reported to be useful when translating questionnaires to other languages [23], and the validity of the technique has been supported when identifying linguistic problems in the questionnaire’s items [24].

There is limited knowledge on HL in Iceland and no validated instruments are available. The increasing interest in HL in the general population worldwide and across Europe supports the demand for HL measurements in Icelandic. Thus, the aim of our study is to translate the European Health Literacy Survey Questionnaire- short version (HLS-EU-Q16) into Icelandic, adapt the version, explore its psychometric properties and establish preliminary norms.

Methods

Study design and setting

The HLS-EU-Q16 translation model included three basic steps. In step one, the questionnaire was translated and back- translated with a specialists’ committee review. In step two, 17 lay people responded to the questionnaire in cognitive interviews. In step three, the final Icelandic version of the questionnaire (HLS-EU-Q16-IS) was validated in a stratified random sample, drawn from the Icelandic national registry, including 11 background questions added by the researchers. This same general sample of Icelandic adults was used to establish preliminary norms for health literacy based on HLS-EU-Q16-IS. A permission for the translation was obtained from the HLS-EU-Q project leader and the Icelandic Data Protection Authority was informed about the study.

Instrument

The HLS-EU-Q16 is one of four questionnaires that resulted from analysis of HLS-EU-Q data from a large, cross-national survey of EU citizens using Eurobarometer methodology [10, 12] where data was collected by using either computer-assisted personal interviews or paper-assisted personal interviews [14]. The original HLS-EU-Q item selection was guided by a conceptual model of HL, which identifies four competencies related to managing health information (find, understand, appraise, and apply) in three domains (health care, disease prevention, and health promotion). These four competencies in three domains were used to create a four by three HL-EU matrix, including 12 cells with unique content for HL [10, 12, 14]. The 16 items in the HLS-EU-Q16 questionnaire were selected as they represent well 11 out of the 12 cells in this HL-EU matrix and at the same time present good psychometric properties. The construct validity of this 16-item scale has been established in all eight HLS-EU study participating countries, based on Rasch modelling for content- and face validity criteria [25]. In Italy e.g. computer-assisted telephone interviews were used in the validation process of the Q16 version [26]. All four HLS-EU-Q questionnaires use the same four response categories for each item. However, when scoring the HLS-EU-Q16, the categories; “very difficult”, “fairly difficult”, “fairly easy” and “very easy” are dichotomized into “easy” (scored with 1) and “difficult” (scored with 0). Summing these responses gives a HLS-EU-Q16 final score that can range from 0 (low/no HL) to 16 (high HL). Missing responses are replaced with 0, given that no more than two responses are missing. For interpretation of the final score on the scale, three levels have been defined: Inadequate HL (0–8), Problematic HL [9,10,11,12], and Sufficient HL [13,14,15,16] [13, 25]. The HLS-EU-Q16 was selected for translation and adaptation because it is short, easy to administer and is one of few HL instruments designed to measure HL of general populations rather than specific patient groups.

Participants and sampling method

For the first step of the research, four people were selected for the translation of the questionnaire and six people to create a specialist committee to review translations of the questionnaire twice in the process. Two of those participating in the translations came from the specialists committee and two were hired from outside because of their experience in health related translations. Members of the specialist committee were selected based on their field of specialty to create a multi-disciplinary group within health and social sciences.

To access lay people, for the cognitive interviewing in the second step of this research, administrators of two public institutions, each with 70–80 employers, were contacted in January and February 2017. The institutions were chosen, as they were not in the field of health-related service but in education and social welfare, and were known to have employers with various educational levels. The administrators forwarded, by e-mail, an introduction letter provided by the researchers to their respective employees with general information about the study and information about the right not to participate or to withdraw from the study at any time. Those willing to participate were asked to contact the administrator who forwarded the information on to the researchers. Initially, only one round was planned with 12 people. Because of new information received after the first round, it was decided to add another round. For the first round, 15 were willing to participate and 12 were selected according to the criteria for equal gender, age groups (18–45, 46–64, and 65–85) and educational level distribution (elementary, secondary or university degree). For the second round, five were willing to participate and were selected.

Participants in the validation process (step three) were a part of a stratified random sample of 1200 Icelanders, drawn from the Icelandic National Registry. The sample was stratified according to age, gender and place of living. Inclusion criteria was to be between 18 and 85 years old and registered with a home address in Iceland. People living in nursing homes were excluded. Due to name and address not matching, 91 questionnaires were returned. Therefore, the intended sample size was 1109.

The translation model

Translation of the instrument

The translation and adaptation process are described in Table 1. The original validated English version of the HLS-EU-Q16 was translated into Icelandic by authors 1 and 2, based on recommendations from Beaton et al. [17]. The two authors are fluent (which includes knowing colloquial phrases, jargon, idiomatic expressions, etc.) in the source language, and the target language is their native tongue. Both are familiar with source and target cultures, both have lived and studied in an English speaking country, and both have some knowledge in the content of the instrument. After discussion between the researchers, and with a review from the specialists’ committee, the two versions were combined into one Icelandic version that was translated back into English by two translators. The two back translators are native speakers of the source language and are fluent in the target language. Both back translators have lived and worked in both source and target cultures but are unfamiliar with the content of the instrument. The English back-translated versions were combined into one by the researchers and compared with the original HLS-EU-Q16. Minor discrepancies were addressed based on consensus. Based on these differences, another consultation with the specialists´ committee took place before the final version, for the cognitive interview process, was made.

Table 1 Translation and adaptation process of the instrument
Full size table

Cognitive interviewing

The cognitive interviews took place at the workplace or at a given participant’s home, depending on their preference. The interviews lasted from 12 to 35 min (average – 25 min), were tape-recorded, and a written summary was made after each interview. Both the think-aloud interview method and the verbal-probing technique were used [20, 22]. The think-aloud part involved participants responding to the questionnaire in writing, while being asked to think out loud about what was going through their mind while responding to each item. This was to help the researcher capture participants’ understanding of each item, and to determine if they were struggling to understand the wording or comprehend the meaning of each item. As a follow-up to the think-aloud procedure, participants were also given verbal probes about: [1] their understanding and interpretation of specific items or ideas [2]; how they would rephrase items [3]; why they answered them the way they did; and [4], generally speaking, how easy or difficult it was to answer the items. After the first and second round of cognitive interviews, authors 1, 2 and the research assistant held a consultation meeting where summaries from the interviews were reviewed and the questionnaire changed accordingly. The goal of the second round of interviews was to get an opinion from individuals who had not seen the questionnaire, to confirm that there were no additional issues or comments on wording.

Validity testing of instrument

For the instrument validation, mode of data collection varied depending on the participant’s age. The intention was to maximise the response rate, by targeting each generation in the most user friendly way, yet within the surveys budget and timeframe. All intended participants were mailed an introduction letter along with the HLS-EU-Q16 Icelandic version and 11 background items. The background items were on age, gender, education, income and perception of own general health. For participants in the 18–64 age group (n = 990), the introduction letter included a QR code and a web URL so they could answer the questionnaire by computer-assisted (electronic) self-administration method. In the 65–85 age group (n = 210), the introduction letter included a questionnaire for a traditional paper and pencil self-administration and a prepaid response envelope. In addition, the information letter stated that they would receive a phone call from the researcher if the researcher had not received their answers in three weeks, so they would have the opportunity to answer the list by phone, a computer-assisted telephone interview. For that purpose, questionnaires for this age group were numbered. After four weeks, the response rate in the 18–64 years age group was low (< 20%) compared to over 60% in the 65–85 age group. Therefore, every fifth participant in the 18–64 age group was phoned and offered to answer the questionnaire by computer-assisted telephone interview or by computer-assisted (electronic) self-administration method (web-URL).

Analysis of survey data

Descriptive statistics for the background of all survey participants (n = 251) included mean (M) and standard deviation (SD) for continuous variables and counts and proportions for categorical variables. Descriptive statistics were also used to present the preliminary norms on HLS-EU-Q16-IS by gender and age group.

A Principal Component Analysis (PCA) was conducted for structural analysis of the HLS-EU-Q16-IS, using an Oblimin rotation. In addition, a linear multivariate regression model was used to analyse the association between HL (dependent variable) and potential influencing factors (independent variables). The independent variables were selected for the model based on a significant bivariate correlation with HL. Statistical analyses were run with the IBM SPSS software package, v. 22 [27].

Results

Translation and adaptation based on cognitive interviewing

In the translation process, small differences were found in syntax and grammar between the forward and back translations of the questionnaire. The items were, however, semantically equivalent. The specialists´ committee reflected and reviewed translations and made critical decisions on “mental health” in item 8 and 13, “health warnings” in item 9 and “health screenings” in item 10 and about the role of pharmacist in different cultures connected to item four.

The translation process was followed by the first round of cognitive interviews with lay people including six women and six men, age range from 20 to 74 (Mean = 51 and SD ± 19.55) years. For the second round, four women and one man, age range 26 to 65 (Mean = 55 and SD ± 11.12) years participated. Eleven items of 16 in the HLS-EU-Q16-IS were changed after the two rounds of analyses following the cognitive interviews. The items appeared to become simpler and clearer as well as becoming more applicable to lay Icelandic language. After the analysis of responses, we also changed the appearance of the instructions for the questionnaire, switching the order of the responses to the scale’s items, starting with “very easy” instead of “very difficult”. Participants felt it important to have the most positive response the first one. A comprehensive overview of changes in the items of the questionnaire after the two rounds and consultation of researchers are shown in Table 2. As an example of minor changes in wording; in item 1, we replaced the medical term for “treatment” with a more general term which expresses wider variety of interventions. An example of a considerable change in wording is found in item 7, “… follow instructions from your doctor or pharmacist”. In the Icelandic version, the “pharmacist” was dropped because of cultural differences.

Table 2 Changes in wording of items due to cognitive interviewing
Full size table

Survey participants

A total of 268 participants completed the survey form (response rate 24%), 119 on paper, 28 per phone and 121 per web URL. However, 17 participants had to be excluded because of more than two missing items on HLS-EU-Q16-IS. A total of 251 participants completed the questionnaire, age 18 to 85 years (Mean = 55, ±SD 18.98) and 52% women. The response rate was higher in the 65–85 age group compared to the 18–64 age group. Icelandic was the first language of 92.8% (233/251) of participants and the majority (72.5%; 182/251) lived in South Iceland, including the capital area. To gauge for potential hidden nesting effects due to response rates, sampling methods and geographic location of respondents, an intraclass coefficient (ICC) was calculated. The mean ICC for single measures was .322, indicating that the sample was not more homogeneous than if it had been drawn from a non-stratified sample. See Table 3 for characteristics of survey participants.

Table 3 Characteristics of the instrument testing sample (n = 251)
Full size table

Validity testing of instrument

Table 4 shows responses to individual items by response options on the HLS-EU-Q16-IS, including missing values and skewness/kurtosis values for each item. Overall, missing values were few, the highest count of which was nine, on item 8.

Table 4 Responses to individual items on the HLS-EU-Q16-IS (n = 251)
Full size table

Internal consistency for the HLS-EU-Q16-IS questionnaire was α = .88. The KMO value was .86, supporting the sampling adequacy for the analysis [28, 29]. Bartlett’s test of sphericity (χ2 = 1436.930, df = 120, p < 0.001) indicated that correlations in the correlation matrix did not occur by chance, and that correlation between items were sufficient for the analysis. The final data reduction model chosen for the current analysis was a Principal Component Analysis (PCA) with an Oblimin rotation. An initial analysis was run to obtain eigenvalues for each component in the data. Four components (eigenvalues 5.94, 1.62, 1.38 and 1.05) explained 62.6% of the variance. The scree plot indicated that the optimal solution consists of two to four components depending on how the plot is interpreted. The items´ loadings after rotation are illustrated in Table 5 with Cronbach’s alpha for each subscale. The items that cluster on the same factor suggest that component 1 (items: 3, 5, 6, 7 and α = .77) represents “Processing and Using Information from the Doctor”; component 2 (items: 11, 12, 14, 15 and α = .85) represents “Processing and Using Information from the Family and Media”; component 3 (items: 4, 9, 10, 13, 16 and α = .76) represents “Processing Information in Connection to Healthy Lifestyle”; and component 4 (items: 1, 2, 8 and α = .73) represents “Finding Information about Health Problems/Illnesses”. Component 1, “Processing and Using Information from the Doctor” had the highest internal consistency of the subscales that appeared in the current PCA. The corrected item-total correlation in each subscale was high as all items received correlation of .40 or higher, with a range from .47 to .85. Deleting items from subscales did not affect the internal consistency of the subscales.

Table 5 Component loadings of the HLS-EU-Q16-IS, after Oblimin rotation (n = 251)
Full size table

There were positive relationships among HL score and [1] education (r = .144, p = 0.037), [2] income per month (r = .167, p = 0.016), [3] having enough income after tax to fulfil needs (r = .205, p = 0.003), and a negative relationship between HL score and self-rated health (r = −.263, p = 0.001). No correlation between HL and age was found. A multivariate linear regression was conducted to analyse association between HL (dependent variable) and education level, income per month, having enough income to fulfil needs, and self-rated health (independent variables). A statistically significant regression relationship was found (F (4, 193) = 5.484, p < .001), with an R2 of .102. Self-rated health was the only statistically significant predictor of HL (β = −.484, p = .008.).

Preliminary norms

Preliminary norms for HL were established in a general population of Icelanders. In this sample the scores ranged from 5 to 16, the mean was 13.7 (SD = ± 2.6) and the median 14. In Table 6, descriptive findings on HL score divided by gender and age groups are shown. There were 182 individuals (72.5%) that scored from 13 to 16 indicating sufficient HL, 55 (22%) scored from 9 to 12, which has been defined as problematic HL, and 14 (5.5%) scored from 0 to 8, indicating inadequate HL.

Table 6 HL score distribution within gender and age groups
Full size table

Discussion

Our results indicate that, after translating and adapting the HLS-EU-Q16 to Icelandic, the HLS-EU-Q16-IS is a valid instrument, ready to be used in Iceland, and opening possibilities to study HL in Iceland and compare the results internationally.

In our view, to be consistent with the broad and inclusive definition of HL, we felt that lay people should be participants in the process. The cognitive interviewing using lay people was an important step in the translation process, which eventually led to the Icelandic version of HLS-EU-Q16. Although the specialist review turned out to be essential regarding accepted language within the health- and social setting, the cognitive interviewing gave vital information about the understanding of actual people who might answer the questionnaire. It also provided lay people an opportunity to influence the adaptation process. This was, for example, useful in the wording of items connected to culturally sensitive things, such as mental health and illness. Not only did the wording of items change with cognitive interviewing, but it also prompted the researchers to reverse the response scale, starting with “very easy” instead of “very difficult” as in the Swedish version [30]. Epstein et al. [16] has pointed out that currently there is no consensus on cross-cultural adaptation procedure. However, researchers suggest [24], the importance of including the target audience when translating questionnaires to another language.

The Icelandic version of HLS-EU-Q16 exhibited high internal consistency, with Cronbach’s α = .88, which is in line with results from the German version of the instrument [31]. The four components yielded by the PCA (Table 5) had internal consistency from α = .73 for component 4 to α = .85 for component 2. It should be noted that with a list of 16 items, lower internal consistency could be expected, so these results are quite acceptable. The PCA yielded a reasonably defined structure, and only item 4 loaded on more than one component (Table 5) ( “… understand your doctor’s or pharmacist’s instruction on how to take prescribed medicine?” loaded on components 1 and 3). This is possibly because participants perceived taking one’s prescribed medicine as a part of a healthy lifestyle, in addition to reflecting their interaction with the doctor. Another explanation could be that the word “pharmacist” was removed from item 7 in the Icelandic version but not in item 4. In the Icelandic culture, doctors and nurses play a dominant role in instructing people on how to take their medicine, whereas pharmacists play a negligible one.

In our principal component analysis, the fourth component includes items representing the competency to find health related information (Table 5). The other three components represented more than one competency in the original Sørensen’s et al. [10] model. This might indicate that finding health-related information is more salient for the Icelandic sample than, for example, understanding and appraising health-related information. The three domains of health care, disease prevention and health promotion are not indistinct in the current analysis. Component 1 includes only items within the health care domain and component 4 includes two of three items within that domain. Component 2 includes items from two domains and component 3 includes items within every three domains. This indicates subtle differences in how the Icelandic samples responds to those items and the original model. As previously reported, the HLS-EU-Q instrument has received critique for its continued emphasis on healthcare and disease prevention over health promotion [15]. The findings from our current PCA indicate that the four health promotion domain items do not cluster together as they did in the original version [10]. Considering the above, it is reasonable to conclude that the domains do not manifest in the same way across the cultures, comparing our study and the work of Sørensen et al. [10]. Our approach of using PCA seems relatively unique, yet, as PCA is an empirical technique, it should be well suited for analysis of cultural differences in item understanding of populations. While Confirmatory Factor Analysis seems more commonly used than a PCA or Exploratory Factor Analysis for validation of the HLS-EU-Q (e.g. [32,33,34]), exploratory techniques such as an EFA or PCA are nevertheless used in the field. For example, Sukys et al. [35] used an EFA to assess the factor structure of the healthcare, disease prevention, and health promotion domains for the HLS-EU-Q47.

The results from the current study demonstrated a relative high score in HL, compared to the European study [14], and limited HL was connected to people with lower education and income, while a negative correlation was seen between self-rated health as predictor of HL. People with lower education have been found to have lower health literacy in comparison to people with higher education [14, 36]. Interestingly, no negative correlation was discovered between age and HL in the current study, as previous studies from Europe, Australia and Asia have reported [14, 34, 37]. In a Danish national study [38], results indicated that people age 45–65 have less difficulty in understanding and engaging actively with healthcare providers, than those between the ages of 25 and 45. Attention is drawn to the necessity to look at HL also in connection to what kind of health care systems are provided in each country, and that, for example, Nordic counties with similar universal health care systems could more easily be compared together than counties with different systems. The current research is based on a sample of 251 people within a nation with approximately 350,000 inhabitants, a relatively large proportion compared to counties with larger populations. In addition, our sample was stratified according to age, gender and place of living and socio-demographic data of the respondents did not indicate difference from the general population. Therefore, our results may offer preliminary norms or benchmarks that can inform future surveys in countries with comparable health systems.

Limitations

The low participation rate, 24%, (step three of the validation process of the instrument) is of some concern and a limitation to this study. However, the overall number of participants reached is acceptable within the frame of the statistical analysis used, and an intraclass correlation of .322 indicated that the assumption of independence was not violated. The reasons for the low participation rate can only be speculated upon, especially among people between the ages of 18 and 59. This age group had a participation rate of 40% (Table 3), compared to almost 55% in the 60–85 age group. We used diverse administration modes, a traditional paper and pencil self-administration by post, computer-assisted telephone interviews and computer-assisted electronic self-administration method (web URL). The impact of administration mode on response effects has been reported as well as the difficulty to separate out such effects [39, 40]. Although self-administered questionnaires are considered to have many benefits the mode has also been criticised for, among other things, to have a high cognitive burden and not offering additional explanations [39, 40]. The different administration modes in our study can be regarded as a limitation for between-studies comparison. However, by conducting cognitive interviews among lay people a step was taken to limit this effect.

Survey response rates have been declining over the past decade and there are indications that web-based questionnaires could be an alternative platform to reach higher participation rates in population surveys, compared to paper questionnaires [41]. An attempt was made to make answering more appealing or acceptable to people by offering a QR code. However, that option might be more used by younger people, under the age of 30.

Conclusions

The findings indicated that the Icelandic version of HLS-EU-Q16 is psychometrically sound, with a reasonably clear factor structure, and comparable to the original model. This opens possibilities to study HL in Iceland, gradually add to a database, which now includes preliminary norms, and compare the results internationally. The specialist review and cognitive interviewing provided essential additional information to the translation-back-translation procedure. This translation model might be helpful for other countries where information on HL is missing based on lack of validated tools. We believe that this instrument will become valuable in a future cross-cultural research on HL among the public.

Availability of data and materials

The datasets used and/or analysed during the current study and the Icelandic version of the questionnaire are available from the corresponding author on reasonable request.

Abbreviations

CCA:

Cross-Cultural Adaptation

EC:

European Commission

HL:

Health literacy

HLS-EU-Q:

The European Health Literacy Survey Questionnaire

HLS-EU-Q16:

The European Health Literacy Survey Questionnaire- short version

ICC:

Intraclass correlation coefficient

PCA:

Principal Component Analysis

References

  1. Simonds KS. Health education as a social policy. Health Education Monograph. 1974;2:1–25.

    Article  Google Scholar 

  2. Altin SV, Finke I, Kautz-Freimuth S, Stock S. The evolution of health literacy assessment tools: a systematic review. BMC Public Health. 2014;14(1):1207.

    Article  PubMed  PubMed Central  Google Scholar 

  3. World Health Organization. Optimizing health literacy: Improving health and reducing health inequities. World Health Organization, Regional Office for South-East Asia. 2015. http://www.who.int/iris/handle/10665/205594. Accessed 15 Sept 2018.

  4. World Health Organization. Policy brief 4: health literacy. Global conference on health promotion. World Health Organization. 2016. https://www.who.int/healthpromotion/conferences/9gchp/policy-brief4-health-literacy.pdf. Accessed 15 Sept 2018.

  5. Schulz PJ, Nakamoto K. Health literacy and patient empowerment in health communication: the importance of separating conjoined twins. Patient Educ Couns. 2013;90(1):4–11.

    Article  PubMed  Google Scholar 

  6. Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promot Int. 2000. https://0-doi-org.brum.beds.ac.uk/10.1093/heapro/15.3.259.

    Article  Google Scholar 

  7. Sørensen K, Brand H. Health literacy lost in translations? Introducing the European health literacy glossary. Health Promot Int. 2014;29(4):634–44.

    Article  PubMed  Google Scholar 

  8. Mårtensson L, Hensing G. Health literacy – a heterogeneous phenomenon: a literature review. Scand J Caring Sci. 2012;26(1):151–60.

    Article  PubMed  Google Scholar 

  9. Commission of the European Communities. Together for health: a strategic approach for the EU 2008–2013. White paper. Commission of the European Communities. 2007. https://ec.europa.eu/health/sites/health/files/policies/docs/whitepaper_en_0.pdf. Accessed Aug 2018.

  10. Sørensen K, Van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, et al. Measuring health literacy in populations: illuminating the design and development process of the European health literacy survey questionnaire (HLS-EU-Q). BMC Public Health. 2013;13(1):948.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012. 10:1186/1471–2458-12-80.

  12. The HLS-EU Consortium. Measurement of health literacy in Europe: HLS-EU-Q47; HLS-EU-Q16; and HLS-EU-Q86. Health Literacy Project 2009–2012. The HLS-EU Consortium 2012. http://www.forumitesss.com/wp-content/uploads/2015/02/HLS-EU-Q-tools-and-introduction-2.pdf. Accessed 26 Sept 2016.

  13. Pelikan JM, Röthlin F, Ganahl, K. Measuring comprehensive health literacy in general populations: validation of instrument, indices and scales of the HLS-EU study. Ludwig Boltzmann Institute Health Promotion Research, Vienna, Austria. 2014.

  14. Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Pub Health. 2015. https://0-doi-org.brum.beds.ac.uk/10.1093/eurpub/ckv043.

    Article  PubMed  PubMed Central  Google Scholar 

  15. Guzys D, Kenny A, Dickson-Swift V, Threlkeld G. A critical review of population health literacy assessment. BMC Public Health. 2015;15(1):1551.

    Article  Google Scholar 

  16. Epstein J, Santo RM, Guillemin F. A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. J Clin Epidemiol. 2015;68(4):435–41.

    Article  PubMed  Google Scholar 

  17. Beaton DE, Bombardie C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25:3186–91.

    Article  CAS  PubMed  Google Scholar 

  18. Statistics Iceland. Population - key figures 1703-2019. Statistics Iceland 2018. https://px.hagstofa.is/pxen/pxweb/en/Ibuar/Ibuar__mannfjoldi__1_yfirlit__yfirlit_mannfjolda/MAN00000.px/table/tableViewLayout1/?rxid=ef9a7ba9-90b7-48e9-a844-c3de59d1eb5b. Accessed 17 July 2018.

  19. Guðmundsson, E. Þýðing og staðfærsla sálfræðilegraprófa. Sálfræðiritið. 2005–2006; 10.-11:23–40.

  20. Beatty PC, Willis GB. Research synthesis: the practice of cognitive interviewing. Public Opin Q. 2007; doi.org/https://0-doi-org.brum.beds.ac.uk/10.1093/poq/nfm006.

    Article  Google Scholar 

  21. Hambleton RH, Merenda PF, Spielberger CD. Adapting educational and psychological tests for cross-cultural assessment. Mahwah, New Jersey 07430: Lawrence Erlbaum Associates; 2005.

  22. Willis GB. Cognitive interviewing: a tool for improving questionnaire design. Thousand Oaks, California 91920: Sage Publications; 2005.

  23. Goerman PL, Caspar RA. A preferred approach for the cognitive testing of translated materials: testing the source version as a basis for comparison. Int J Soc Res Methodol. 2010;13(4):303–16.

    Article  Google Scholar 

  24. Park H, Sha MM, Pan Y. Investigating validity and effectiveness of cognitive interviewing as a pretesting method for non-English questionnaires: findings from Korean cognitive interviews. Int J Soc Res Methodol. 2014;17(6):643–58.

    Article  Google Scholar 

  25. Rötlin F, Pelikan JM, Ganahl K. Die gesundheitskompetenz der 15-jåhrigen jügendlichen in Österreich. Abschlussbericht der österreichischen gesundheitskompetenz jugendstudie im auftrag des hauptverbands der österreichischen Sozialversicherungsträger (HVSV). 2013; http://www.hauptverband.at/cdscontent/load?contentid=10008.597350&version=1395738807. Accessed 26. Sept 2018.

  26. Lorini C, Santomauro F, Grazzini M, Mantwill S, Vettori V, Lastrucci V, et al. Health literacy in Italy: a cross-sectional study protocol to assess the health literacy level in a population-based sample, and to validate health literacy measures in the Italian language. BMJ Open. 2017;7(11):e017812.

    Article  PubMed  PubMed Central  Google Scholar 

  27. IBM Corporation. IBM SPSS Statistics for Windows, version 22.0. IBM Corporation, New York; 2013.

  28. Field A. Discovering statistics using SPSS. 3rd ed. Los Angeles: Sage; 2009.

    Google Scholar 

  29. Tacq J. Multivariate analysis techniques in social science research. London: Sage; 1997.

    Google Scholar 

  30. Wångdahl J, Lytsy P, Mårtensson L, Westerling R. Health literacy among refugees in Sweden - a cross-sectional study. BMC Public Health. 2014. https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2458-14-1030.

  31. Tiller D, Herzog B, Kluttig A, Haerting J. Health literacy in an urban elderly east-German population - results from the population-based CARLA study. BMC Public Health. 2015;15(1):883.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Duong TV, Aringazina A, Baisunova G. Nurjanah, Pham TV, Pham KM, et al. measuring health literacy in Asia: validation of the HLS-EU-Q47 survey tool in six Asian countries. J Epidemiol. 2017;27(2):80–6.

    Article  PubMed  Google Scholar 

  33. Nguyen TH, Paasche-Orlow MK, Kim MT, Han HR, Chan KS. Modern measurement approaches to health literacy scale development and refinement: overview, current uses, and next steps. J Health Commun. 2015;20(Suppl 2):112–5.

    Article  PubMed  Google Scholar 

  34. Duong VT, Lin I-F, Sorensen K, Pelikan JM, Van Den Broucke S, Lin Y-C, et al. Health literacy in Taiwan: a population based study. Asia Pac J Public Health. 2015;27(8):871–80.

    Article  PubMed  Google Scholar 

  35. Sukys S, Cesnaitiene VJ, Ossowsky ZM. Is health education at university associated with students' health literacy? Evidence from cross-sectional study applying HLS-EU-Q. Biomed Res Int. 2017. https://0-doi-org.brum.beds.ac.uk/10.1155/2017/8516843.

    Article  Google Scholar 

  36. Kickbusch I, Pelikan JM, Apfel F. Health literacy: the solid facts. Copenhagen: World Health Organization, Regional Office for Europe; 2013. http://www.euro.who.int/__data/assets/pdf_file/0008/190655/e96854.pdf. Accessed July 2018

    Google Scholar 

  37. Barber MN, Staples M, Osborne RH, Clerehan R, Elder C, Buchbinder R. Up to a quarter of the Australian population may have suboptimal health literacy depending upon the measurement tool: results from a population-based survey. Health Promot Int. 2009;24(3):252–61. https://0-doi-org.brum.beds.ac.uk/10.1093/heapro/dap022.

    Article  PubMed  Google Scholar 

  38. Bo A, Friis K, Osborne RH, Maindal HT. National indicators of health literacy: ability to understand health information and to engage actively with healthcare providers - a population-based survey among Danish adults. BMC Public Health. 2014;14(1):1095.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Bowling A. Mode of questionnaire administration can have serious effects on data quality. J Public Health. 2005;27(3):281–91.

    Article  Google Scholar 

  40. Schwarz N, Strack F, Hippler H, Bishop G. The impact of administration mode on response effects in survey measurement. Appl Cognitive Psych. 1991;5(3):193–212.

    Article  Google Scholar 

  41. Hohwu L, Lyshol H, Gissler M, Jonsson SH, Petzold M, Obel C. Web-based versus traditional paper questionnaires: a mixed-mode survey with a Nordic perspective. J Med Internet Res. 2013;15(8):e173.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all the participants in the study, our research assistant Gudrun Heida Kristjansdottir for her contribution to the data collection process and Abigail Grover Snook for her contribution to English proofreading.

Open access

This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Funding

This work was supported by a grant from the University of Akureyri research fund. The funding bodies had no role in the design, data collection, data analysis, data interpretation, or writing of the manuscript.

Author information

Authors and Affiliations

  1. Faculty of Health Science, University of Akureyri, Solborg, Nordurslod 2, 600, Akureyri, Iceland

    Sonja Stelly Gustafsdottir & Arun K. Sigurdardottir

  2. Akureyri Hospital, Eyrarlandsvegi, 600, Akureyri, Iceland

    Arun K. Sigurdardottir

  3. Department of Physical Therapy, Faculty of Medicine, University of Iceland, Saemundargotu 2, 102, Reykjavik, Iceland

    Solveig A. Arnadottir

  4. Faculty of Psychology, University of Akureyri, Solborg, Nordurslod 2, 600, Akureyri, Iceland

    Gudmundur T. Heimisson

  5. Health and Rehabilitation at Institute of Neuroscience and Physiology, University of Gothenburg, 455, Arvid Wallgrens Backe, hus 2, 405 30, Gothenburg, Sweden

    Lena Mårtensson

Authors
  1. Sonja Stelly Gustafsdottir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Arun K. Sigurdardottir
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Solveig A. Arnadottir
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gudmundur T. Heimisson
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lena Mårtensson
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SSG analysed, interpreted the data, and wrote the manuscript. AKS was the study guarantor, a grant holder and a senior statistician, contributed to interpretation of data, drafting and revising the manuscript. SAA contributed to interpretation of data, drafting and revising the manuscript. GTH contributed statistical analysis and revising the manuscript. LM contributed to drafting and revising the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Sonja Stelly Gustafsdottir.

Ethics declarations

Ethics approval and consent to participate

According to information from The Icelandic National Bioethics Committee, after an inquiry, no part of this project needed ethical approval in Iceland. The Icelandic Data Protection Authority needed however to be notified about the project. Formal notification was sent to The Icelandic Data Protection Authority in January 2017, which processed the notification without any remarks. Written informed consent was obtained from participants in the cognitive interviews. Survey participants in the third part of the project, received an introduction letter about the purpose and nature of study and provided consent for participation by answering the questionnaire.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gustafsdottir, S.S., Sigurdardottir, A.K., Arnadottir, S.A. et al. Translation and cross-cultural adaptation of the European Health Literacy Survey Questionnaire, HLS-EU-Q16: the Icelandic version. BMC Public Health 20, 61 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-020-8162-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-020-8162-6

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us