This article has Open Peer Review reports available.
Factors affecting acceptability of an email-based intervention to increase fruit and vegetable consumption
© Kothe and Mullan; licensee BioMed Central Ltd. 2014
Received: 28 May 2014
Accepted: 22 September 2014
Published: 30 September 2014
Fresh Facts is a 30-day email-delivered intervention designed to increase the fruit and vegetable consumption of Australian young adults. This study investigated the extent to which the program was acceptable to members of the target audience and examined the relationships between participant and intervention characteristics, attrition, effectiveness, and acceptability ratings.
Young adults were randomised to two levels of message frequency: high-frequency (n = 102), low-frequency (n = 173). Individuals in the high-frequency group received daily emails while individuals in the low-frequency group received an email every 3 days.
Individuals in the high-frequency group were more likely to indicate that they received too many emails than individuals in the low-frequency group. No other differences in acceptability were observed. Baseline beliefs about fruit and vegetables were an important predictor of intervention acceptability. In turn, acceptability was associated with a number of indicators of intervention success, including change in fruit and vegetable consumption.
The findings highlight the importance of considering the relationship between these intervention and participant factors and acceptability in intervention design and evaluation. Results support the ongoing use of email-based interventions to target fruit and vegetable consumption within young adults. However, the relationships between beliefs about fruit and vegetable consumption and acceptability suggest that this intervention may be differentially effective depending on individual’s existing beliefs about fruit and vegetable consumption. As such, there is a pressing need to consider these factors in future research in order to minimize attrition and maximize intervention effectiveness when interventions are implemented outside of a research context.
In Australia, it is recommended that adults consume at least two servings of fruit and five of vegetables daily . As in most other developed countries , consumption is low across the population and young adults have particularly low levels of consumption [2–4]. Many young people cannot correctly report the guidelines for fruit and vegetable consumption and hold misconceptions which are likely to lessen their ability to meet recommendations .
Fresh Facts is a 30-day email-based program designed to increase Australian young adults’ fruit and vegetable intake [6–8]. The intervention is based on the theory of planned behaviour TPB; [9, 10] and has previously been shown to be successful in bringing about increases in individual’s attitudes towards eating fruit and vegetables and in increasing the perceived social pressure to consume fruit and vegetables .
Comparison between Fresh Facts (15 day) and Fresh Facts (30 day)
Fresh Facts (15 day)
Fresh Facts (30 day)
Perceived behavioural control
Perceived behavioural control, attitude, subjective norm
Total number of intervention messages
Intervention messages per email
HTML and Text
HTML and Text
Images included in emails
Participants and procedure
Data were collected from undergraduate students enrolled in an introductory psychology course at an Australian University. Students received course credit for participation in the study. All aspects of the study occurred online and could be completed from any computer with internet access. Written informed consent for participation was obtained from all participants, who were all adults aged 18 years and older.
Participants were randomly assigned to one of three groups: (1) low-frequency intervention (2) high-frequency intervention or (3) control. The acceptability data included in this manuscript was drawn from two studies that sought to assess the efficacy of the Fresh Facts intervention [7, 8]. The results of both studies have been published elsewhere [7, 8]. The second of these studies included a control group (who received no intervention emails). Participants randomised to that group did not complete any measure of intervention acceptability and so were not included in the analyses reported in this manuscript. As such, this study includes individuals randomised to either intervention condition in either of the Fresh Facts efficacy studies. Both studies were approved by the University Human Research Ethics Committee.
Participants completed measures of fruit and vegetable intake (servings/day) and TPB variables (intention, subjective norm, perceived behavioural control and attitude) at baseline and immediately post-intervention.
TPB variables were measured using the same measure described in previous evaluations of the Fresh Facts intervention . Intention, attitude, subjective norm and PBC were all assessed using a 100 point visual analogue scale (where higher scores indicated stronger/more positive levels of that construct). Internal consistency for the TPB measures was good (Cronbach’s alphas = .718 - .929).
As in evaluations of the efficacy of Fresh Facts , fruit and vegetable consumption was measured using a brief self-report measure of previous day consumption (e.g. How many servings of fruit did you eat yesterday?). Scores were summed to create a composite score of the previous day fruit and vegetable consumption.
Intervention acceptability was assessed using an established measure [6, 11] immediately post-intervention. This measure assessed participants beliefs about the intervention on a 6 point Likert scale (e.g. I think the email messages were… interesting: 1 = strong disagree, 6 = strongly agree). Intervention materials were delivered to the participant’s nominated email address on days 1–30.
Example intervention messages included in Fresh Facts
TPB variable targeted
Example of how construct was targeted within Fresh Facts*
Example intervention text targeting this construct
Factual information about the link between fruit and vegetable consumption and health outcomes from a number of different sources (e.g. “experts” and same age peers) was provided over the course of the intervention
“In Australia, experts agree that you should enjoy a wide variety of nutritious foods including plenty of vegetables, legumes, and fruit. Australian health professionals recommend eating at least 2 serves of fruit and 5 serves of vegetables”
“Eating more fruit and vegetables makes it easier to control my weight and keeps my skin clear. Eating plenty of fruit and vegetables help me look and feel my best”
Participants were provided information same age peers approval of fruit and vegetable consumption
“Over 80% of young adults think their peers should eat at least 2 servings for fruit and 5 servings of vegetables every day”
Stories from other young people were included to provide information about the fruit and vegetable consumption of same age peers
“I eat at least 2 fruit and 5 veg every day – and I think everyone should as well”
Individuals were prompted to compare their own fruit and vegetable consumption to other people they knew and to seek advice and support from individuals who were consuming high quantities of fruit and vegetables
“If there are people in your life who are especially good at eating well, why not ask them how they do it? Talking to others can give you ideas about how to improve your own habits”
Perceived behavioural control
Fresh Facts messages emphasised that consumption of fruit and vegetables was easy to perform and achievable for the individual
“Eating the recommended daily intake of fruit and vegetables is not a difficult task. You can do this very easily… you can do it. So do it this week”
During Fresh Facts development young adults reported that storage of fresh food was a major barrier fruit and vegetable consumption. Participants were provided with instruction and “tips” designed to encourage consumption of fruit and vegetables in spite of this barrier
“Some people say that fruits and vegetables are hard to store – but storage is a snap if you shop and eat smart. You can make up your daily intake of fruit and vegetables with a variety of fresh, frozen, tinned, and dried foods”
Differences in attrition and acceptability between the low- and high-frequency interventions were assessed using independent samples t-tests and chi-squared tests. Chi-squared tests and Pearson’s correlations were used to assess the relationships between acceptability ratings, baseline characteristics and change scores for fruit and vegetable consumption and TPB variables.
Demographic characteristics of participants at baseline and attrition by condition
Differences between conditions
Baseline fruit and vegetable intake (servings/day)
Southern and Eastern European
Southern and Central Asian
North African and Middle Eastern
New Zealander, Maori or Pacific Islander
Acceptability ratings by condition
Easy to understand
Too many emailsa, b
Pearson Correlations between beliefs about fruit and vegetable consumption at baseline and intervention acceptability ratings
Baseline subjective norm
Easy to understand
Too many emails
Pearson Correlations between change in beliefs about fruit and vegetable and intervention acceptability ratings
Easy to understand
Too many emails
The aim of the current study was to extend on a previous evaluation of Fresh Facts by evaluating the acceptability of the 30-day version of the program. The relationship between participant and intervention characteristics (including intervention intensity), attrition (an indirect measure of feasibility), effectiveness, and intervention acceptability was also investigated. The findings highlight the importance of considering the relationship between these factors in intervention design and evaluation, and provide valuable information about the acceptability of Fresh Facts.
In particular, when taken in conjunction with the previous evaluation of the acceptability of Fresh Facts , the analyses conducted as part of this study support the ongoing use of email-based interventions to target fruit and vegetable consumption within young adults. Both levels of intervention intensity were acceptable to participants within this sample – indicating that young adults were generally receptive to receiving health promotion content using this intervention modality. This is consistent with several recent studies that have shown email-delivered health interventions to be well-received by participants across a range of contexts [13, 14].
Previous researchers have noted a need to investigate the role of message frequency in intervention acceptability . It appears that frequency of the emails in the high-frequency intervention was not acceptable to the majority of subjects in that group. While optimal message frequency is likely to be context specific, the finding that other indicators of intervention acceptability were not influenced by the frequency of intervention contact is pertinent. Given the longer emails included multiple intervention messages within in single email it would be plausible to expect that the combination in emails may influence the perception that those emails were logical, easy to understand, useful, too long, and/or confusing. There was also a risk that a change in frequency could have led to a change in the perception of content quality. However, it does not appear that the increased length, and complexity, of the combined email influenced the perception of the intervention content in this manner. This finding suggests that this intervention modality can be delivered with very frequent contact without compromising the other facets of reported acceptability of the intervention. As such, when seeking to design interventions on the basis of this finding future researchers and practitioners should carefully consider the indictors of intervention acceptability that are most relevant to their intervention aims. However they should consider the evidence that “very frequent” contact is likely to be less acceptable to participants than lower frequency contact.
The relationships between beliefs about fruit and vegetable consumption at baseline and acceptability suggest that this intervention may be differentially effective depending on individual’s existing beliefs about fruit and vegetable consumption. For example, individuals with lower baseline intentions were more likely to find the intervention annoying and confusing, and less likely to find it interesting, logical, easy to understand and useful. The finding that intention, attitude, subjective norm, and perceived behavioural control at baseline were all related to intervention acceptability indicates a potential threat to the dissemination of the intervention, since it would appear that the intervention is best received by those who have the least need for it. Evidence for these kinds of differential effects are not unique to Fresh Facts, indeed evaluation of the X-Pack program, an email-delivered program for smoking cessation targeting college students, found that the intervention was rated as more acceptable by individuals with lower levels of nicotine dependence at baseline . Similarly, the Hello World program – an email-supported health promotion program for Dutch pregnant women was best received by individuals with lower levels of alcohol consumption at baseline .
The relationships between baseline beliefs and acceptability ratings are of particular relevance since acceptability ratings were associated with a number of indicators of intervention success. Specifically, the primary intervention outcome (fruit and vegetable consumption) was positively correlated with the extent to which individuals believed the intervention was interesting, useful, and complete and negatively correlated with the view that the intervention too long, annoying, confusing and contained too many emails. Given similar links have been observed in at least one other study , these findings suggest a pressing need to consider these factors in order to minimize attrition and maximize intervention effectiveness when interventions are implemented outside of a research context.
Strengths and limitations of the present study
In addition to the issues discussed above, there are a number of factors that should be taken into account when interpreting these results. Firstly, the results presented here consider the feasibility of the Fresh Facts intervention only in the context of university undergraduate students. While the use of a study population that closely matched to the target population of the intervention is appropriate to the evaluation of the intervention itself – this limits the extent to which relationships reported in this study would be generalizable to other populations. As such, readers should be cautious when seeking to apply the results of this study to other contexts.
This study contributes to a small, but growing, literature on the acceptability of behaviour change interventions. The consideration of the relationship between participant and intervention characteristics, attrition, effectiveness, and intervention acceptability is a relatively new advance within this context and is a strength of this stage of Fresh Facts evaluation. These analyses not only provide valuable information about the acceptability of Fresh Facts but also provide important data about potential threats intervention dissemination that may also be relevant for other intervention programmes.
Despite the limitations of the current study, these results broadly support the conclusion that this email delivered intervention is an acceptable tool for promoting increased fruit and vegetable consumption. Individuals in the high-frequency group were more likely to indicate that they received too many emails than individuals in the low-frequency group. However it does appear that high frequency messages can be used without adversely influencing non-frequency related indicators of intervention acceptability (such as credibility and personal relevance).
- National Health and Medical Research Council: Dietary Guidelines for Australian Adults. 2003, CanberraGoogle Scholar
- World Health Organisation: Comparative quantification of health risks: Global and regional burden of disease attributable to selected major risk factors. 2004, GenevaGoogle Scholar
- Australian Bureau of Statistics: National Nutrition Survey: Selected Highlights, Australia, 1995. 1997, CanberraGoogle Scholar
- Unit JHS: Health Survey for England 2006. 2008, Leeds: Cardiovascular disease and risk factorsGoogle Scholar
- Kothe EJ, Mullan BA: Perceptions of fruit and vegetable dietary guidelines amongst Australian young adults. Nutrition and Dietetics. 2011, 68: 262-266. 10.1111/j.1747-0080.2011.01550.x.View ArticleGoogle Scholar
- Kothe EJ, Mullan BA: Acceptability of a theory of planned behaviour email-based nutrition intervention. Health Promot Int. 2014, 29: 91-90. 10.1093/heapro/das041.View ArticleGoogle Scholar
- Kothe EJ, Mullan BA: A randomised controlled trial of a theory of planned behaviour to increase fruit and vegetable consumption. Fresh Facts. Appetite. In pressGoogle Scholar
- Kothe EJ, Mullan BA, Butow P: Promoting fruit and vegetable consumption: Testing an intervention based on the theory of planned behaviour. Appetite. 2012, 58: 997-1004. 10.1016/j.appet.2012.02.012.View ArticlePubMedGoogle Scholar
- Ajzen I: The theory of planned behavior. Organ Behav Hum Decis Process. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.View ArticleGoogle Scholar
- Fishbein M, Ajzen I: Predicting and changing behavior: The reasoned action approach. 2010, New York: Psychology PressGoogle Scholar
- Vandelanotte C, De Bourdeaudhuij I: Acceptability and feasibility of a computer-tailored physical activity intervention using stages of change: Project FAITH. Health Educ Res. 2003, 18: 304-317. 10.1093/her/cyf027.View ArticlePubMedGoogle Scholar
- Campbell M, Fitzpatrick R, Haines A, Kinmonth AL, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. Br Med J. 2000, 321: 694-10.1136/bmj.321.7262.694.View ArticleGoogle Scholar
- Wolfenden L, Wiggers J, Paul C, Freund M, Lecathelinais C, Wye P, Gillham K: Increasing the use of preventative health services to promote healthy eating, physical activity and weight management: the acceptability and potential effectiveness of a proactive telemarketing approach. BMC Public Health. 2012, 12: 953-10.1186/1471-2458-12-953.View ArticlePubMedPubMed CentralGoogle Scholar
- Franklin PD, Rosenbaum PF, Carey MP, Roizen MF: Using sequential email messages to promote health behaviors: Evidence of feasibility and reach in a worksite sample. J Med Internet Res. 2006, 8: 25-37. 10.2196/jmir.8.4.e25.View ArticleGoogle Scholar
- Abroms LC, Gill J, Windsor R, Simons-Morton B: A process evaluation of e-mail counselling for smoking cessation in college students: Feasibility, acceptability and cost. J Smok Cessat. 2009, 4: 26-33. 10.1375/jsc.4.1.26.View ArticleGoogle Scholar
- Bot M, Milder IE, Bemelmans WJ: Nationwide implementation of hello world: a Dutch email-based health promotion program for pregnant women. J Med Internet Res. 2009, 11: e24-10.2196/jmir.1183.View ArticlePubMedPubMed CentralGoogle Scholar
- Sainsbury K, Mullan B, Sharpe L: Dissemination of an Online Theory-Based Intervention to Improve Gluten-Free Diet Adherence in Coeliac Disease: the Relationship Between Acceptability, Effectiveness, and Attrition. Int J Behav Med. 2014, 1-9.Google Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-2458/14/1020/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.