- Study protocol
- Open Access
- Open Peer Review
Effectiveness and cost-effectiveness of a multidisciplinary intervention programme to prevent new falls and functional decline among elderly persons at risk: design of a replicated randomised controlled trial [ISRCTN64716113]
© Hendriks et al; licensee BioMed Central Ltd. 2005
- Received: 10 December 2004
- Accepted: 14 January 2005
- Published: 14 January 2005
Falls are common among community-dwelling elderly people and can have a considerable impact on quality of life and healthcare costs. People who have sustained a fall are at greater risk of falling again.
We replicated a British randomised controlled trial which demonstrated the effectiveness of a multidisciplinary intervention programme to prevent falls.
The objective is to describe the design of a replication study evaluating a multidisciplinary intervention programme on recurrent falls and functional decline among elderly persons at risk. The study consists of an effect evaluation, an economic evaluation and a process evaluation.
The programme is aimed at community-dwelling elderly people aged 65 years or over who have visited an accident and emergency department (A&E department) or a general practitioners' cooperative (GP cooperative) because of a fall.
The design involves a two-group randomised controlled trial. Participants are followed for twelve months after baseline. The intervention programme consists of a detailed medical and occupational therapy assessment with referral to relevant services if indicated. People in the control group receive usual care.
The main outcome measures of the effect evaluation are number of falls and daily functioning. The economic evaluation will be performed from a societal perspective. A process evaluation will be carried out to evaluate the feasibility of the intervention programme.
- Economic Evaluation
- Elderly People
- Usual Care
- Barthel Index
- Usual Care Group
Publishing the design of a study
This article describes the design of a replication of a randomised controlled trial (RCT) evaluating the effectiveness and cost-effectiveness of a multidisciplinary intervention programme to prevent further falls among elderly people at risk.
Publishing the design and protocol of a study before results are available is important for several reasons. A published protocol allows easier comparison between what was originally intended and hypothesised and what was actually done , and it gives readers greater insight into the methodological quality of a study. Furthermore, it has often been recognised that negative or adverse outcomes are less likely to be published [1–3]. Publishing the design of a study before its start announces that a study will be undertaken, which encourages publication of the results and in any case informs researchers where they can find the data for inclusion in systematic reviews [1, 2]. Thus, publishing a design article can prevent publication bias.
Prevention of falls
About one-third of people over the age of 65 fall at least once a year . People who have fallen show an increase in morbidity, mortality and healthcare utilisation , which implies increased healthcare costs. In addition, people who have sustained a fall are at greater risk of falling again .
Since preventing falls has been a matter of interest for years, many programmes aimed at preventing falls have been developed and evaluated. Unfortunately, many of these have turned out to be ineffective . However, there is now considerable evidence of the effectiveness of multifaceted interventions. Programmes likely to be effective in preventing falls among elderly people are multidisciplinary, multifactorial programmes screening for health and environmental risk factors and offering interventions, both for the general population of community-dwelling elderly people and for elderly people with a history of falling selected because of known risk factors . An example of such an intervention programme is the successful programme developed by Close et al. . This programme is aimed at people aged 65 years or older who live in the community and have visited an accident and emergency department because of a fall. The intervention programme consists of a detailed medical and occupational therapy assessment with referral to relevant services if indicated. The intervention has been evaluated in a randomised controlled trial, which demonstrated that this multidisciplinary intervention implemented among people at risk was highly effective in reducing the number of recurrent falls and associated injuries in London (United Kingdom) .
Because details of the status of the participants, the context of the intervention and the content and presentation appear to be critical, it has been recommended to re-evaluate effective intervention programmes in different healthcare systems . We therefore decided to evaluate the effectiveness of the intervention developed by Close  in Dutch healthcare, by replicating this study in the Netherlands.
Objective and research questions
The main objective of our current study is to evaluate the effects of a multidisciplinary intervention programme on recurrent falls and functional decline among elderly persons who have visit a general practitioners' cooperative (GP cooperative) and/or an accident and emergency department (A&E department) because of a fall. This objective has resulted in the following research questions.
Is a multidisciplinary intervention programme more effective than usual care in preventing new falls and functional decline among community-dwelling elderly people who visit a GP cooperative and/or A&E department at a hospital because of a fall?
Is the multidisciplinary intervention programme cost-effective compared to usual care when assessed from a societal perspective?
Besides the effect evaluation and economic evaluation, a process evaluation is being carried out to assess the feasibility and applicability of the intervention programme for those receiving and implementing the intervention.
We have taken various measures to ensure blinding in the data collection process. Questionnaires are collected anonymously and sorted by number. Follow-up measurements by phone are contracted out to an independent call centre, whose operators are unaware whether the subjects have been allocated to the intervention or the control group.
The study design and protocols were approved by the Medical Ethics Committee of the University Hospital and University of Maastricht.
Various studies have been conducted to assess the effectiveness of programmes to prevent falls. Although most studies were aimed at the general population of elderly people, details of the status of the participants appear to be critical [4, 6]. Several authors have suggested that interventions are likely to have greater effect when targeting people at risk [7, 8]. People who attend an A&E department with an injurious fall form a high-risk group, and are expected to be more receptive to an intervention programme aimed at reducing falls than the general population of community-dwelling elderly people. In a study by Close et al., about half of the patients who attended an A&E department with a fall had experienced an earlier fall in the previous year, compared to about one third of the elderly people in the general population . Like Close et al. , we chose community-dwelling elderly people aged 65 years or over who had sustained an injurious fall as the target population of our intervention programme. The following definition of a fall was used: 'A fall is an event which results in a person coming to rest inadvertently on the ground or other lower level'. This definition is derived from that used by the Kellogg International Work Group .
Recruitment of the study population
Recruitment of subjects took place at the local GP cooperative and the A&E department of the University Hospital in Maastricht. The Maastricht GP cooperative is a group of GPs from practices in the town of Maastricht and the surrounding area who have founded a non-profit organisation to provide care for their own patients after hours . The Maastricht GP cooperative has been set up at the hospital's A&E department and covers the out-of-hours service for all local GPs .
The following inclusion criteria were used: age 65 years or older, community-dwelling, having visited the A&E department or GP cooperative at the University Hospital Maastricht for the consequences of a fall, and living in Maastricht or its surrounding area. People were only allowed to enter the programme after completing and returning an informed consent form. Exclusion criteria were: not able to speak or understand Dutch, not able to complete questionnaires or interviews by telephone, cognitive impairment (a score of less than 4 on the Abbreviated Mental Test 4 (AMT 4) [12, 13], long-term admission to a hospital or other institution (more than four weeks from the date of inclusion), permanently bedridden, or fully dependent on a wheelchair.
Sample size calculation
Sample size calculations were based on the expected effects of the intervention on the main outcome measure, the percentage of people sustaining a fall during one year of follow-up. The study by Close et al.  found that the percentage of persons who sustained a recurrent fall was 52% in the usual care group and 32% in the intervention group. If we want to detect the same reduction in the percentage of persons sustaining a recurrent fall in our study, with a power (1-beta) of 90% and alpha of 0.05, we need 123 patients in each group (a total of 246). Based on the experiences of Close et al. and our own experiences in trials among elderly people in the Netherlands , we expect a dropout rate of about 25% during the one-year follow-up period. This means that about 164 persons per group (a total of 328) have to be included in the study. The inclusion period was 14 months.
To adapt the programme developed by Close et al.  to the Dutch situation, and to make improvements based on recent insights, we performed a review of the literature, convened a consensus meeting and tested the adapted version in a pilot study (n = 36). Based on this process, we made some improvements to Close et al.'s programme.
The final programme includes a medical and occupational therapy assessment resulting in recommendations. The medical assessment consists of an examination performed by a geriatrician, a geriatric nurse and a rehabilitation physician to identify and address risk factors for falling. The examination includes a comprehensive general examination, but in addition focussed on a more detailed assessment of visual acuity, stereoscopic vision, mobility, balance, cognition, affect, use of medication and examination of feet and footwear. Recommendations or indications for referral resulting from this examination are sent to the patient's GP. After the medical assessments, an occupational therapist visits the patients to identify possible risk factors for falling in the home environment. The therapist makes recommendations regarding adaptations to the home environment, assistive devices, home care and behavioural change. Recommendations by the occupational therapist are sent directly to the subjects themselves and to their GPs. As stated before, the intervention period is scheduled to last for a maximum of 3.5 months after the baseline measurement.
An important addition to Close et al.'s protocol  is the collaboration with a rehabilitation physician (physiatrist) in the medical part of the intervention. In addition to the screening by a geriatrician, our programme also involves screening by a rehabilitation physician who examines the subjects' feet and the shoes which the subjects wore at the time of the fall. Details of the process of adaptation and the contents of the intervention programme will be published elsewhere.
Usual care in the Netherlands
People in the control group receive usual care. At present, no guidelines exist for the systematic assessment of the underlying causes of an injurious fall presented at an A&E department or GP cooperative in the Netherlands. In usual care, medical risks and other risk factors such as environmental hazards in the home and patients' risk behaviour are not systematically registered and addressed by hospital physicians, specialists or general practitioners. Moreover, no systematic attention is currently being paid to the specific consequences of an injurious fall for the daily functioning of individual patients in their unique situation. We placed no restrictions on co-interventions.
The primary outcome measures of the effect evaluation are number of falls and daily functioning. Number of falls is subdivided into three separate measures: the percentage of elderly people sustaining a fall during the one-year follow-up period, recurrent falls during follow-up (i.e., the percentage of elderly people sustaining two or more falls), and injurious falls during follow-up (the percentage of elderly people receiving medical care after a fall). Falls are recorded continuously by means of a fall calendar during the twelve-month follow-up period. Subjects are called monthly to report their falls as recorded on the fall calendar relating to the previous month.
We decided to measure daily functioning by means of the Frenchai Activity Index (FAI) , in contrast to Close et al. , who used the Barthel Index. Our reason for choosing this instrument was that the FAI has proved to be suitable for the general population of elderly people  and has at least two advantages over the Barthel Index. One is that the Barthel Index shows a ceiling effect when applied to elderly people who have sustained a fall . The other is that most activities of daily living (ADL) scales, like the Barthel Index, do not refer to complex activities like housekeeping, recreation, hobbies and social interaction. These so-called instrumental abilities (IADL) may affect the quality of life considerably, and the FAI focuses primarily on these IADL abilities . The FAI is measured by means of self-administered questionnaires at baseline and after four and twelve months.
Our secondary outcome measures are: recuperation from the fall, health complaints, perceived health measured by means of the first two items of the RAND-36 , ADL and IADL disability measured by means of the GARS (Groningen Activity Restriction Scale) , mental health measured by means of the HADS (Hospital Anxiety and Depression Scale) [18, 19] and quality of life measured by means of the European Quality of Life instrument (EuroQol) . The secondary outcome measures are assessed by means of self-administered questionnaires at four and twelve months.
Besides the primary and secondary outcome measures, we assess some background variables which are considered to be predictors, confounders or effect modifiers. The following personal characteristics are assessed: age, sex, marital status, living alone and socio-economic status. In addition, we assess the circumstances and causes of the falls reported at the GP cooperative and/or A&E department, the consequences of the falls (using the Falls Handicap Inventory ), the type of injury, falls in the previous year (retrospective), the patient's height, weight, use of medication and social contacts (using an adjusted version of items 4 and 5 of the Rand Social Health Battery)[22, 23], and the occurrence of life events. All background variables are measured at baseline.
The economic evaluation in our study is being performed from a societal perspective, which implies that all costs and outcomes are taken into account if possible. The economic evaluation will be a combination of a cost-effectiveness and a cost-utility analysis. The primary outcome measure for the cost-effectiveness analysis will be the percentage of people sustaining a fall during one year of follow-up. As mentioned above, falls are recorded by means of a calendar. Within the cost-utility analysis, the effects are measured in terms of generic health-related quality of life descriptions, measured according to the standard Dutch version of the EuroQol (EQ 5-D)  in self-administered questionnaires at baseline and after four and twelve months. A direct value for every state of health is generated using the social tariff , which involves an algorithm for interpolating EuroQol results to population utilities.
We will assess programme costs, healthcare costs and patient and family costs. All costs are measured by means of a cost diary , in which patients continuously record volumes of health care utilisation during the twelve-month follow-up period. Subjects are asked to report their cost diary relating to the previous month during the same monthly telephone interview in which they report falls from the calendar. The volume of each category we measure will be multiplied by the cost price of each category. Cost prices are presented in Euros. Health care costs are estimated according to the Dutch guideline for cost analysis in health care research . Where such guidelines are not available for a specific category, real costs or tariffs are used to estimate costs.
The process evaluation involves assessing the extent to which the intervention programme is performed according to protocol, the nature of the recommendations made to the participants, participants' compliance with these recommendations and the opinions of participants, physicians and therapists about the intervention programme and recommendations. Data on these topics are collected using the following methods: structured registration forms for the medical and occupational parts of the intervention programme; self-administered evaluation forms filled in by the participants after the medical intervention; interviews by telephone with the participants six weeks or longer after the recommendations are sent and interviews with all participating physicians and therapists at the end of the intervention period.
Data will be primarily analysed according to the intention-to-treat principle, i.e., including all participants with valid data, regardless of whether they received or did not receive the intervention. Subsequently, the results of the intention-to-treat analysis will be compared with the results of an on-treatment analysis, to assess whether protocol deviations have caused bias. Participants with documented deviations from the study protocol (i.e., participants in the intervention group who did not receive the entire intervention or participants in either the intervention or the control group with incomplete follow-up data) will be excluded from this on-treatment analysis.
Comparability between the intervention and control groups will be assessed at baseline to check for differences between the two groups. Outcome at four and twelve months will be compared between the intervention and control groups by both univariate and multivariate techniques. We will use multivariate analysis to adjust for possible differences in baseline scores and background variables between the intervention and control groups. Dropouts and losses-to-follow up will be described.
The economic evaluation will involve calculating cost-effectiveness and cost-utility ratios. The additional costs and additional benefits of the intervention programme compared with usual care will be examined by calculating incremental cost-effectiveness and cost-utility ratios. These incremental ratios represent the difference in mean costs between the intervention and usual care groups in the numerator and the difference in mean effects in the denominator.
Since the recruitment period is only 14 months, and the follow-up period is also relatively short (12 months), it is unlikely that there will be substantial differences between costs made by and for patients who started in the first part of the recruitment period and those who started in the last part. Therefore, discounting of costs is not required. Finally, a sensitivity analysis will be done to assess the generalisability of the assumptions made in the costing process. This sensitivity analysis, which involves calculating the upper and lower limits of the confidence interval of cost and effect variables, will allow us to explore and quantify the uncertainty not related to sampling variations.
The process evaluation will mainly be analysed by means of descriptive techniques.
Progress of the study
Recruitment of eligible subjects commenced in December 2002 and ended in February 2004, resulting in a total of 333 eligible subjects being included in the trial. Randomisation resulted in the allocation of 166 participants to the intervention group and 167 to the control group. Of the 333 persons recruited, 105 (32 %) are male and 228 (68 %) are female.
The follow-up period is to end in May 2005. Results on the effects of the programme will be available in 2006 and will be published in the relevant journals.
Although the intervention has been subject of earlier research, this study will provide new information about the effectiveness in the Dutch situation. Furthermore, the results of the economic evaluation can provide information about the cost-effectiveness of the intervention and the effects on quality of life. In case of shown effectiveness and cost-effectiveness, we aim to implement this intervention into usual healthcare.
This study was funded by the Netherlands Organisation for Health Research and Development (ZonMw), grant number 945-02-053.
- Godlee F: Publishing study protocols: making them visible will improve registration, reporting and recruitment. BMC News and Views. 2001, 2: 4-Google Scholar
- Thornton A, Lee P: Publication bias in meta-analysis: its causes and consequences. J Clin Epidemiol. 2000, 53: 207-216. 10.1016/S0895-4356(99)00161-4.View ArticlePubMedGoogle Scholar
- Steenstra IA, Anema JR, Bongers PM, de Vet HC, van Mechelen W: Cost effectiveness of a multi-stage return to work program for workers on sick leave due to low back pain, design of a population based controlled trial [ISRCTN60233560]. BMC Musculoskelet Disord. 2003, 4: 26-10.1186/1471-2474-4-26.View ArticlePubMedPubMed CentralGoogle Scholar
- Gillespie LD, Gillespie WJ, Robertson MC, Lamb SE, Cumming RG, Rowe BH: Interventions for preventing falls in elderly people. Cochrane Database Syst Rev. 2003, CD000340-Google Scholar
- Close J, Ellis M, Hooper R: Prevention of falls in the elderly trial (PROFET): a randomised controlled trial. Lancet. 1999, 353: 93-97. 10.1016/S0140-6736(98)06119-4.View ArticlePubMedGoogle Scholar
- van Haastregt JC, Diederiks JP, van Rossum E, de Witte LP, Crebolder HF: Effects of preventive home visits to elderly people living in the community: systematic review. BMJ. 2000, 320: 754-758. 10.1136/bmj.320.7237.754.View ArticlePubMedPubMed CentralGoogle Scholar
- Tinetti ME, Baker DI, McAvay G, Claus EB, Garrett P, Gottschalk M, Koch ML, Trainor K, Horwitz RI: A multifactorial intervention to reduce the risk of falling among elderly people living in the community. N Engl J Med. 1994, 331: 821-827. 10.1056/NEJM199409293311301.View ArticlePubMedGoogle Scholar
- Cumming RG, Thomas M, Szonyi G, Salkeld G, O'Neill E, Westbury C, Frampton G: Home visits by an occupational therapist for assessment and modification of environmental hazards: a randomized trial of falls prevention. J Am Geriatr Soc. 1999, 47: 1397-1402.View ArticlePubMedGoogle Scholar
- The prevention of falls in later life. A report of the Kellogg International Work Group on the Prevention of Falls by the Elderly. Dan Med Bull. 1987, 34 (Suppl 4): 1-24.Google Scholar
- Leibowitz R, Day S, Dunt D: A systematic review of the effect of different models of after-hours primary medical care services on clinical outcome, medical workload, and patient and GP satisfaction. Fam Pract. 2003, 20: 311-317. 10.1093/fampra/cmg313.View ArticlePubMedGoogle Scholar
- van Uden CJ, Winkens RA, Wesseling GJ, Crebolder HF, van Schayck CP: Use of out of hours services: a comparison between two organisations. Emerg Med J. 2003, 20: 184-187. 10.1136/emj.20.2.184.View ArticlePubMedPubMed CentralGoogle Scholar
- Swain DG, Nightingale PG: Evaluation of a shortened version of the Abbreviated Mental Test in a series of elderly patients. Clin Rehabil. 1997, 11: 243-248.View ArticlePubMedGoogle Scholar
- Swain DG, O'Brien AG, Nightingale PG: Cognitive assessment in elderly patients admitted to hospital: the relationship between the shortened version of the Abbreviated Mental Test and the Abbreviated Mental Test and Mini-Mental State Examination. Clin Rehabil. 2000, 14: 608-610.View ArticlePubMedGoogle Scholar
- van Haastregt JC, Diederiks JP, van Rossum E, de Witte LP, Voorhoeve PM, Crebolder HF: Effects of a programme of multifactorial home visits on falls and mobility impairments in elderly people at risk: randomised controlled trial. BMJ. 2000, 321: 994-998. 10.1136/bmj.321.7267.994.View ArticlePubMedPubMed CentralGoogle Scholar
- Schuling J, Haan de R, Limburg M: The Frenchai activities index; assessment of functional status in stroke patients. Stroke. 1993, 24: 1173-1177.View ArticlePubMedGoogle Scholar
- van der Zee KI, Sanderman R: Het meten van de algemene gezondheidstoestand met de RAND-36: een handleiding [Measuring general health with the RAND-36:manual]. 1993, Groningen: Noordelijk Centrum voor Gezondheidsvraagstukken, Rijksuniversiteit GroningenGoogle Scholar
- Kempen GI, Miedema I, Ormel J, Molenaar W: The assessment of disability with the Groningen Activity Restriction Scale. Conceptual framework and psychometric properties. Soc Sci Med. 1996, 43: 1601-1610. 10.1016/S0277-9536(96)00057-3.View ArticlePubMedGoogle Scholar
- Bjelland I, Dahl AA, Haug TT, Neckelmann D: The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res. 2002, 52: 69-77. 10.1016/S0022-3999(01)00296-3.View ArticlePubMedGoogle Scholar
- Flint AJ, Rifat SL: Factor structure of the hospital anxiety and depression scale in older patients with major depression. Int J Geriatr Psychiatry. 2002, 17: 117-123. 10.1002/gps.535.View ArticlePubMedGoogle Scholar
- Brooks R: Euroqol:the current state of play. Health policy. 1996, 37: 53-72. 10.1016/0168-8510(96)00822-6.View ArticlePubMedGoogle Scholar
- Rai GS, Kiniorns M, Wientjes H: Falls Handicap Inventory (FHI) – an instrument to measure handicaps associated with repeated falls. J Am Geriatr Soc. 1995, 43: 723-724.View ArticlePubMedGoogle Scholar
- Donald CA, Ware JE, Brook RH, Davies-Avery A: Conceptualisation and measurement of health for adults in the Health Insurance Study, vol. IV Social Health. 1978, Santa Monica, CA: The rand CorporationGoogle Scholar
- McDowell I, Newell C: Measuring Health: a guide to rating scales and questionnaires. 1996, New York: Oxford University PressGoogle Scholar
- Dolan P: Modeling valuations for EuroQol health states. Med Care. 1997, 35: 1095-1108. 10.1097/00005650-199711000-00002.View ArticlePubMedGoogle Scholar
- Goossens ME, Rutten van Molken MP, Vlaeyen JW, van der Linden SM: The cost diary: a method to measure direct and indirect costs in cost-effectiveness research. J Clin Epidemiol. 2000, 53: 688-695. 10.1016/S0895-4356(99)00177-8.View ArticlePubMedGoogle Scholar
- Oostenbrink J, Koopmanschap M, Rutten F: Handleiding voor kosten onderzoek; methodenen richtlijnprijzen voor economische evaluaties in de gezondheidszorg. 2000, Amstelveen: College van zorgverzekeraarsGoogle Scholar
- Drummond MF, O'Brien BJ, Stoddart GL, Torrance GW: Methods for the Economic Evaluation of Health Care Programmes. 2003, New York: Oxford University Press, 2Google Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-2458/5/6/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.