Skip to main content
Download PDF
  • Study protocol
  • Open access
  • Published:

Study protocol: a clinical trial for improving mental health screening for Aboriginal and Torres Strait Islander pregnant women and mothers of young children using the Kimberley Mum's Mood Scale

BMC Public Health volume 19, Article number: 1521 (2019) Cite this article

Abstract

Background

Improving the rates of, and instruments used in, screening for perinatal depression and anxiety among Aboriginal and Torres Strait Islander women are important public health priorities. The Kimberley Mum’s Mood Scale (KMMS) was developed and later validated as an effective and acceptable perinatal depression and anxiety screening tool for the Kimberley region under research conditions. Other regions have expressed interest in using the KMMS with perinatal Aboriginal and Torres Strait Islander women. It is, however, important to re-evaluate the KMMS in a larger Kimberley sample via a real world implementation study, and to test for applicability in other remote and regional environments before recommendations for wider use can be made. This paper outlines the protocol for evaluating the process of implementation and establishing the ‘real world’ validity and acceptability of the KMMS in the Kimberley, Pilbara and Far North Queensland in northern Australia.

Methods

The study will use a range of quantitative and qualitative methods across all sites. KMMS validation/revalidation internal consistency of Part 1 will be determined using Cronbach’s alpha. Equivalence for identifying risk of depression and anxiety compared to a standard reference assessment will be determined from receiver operating characteristic curves. Sensitivity and specificity will be determined based on these cut-points. Qualitative methods of phenomenology will be used to explore concepts of KMMS user acceptability (women and health professionals). Additional process evaluation methods will collate, assess and report on KMMS quality review data, consultations with health service administrators and management, field notes, and other documentation from the research team. This information will be reported on using the Dynamic Sustainability Framework.

Discussion

This project is contributing to the important public health priority of screening Aboriginal and Torres Strait Islander women for perinatal depression and anxiety with tools that are meaningful and responsive to cultural and clinical needs. Identifying and addressing barriers to implementation contributes to our understanding of the complexity of improving routine clinical practie.

Trial registration

The study was registered retrospectively on 15/05/2019 with the Australian and New Zealand Clinical Trial registry (ACTRN12619000580178).

Peer Review reports

Background

There is little evidence of the prevalence of perinatal depression and anxiety among Aboriginal and Torres Strait Islander women in Australia [1,2,3]. Given the higher levels of trauma and distress in the Aboriginal population as a whole, it is understood that rates of perinatal depression and anxiety are also higher than the national average [1,2,3,4]. Untreated perinatal mental health disorders can have a severe negative impact on the mother, child and extended family [1, 4, 5]. Specific impacts of perinatal depression and anxiety may include poorer birth outcomes, poorer bonding and attachment between mother and baby, ongoing emotional and cognitive difficulties for children, and enduring (and possibly escalating) mental health disorders for the woman [6,7,8].

In 2008, the Australian Government launched the National Perinatal Depression Initiative 2008–2013 [9], promoting a universal clinical screening schedule for perinatal depression. The Edinburgh Postnatal Depression Scale (EPDS) [10] was the recommended clinical screening tool. The EPDS was developed in 1987 and is a 10-item depression scale, which also includes a 3-item anxiety subscale. The EPDS, however, has not been validated for use with Aboriginal and Torres Strait Islander women [11]. In the Kimberley, a sparsely populated region in North West Australia, health professionals were concerned that the language and concepts in the EPDS unintentionally disengaged Aboriginal women from the screening process [12]. Consequently, use of the EPDS has been limited among Aboriginal women, and perinatal depression and anxiety are often not identified [12, 13]. In 2013 Gausia et al. [3] reported that Aboriginal women were four times less likely to be screened than non-Indigenous women. Another recent study from Queensland (n = 30,468) demonstrated that, after adjustment for socio-demographics, Aboriginal and Torres Strait Islander women were approximately half as likely to have been screened using the EPDS than non-Indigenous women (OR 0.47, 95% CI 0.39–0.56) [14]. Improving the rates of, and instruments used in, screening for perinatal depression and anxiety among Aboriginal and Torres Strait Islander women are important public health priorities.

To initiate improvements in perinatal depression and anxiety screening in the Kimberley region, over 100 Aboriginal women and 70 staff from Kimberley Aboriginal Community Controlled Health Organisations (ACCHOs) and the Western Australian Country Health Service (WACHS) were consulted. The objective of the consultation was to develop a more appropriate way for health professionals to engage Aboriginal women and screen for perinatal depression and anxiety [12]. The consultation resulted in the development of the two-part Kimberley Mum’s Mood Scale (KMMS) (Additional file 1). Part 1 of the KMMS adapts the EPDS using language and graphics determined through the consultation process. Part 2 involves “yarning” [15, 16] as a culturally secure approach for health professionals to explore select psychosocial risk and protective factors with women. The yarning topics were identified through both the consultation process and existing resources [17] relating to good psychosocial care in the perinatal period for Aboriginal and Torres Strait Islander women. The KMMS is designed to be administered by providers of perinatal care including midwives, child health nurses (CHNs), Aboriginal Health Workers (AHWs) and remote area nurses (RANs) who complete the tool alongside and in partnership with Aboriginal and Torres Strait Islander women.

In 2013–14, the KMMS was validated in a study with 91 Aboriginal women from 15 communities and towns in the Kimberley [13]. Overall KMMS risk equivalence for screening for clinically diagnosed depression and anxiety disorders was greater than or equal to moderate (sensitivity 83%; specificity 87%; positive predictive value 68%). During the validation study, participants and their health professionals were asked, using short semi-structured surveys, about their experience with, and the acceptability of, the KMMS. Results from the survey demonstrated the KMMS was well-accepted by the participants and their health professionals. The Aboriginal women who participated in the Kimberley validation study placed high value on patient–health professional rapport and having the time and opportunity to yarn. Completing the tool with a health professional rather than alone was also highly valued.

The findings of the Kimberley validation study [13] have led to endorsement of the KMMS by the Kimberley Aboriginal Health Planning Forum (KAHPF) as the recommended perinatal depression and anxiety screening tool for all Aboriginal and Torres Strait Islander women in the Kimberley region [18]. To better embed the KMMS into routine clinical practice we need to understand ‘real world’ KMMS utilisation/implementation, such as quality, clinical support required and acceptability. We also need to test the validity of the KMMS at a population level, i.e., ‘revalidate’ the KMMS in a larger Kimberley sample via a real world implementation study. Other regions in Australia have also expressed interest in using the KMMS with Aboriginal and Torres Strait Islander women during the perinatal period. Before recommendations for wider use can be made, we need to test for applicability in other regions. This paper outlines the protocol for evaluating the process of implementation and establishing the ‘real world’ quality, validity and acceptability of the KMMS in the Kimberley, Pilbara and Far North Queensland (FNQ) regions of Australia.

Methods/design

Objectives

The primary objectives of this study are to 1) evaluate the implementation and real-world performance of the KMMS in the Kimberley; 2) test the validity of the KMMS in the Pilbara and FNQ; and 3) assess the acceptability of the KMMS for Aboriginal and Torres Strait Islander women and their health professionals across all sites, i.e. Kimberley, Pilbara and FNQ.

Partnerships

The study is a partnership with Apunipima Cape York Health Council (ACYHC) in FNQ; WACHS – Pilbara and Mawarnkarra Health Service (MHS) in the Pilbara region of Western Australia; WACHS – Kimberley, and Kimberley Aboriginal Medical Services (KAMS) and its member services across the Kimberley region of Western Australia.

Study populations

The target populations for this study are Aboriginal and Torres Strait Islander women who are accessing perinatal care in selected sites in the Kimberley, Pilbara and FNQ, and their health professionals.

Sample frame A: Aboriginal and Torres Strait Islander women (aged 16 years and over) who are at least 6 weeks pregnant or between 7 days and 12 months post-partum, who are not known to be currently acutely mentally unwell and who can provide informed consent.

Sample frame B: Health professionals providing care to perinatal Aboriginal and/or Torres Strait Islander women (as per the specifications of sample frame A), including but not limited to midwives, CHNs, AHWs and RANs.

Recruitment

All women who meet the inclusion criteria (sample frame A) and are receiving perinatal care from a partner health service will be invited to participate in the study when they receive routine perinatal screening by perinatal health professionals. Women will be provided with an information sheet and will be required to provide written informed consent prior to participating in the study.

Women are able to withdraw consent at any time and their data will be withdrawn from the study results if they request this.

Study process

The study involves assessment of implementation, validation/revalidation and acceptability of the KMMS as outlined in Fig. 1.

Fig. 1
figure 1

Overview of KMMS and Study Process

Full size image

The KMMS

Part 1 of the KMMS (modified version of the EPDS) includes 10 close-ended questions using regionally appropriate language and graphics. It is an important way to introduce concepts and language around perinatal depression and anxiety, with which women may be unfamiliar [2, 12].

Part 2 is a psychosocial yarning tool [15, 16]. The domains covered in Part 2 include: support; stressors; self-esteem; childhood experiences; relationships; substance use; and social, emotional and cultural wellbeing. Part 2 aims to identify protective and risk factors that may positively or negatively influence a woman’s sense of wellbeing and risk of perinatal depression or anxiety. Health professionals are provided with open-ended prompts to help facilitate the yarn (Additional file 2) [19].

After the KMMS is completed, health professionals then use their clinical judgement and experience to interpret Part 1 and Part 2 to determine a woman’s overall risk of perinatal depression and anxiety. Categories are: low risk (self-care recommended); moderate risk (clinical assessment within 1 week); and high risk (clinical assessment within 72 h). Any concerns regarding a woman’s risk of harm to herself or others (as raised in Part 1, question 10; Additional file 3) requires immediate action in accordance with the health service policies/protocols.

In the Kimberley it is recommended regional practice for all Aboriginal women to be screened with the KMMS (18) with the same frequency and timing as the national EPDS screening schedule [4]. When repeating screening on the same woman during the same perinatal period, a new Part 1 is completed; however, the yarn in the original Part 2 is continued as opposed to starting Part 2 from the beginning. It is recommended practice for those scoring moderate or high risk on the KMMS at any stage to have further clinical assessment by a general practitioner (GP) or mental health professional [18].

Training perinatal health professionals

All perinatal health professionals in partner health services will be offered approximately 2–3 h of KMMS training. Training will be divided into three sessions:

  • KMMS in-service (50 min) designed to be delivered to all clinical staff. This training will provide information and awareness on perinatal mental health and wellness, provide an overview of the KMMS and ensure that all clinical staff are aware of the KMMS project.

  • KMMS administrator training (1.5–2 h) designed to be delivered to health professionals who will be administering the KMMS. This will provide an in-depth explanation of how to use the KMMS, determining the overall risk level and how to recruit and consent women to the study.

  • KMMS Diagnosis and Management Tool training (50 min). GPs and mental health professionals will be provided with specialist training in how to use the standard reference assessment, called the KMMS diagnosis and management tool (DMT; Additional file 4). This training will provide an overview of the KMMS screening process, the origins of the DMT and how to use the DMT as part of diagnosis and management of perinatal depression and/or anxiety.

All training will be provided face-to-face or via online classroom workshops. For health professionals involved in the KMMS administrator or DMT training, support and mentoring in using the KMMS tools will be available for the duration of the study.

Administering the KMMS

Perinatal health professionals from partner health services trained in the KMMS will consent participants and administer the KMMS instead of the EPDS in accordance with the KMMS guidelines for administration [19]. All women who are assessed as having an overall KMMS risk of moderate or high will be referred for further assessment; where possible this assessment will use the DMT. As part of this study, a proportion of women with an overall KMMS risk assessment of ‘low’ will also be referred for further assessment using the DMT to confirm that the current cut-point between low and moderate is valid.

Further clinical assessment

The DMT is the standard reference assessment for all further KMMS clinical assessments. Diagnosis is based on the Diagnostic and Statistical Manual of Mental Disorders (DSM IV) criteria for depressive and anxiety disorders [20] and severity (i.e. low, moderate, high) on the GP Mental State Examination [21]. Participants who are referred for an assessment using the DMT will be assessed as soon as practicable after the KMMS is administered. For those diagnosed with perinatal depression and/or anxiety, a follow-up management plan will be negotiated between the participant and the GP / mental health professional, ensuring appropriate support, referrals and treatment is discussed and agreed upon by both the woman and the health care professional.

Proposed intervention

The proposed intervention (KMMS) for the three geographical areas is outlined below.

Kimberley implementation study

It is recognised that health service implementation is a complex undertaking with many promising research findings failing to translate into improved patient outcomes [22, 23]. Using the Dynamic Sustainability Framework (DSF) [24] we seek to explore and report on the process of implementation. This includes an examination of how the intervention (components, practitioners, outcomes, delivery platform), practice setting (staffing, organisational culture, information systems, business model, training and supervision), and ecological settings (population characteristics, policy, regulation, funding) enable or inhibit implementation of the KMMS into routine clinical care. Specific to the DSF is the expectation that “change is a constant and thus the success of an intervention to be sustained over time lies in the measured, negotiated, and reciprocal fit of an intervention within a practice setting and the practice setting within the larger ecological system” [24]. The DSF posits that ‘fit’ involves the way an intervention is delivered, the characteristics of patients, providers and settings, and the broader system within which health care is situated [24]. The DSF’s recognition and embrace of the constancy of change is compelling and speaks to the realities of the Northern Australian health workforce which is characterised by high turnover, low stability and high use of temporary staffing [25]. Similarly, the emphasis the DSF places on ‘fit’ seems a pertinent starting point for evaluating the process of implementing the KMMS across the geographically large and culturally diverse region of the Kimberley. The learnings and reflections from the process of implementation will be shared with partner health services and the KAHPF, and submitted to relevant peer reviewed journals and national interest bodies contributing to the science of ‘what works’ in the validation and implementation of Aboriginal and Torres Strait Islander health improvement initiatives.

Kimberley revalidation study

In addition to studying the implementation process, Kimberley Aboriginal and Torres Strait Islander women offered the KMMS as part of routine care will be invited to participate in the revalidation study. The revalidation will analyse the results of KMMS assessments, any further clinical assessments and support, and the routine care provided when screening for perinatal depression and/or anxiety (see below for detail). During this study, the only modification to the recommended standard of care in the Kimberley will be for a sample of women who score low risk on the KMMS to be offered a follow-up clinical assessment by a GP or mental health professional as part of revalidating the cut-point.

Women who do not consent to the study will continue with usual care and no identifying information will be collected on these women. De-identified information about the number, scores and basic demographics of all KMMS assessments will be requested from partner organisations as part of evaluating the implementation.

Pilbara and Far North Queensland validation study

In the Pilbara and FNQ selected health services have agreed to trial the KMMS instead of the EPDS to screen for perinatal depression and anxiety. Partner health services will ask perinatal women for consent to participate in the study. This includes completing the KMMS and providing feedback on the screening tool. All women scoring moderate or high on the KMMS and a sample of women scoring low on the KMMS will be referred for a further clinical assessment using the DMT. As in the Kimberley, the KMMS will be offered in accordance with the national EPDS screening schedule [4] and rescreening will involve completing a new Part 1 and continuing the yarn in the original Part 2.

Women who do not consent to the study can use the KMMS, but no identifying information will be collected on these women.

KMMS quality review

Systematic and retrospective investigation of patient medical records has long been used in quality assessment and improvement studies, professional education and training, and as an assessment of patient care initiatives [26,27,28,29]. This study will review the quality and appropriateness of KMMS and DMT assessments from all sites via two separate panel processes (Additional files 5 and 6).

The panels will convene every 3 months and will consist of a minimum of four members who have relevant clinical expertise and are sufficiently impartial to the study [29], i.e. health professionals not engaged in the administration of the KMMS or the DMT. The panels will be convened by a member of the research team. A minimum of nine and maximum of 12 files will be selected by the KMMS research team and reviewed by the panel at each meeting. A quota sampling strategy [26] will be used to select the files to ensure the panels are reviewing a spread of KMMS/DMT results, antenatal and postnatal women, health professionals, and health services.

Overall findings from each panel will be disseminated back to partner health services as a quality initiative. Where required, additional training and support will be offered to health services to ensure that Aboriginal and Torres Strait Islander women are receiving appropriate care and support via the KMMS and the medical files and records reflect the service provided.

Acceptability of the KMMS

User acceptability is a multi-faceted construct that investigates if and how recipients or administrators of a healthcare intervention consider it to be appropriate [30, 31]. The study will assess key domains of user acceptability (Table 1) using a range of methods including questionaries and qualitative interviewing.

Table 1 Kimberley Mum’s Mood Scale user acceptability measures adapted from El-Den et al. [30] and Sekhon et al. [31]
Full size table

Women consented to the KMMS study will be asked to complete a 5-item paper-based feedback questionnaire immediately after the administration of their first KMMS. This questionnaire will assess participants’ experience with the KMMS tool, specifically exploring perceptions of tool content (Table 1). Additionally, a subset of women (n = 6–12 per KMMS region) will be invited to participate in a face-to-face in-depth interview approximately 3–6 months after administration of their first KMMS. The interviews will be no longer than 1 h in duration and will use a methodological approach of phenomenology to explore experiences of completing the KMMS [30, 31]. Recruitment for in-depth interviewing will occur by following up with those women who expressed interest in an interview by leaving their details on the KMMS feedback questionnaire. Additional measures of purposive sampling such as the study team attending mums and bubs groups or playgroups may result in further recruitment. Participants will provide written consent prior to their involvement in the interviews.

Health professionals will also provide data on the acceptability of the KMMS training and KMMS tool. At the time of training, all health professionals will be asked to complete a paper-based feedback questionnaire. This feedback will relate to the health professional’s experience of the training, including their perceptions of the significance and prevalence of perinatal depression and anxiety in the region in which they work. All health professionals who have been trained and have subsequently administered the KMMS will be asked to complete an online questionnaire 6 months post KMMS administrator training. The questionnaire will assess KMMS use and the health professional’s experience of the KMMS as a feature of clinical care.

Additionally, a subset of KMMS-administrator health professionals (n = 6–12 per KMMS region) will be invited to complete an in-depth interview (in person or by phone) 6 or 12 months post administrator training. Recruitment will occur via phone calls to all trained administrators. Interviews will be no longer than 1 h in duration and will explore user acceptability measures identified in Table 1.

All user acceptability data will be anonymous (questionnaries) or de-identified (in-depth interviews) and participants confidentiality will be maintained at all times.

Outcome measures

Primary outcomes:

  • Diagnostic accuracy of the KMMS as a screening tool for perinatal depression and anxiety assessed by comparing results of the KMMS with the DMT.

  • Acceptability of the KMMS for all sites assessed primarily through the qualitative methodology of phenomenology supplemented with descriptive statistical analysis.

  • Implementation of the KMMS in the Kimberley assessed using a process evaluation methodology framed by the DSF.

Secondary outcomes:

  • Patterns of change identified in KMMS risk for women who have more than one KMMS assessment.

  • Variations in DMT diagnosis determined with KMMS assessment overall score based on if the DMT was conducted blinded or not.

  • KMMS quality and appropriateness identified based on the findings of the KMMS quality review panels.

Sample size calculation

We plan to recruit an equal number of antenatal and postnatal women. The data from antenatal and postnatal women will be pooled for the main analysis, as there was no significant difference in KMMS or study GP assessments between antenatal and postnatal participants in the Kimberley validation study [13]. If there is no significant difference between the data from the three regions, these data will also be pooled.

For the validation/revalidation study, assuming there is a minimum sensitivity of 83% for screening for perinatal depression and anxiety and prevalence is at least 25% (based on the Kimberley validation study), using calculations by Buderer [32] a sample size of 868 paired KMMS and DMT assessments will detect a two-tailed 95% CI with a maximum width of ±5% (i.e., if sensitivity 83, 95% CI 78–88%). This is at the upper end of reported sensitivities for the EPDS compared to a reference standard assessment (59–100%) [33].

Based on the Kimberley validation study [13], we expect 65% of KMMS assessments to be referred for DMT and that at least 75% of the participants who are referred will have both the KMMS and DMT assessments completed (i.e., require 1780 KMMS to obtain 868 paired assessments). For the secondary analysis to determine changes in KMMS risk, we aim to assess as many participants as possible both antenatally and postnatally. As a conservative estimate, we will assume that at least 60% of participants will have KMMS administered at both time points. Recruiting 890 antenatal women (50% of the 1780 KMMS required) should provide at least 534 paired antenatal/postnatal KMMS assessments. In addition, approximately 356 women will be recruited postnatally to ensure that we have 890 antenatal and 890 postnatal KMMS assessments required for the main sample size calculation. Therefore, we initially aimed to recruit 1246 women (890 in the antenatal period and 356 women postnatally) to provide 868 paired KMMS / DMT assessments and 534 paired antenatal/postnatal KMMS assessments.

The complexity of establishing a partnership project across three remote regional areas has taken longer than anticipated; as such a revised sample size is 700 women across all three regions. Assuming 442 of the 700 women have paired KMMS and DMT assessments, this would allow us to detect a two-tailed 95% CI with a maximum width of ±7% (i.e., if sensitivity 83, 95% CI 76–90%).

Blinding

Where possible, GPs and mental health professionals using the DMT will be blinded to the original KMMS assessment. Blinding is, however, not practical for busy, under resourced health services [34, 35]. Similarly, blinding does not always represent good care with a patient being asked to tell her story again from the beginning [36]. With respect to the ‘real world’ nature of the study many of the KMMS assessment results will be sent to the GP or mental health professional along with the KMMS referral paperwork, or the results will be viewable via the health service’s electronic medical record system. This study will monitor and assess the convergence or divergence in diagnosis of perinatal mental health disorder(s) based on the GP / mental health professional being blinded or aware of the KMMS assessment results.

Data management

All information collected from participants is treated as strictly confidential.

Electronic data will be stored in the form of Microsoft Word, REDCap, NVivo 12 (QSR International), Microsoft Excel and Stata (StataCorp) documents. Electronic and digital audio data will be stored on a password protected computer supplied by the Rural Clinical School of Western Australia (RCSWA) or partner health service.

Once data has been obtained, collated and checked, it will be de-identified in a re-identifiable manner, with respect for the preservation of individual privacy. Medical information that is linked with a participant’s identity will not be shared with parties that do not have a direct role in health care for that participant.

Paper based consent forms will be stored under numerical code in a locked filing cabinet only accessible to study personnel. KMMS research staff will transpose any paper information to a secure database using REDCap electronic data capture tools hosted at The University of Western Australia (UWA). These data will be kept for 5 years after last access of data by the research team, after which they will be destroyed. At this time electronic data stored by the researchers will be de-identified in such a manner that it cannot be re-identified, and will be kept for a minimum of 15 years.

Data monitoring

Data monitoring is a function of the regional Trial Management Group (TMG). This group consist of the Coordinating Principal Investigator (CPI), Research Fellow, other study staff and partner health service representatives. Data monitoring is a standing agenda item at each of the monthly TMG meetings. Any change or alteration from the procedures stated in this study protocol, consent documentation, recruitment process, or other study materials (e.g. questionnaires) are considered to be protocol deviations and will be assessed by the TMG. In the event of an unexpected adverse event related to the study or a significant protocol deviation this group would convene within 5 days to review and assess the concern. The TMG will report any concerns to the supervising Human Research Ethics Committee as per the streamlined reporting scheme recommended by the National Health and Medical Research Council (NHMRC) and Australian Health Ethics Committee [37].

The data stored on the secure REDCap database described above will be randomly assessed to make sure there are no errors in transcribing. Other data will be routinely checked by senior members of the research team.

Data analyses

Quantitative analysis

KMMS validation/revalidation internal consistency of Part 1 will be determined using Cronbach’s alpha [38]. Equivalence for identifying risk of depression and anxiety compared to the DMT will be determined from receiver operating characteristic curves. Sensitivity and specificity will be determined based on these cut-points.

Differences in characteristics between antenatal and postnatal participants, participants who are or are not diagnosed with depressive and/or anxiety disorders, and participants from different regions will be compared using χ2 tests for categorical data and Mann–Whitney tests for continuous non-parametric data. Change in KMMS risk (from low to moderate/high, or vice versa) will be compared using McNemar’s test. Descriptive statistical analysis will be used when assessing trends and patterns in user acceptability.

Qualitative analysis

User acceptability data will be descriptively and iteratively coded using NVivo11 (QSR International). The coding categories will be reviewed by the research team and Investigators before the data is thematically analysed [39]. Aboriginal and Torres Strait Islander investigators and project staff will be involved in all aspects of qualitative data coding and analysis to ensure that a cultural lens is applied in the coding and analysis of Aboriginal and Torres Strait Islander participants’ data [40,41,42].

Quality assessments of the KMMS and DMT as per the Quality Assessment Panel will be descriptive using the structured process identified in Additional Information 3 and 4.

The process evaluation [43, 44] will collate, assess and report on KMMS user acceptability data, KMMS quality review data, rates of KMMS and DMT completed across the regions, consultations with health service administrators and management, field notes from the research team, TMG meeting minutes, and training calendars, via the DSF.

Discussion

The KMMS is a valid and acceptable screening tool for depression and anxiety among Aboriginal women in the Kimberley region under research conditions [13]. It has the potential to have broader geographical application for other Aboriginal and Torres Strait Islander women. Validating clinical screening tools that are acceptable to the needs and context of Aboriginal and Torres Strait Islander patients increases and informs our understanding of acceptable and culturally appropriate clinical care [17, 19, 21,22,23,24,25]. This project is contributing to the important public health priority of screening Aboriginal and Torres Strait Islander women for perinatal depression and anxiety with tools that are meaningful and responsive to cultural and clinical needs. This approach has the potential to improve the uptake of screening [3]. This in turn could lead to better early identification, support and treatment of mental health disorders for Aboriginal and Torres Strait Islander women [4].

Few studies have reported on the process and outcomes of clinical validation and implementation [45, 46]. Real world studies are complex, at times fragmented and require ongoing detailed planning [47,48,49]. High staff turnover and subsequent institutional amnesia and delays need to be factored into the planning process. Likewise the ongoing impact of colonisation, racism, different world views, cultural values and beliefs, and language need to be considered in the overall process. Real world validation and implementation studies take time and effort, and require a multidimensional and multidisciplinary approach that involves extensive consultation with heath care providers and patients. Identifying barriers and enablers in the process of real world validation and implementation studies contributes to our understanding of the complexity of improving routine clinical practice. Addressing those barriers and enablers enhances the sustainability of the clinical improvements.

Availability of data and materials

The datasets generated and analysed during this study will not be publicly available due to the possible identifying nature of the participants when their data is viewed in full. The Kimberley, Pilbara and FNQ regions have small populations of perinatal women and we are careful to maintain the confidentiality of our participants. Once data from the study is published, requests for additional data can be made to the corresponding author and will be assessed on grounds of reasonableness.

Findings from the study will be disseminated to partners and the public via face to face meetings, plain language summaries and open access peer-reviewed journal articles.

Abbreviations

ACCHO:

Aboriginal Community Controlled Health Organisations

ACYHC:

Apunipima Cape York Health Council

AHW:

Aboriginal Health Worker

CHN:

Child Health Nurse

DMT:

Diagnosis and Management Tool

DSF:

Dynamic Sustainability Framework

DSM:

Diagnostic and Statistical Manual for Mental Disorders

EPDS:

Edinburgh Postnatal Depression Scale

FNQ:

Far North Queensland

GP:

General Practitioner

KAHPF:

Kimberley Aboriginal Health Planning Forum

KMMS:

Kimberley Mum’s Mood Scale

MHS:

Mawarnkarra Health Service

NHMRC:

National Health and Medical Research Council

PAHPF:

Pilbara Aboriginal Health Planning Forum

RAN:

Remote Area Nurse

RCSWA:

Rural Clinical School of Western Australia

TMG:

Trial Management Group

WA:

Western Australia

WAAHEC:

Western Australian Aboriginal Health Ethics Committee

WACHS:

Western Australian Country Health Service

References

  1. Australian Institute of Health and Welfare. Experience of perinatal depression: data from the 2010 Australian National Infant Feeding Survey. Canberra: AIHW; 2012. 

  2. Prandl KJ, Rooney R, Bishop BJ. Mental health of Australian Aboriginal women during pregnancy: identifying the gaps. Arch Womens Ment Health. 2012;15(3):149–54.

    Article  PubMed  Google Scholar 

  3. Gausia K, Thompson S, Nagel T, Rumbold A, Connors C, Matthews V, Boyle J, Schierhout G, Bailie R. Antenatal emotional wellbeing screening in Aboriginal and Torres Strait Islander primary health care services in Australia. Contemp Nurse. 2013;46(1):73–82.

    Article  PubMed  Google Scholar 

  4. Mental health care in the perinatal period: Australian Clinical Practice Guideline. https://www.cope.org.au/health-professionals/health-professionals-3/review-of-new-perinatal-mental-health-guidelines/. Accessed 13 July 2019.

  5. Buist A, Bilszta J. National Postnatal Depression Program: prevention and early intervention 2001–2005 final report. Melbourne: Beyond Blue; 2005. 

  6. Stein A, Pearson RM, Goodman SH, Rapa E, Rahman A, McCallum M, Howard LM, Pariante CM. Effects of perinatal mental disorders on the fetus and child. Lancet. 2014;384(9956):1800–19.

    Article  PubMed  Google Scholar 

  7. Hay DF, Pawlby S, Waters CS, Sharp D. Antepartum and postpartum exposure to maternal depression: different effects on different adolescent outcomes. J Child Psychol Psychiatry. 2008;49(10):1079–88.

    Article  PubMed  Google Scholar 

  8. Huizink AC, Mulder EJ, Buitelaar JK. Prenatal stress and risk for psychopathology: specific effects or induction of general susceptibility? Psychol Bull. 2004;130(1):115–42.

    Article  PubMed  Google Scholar 

  9. Australian Government. National Perinatal Depression Initiative (2008–2013) 2008. http://www.health.gov.au/internet/main/publishing.nsf/content/mental-perinat. Accessed 27 Sept 2018.

  10. Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh postnatal depression scale. Br J Psychiatry. 1987;150:782–6.

    Article  CAS  PubMed  Google Scholar 

  11. Chan AW, Skeffington P, Reid C, Marriott R. Research protocol for the exploration of experiences of Aboriginal Australian mothers and healthcare professionals when using the Edinburgh postnatal depression scale: a process-oriented validation study using triangulated participatory mixed methods. BMJ Open. 2018;8(10):e022273.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Kotz J, Munns A, Marriott R, Marley JV. Perinatal depression and screening among Aboriginal Australians in the Kimberley. Contemp Nurse. 2016;52(1):42–58.

    Article  PubMed  Google Scholar 

  13. Marley JV, Kotz J, Engelke C, Williams M, Stephen D, Coutinho S, Trust SK. Validity and acceptability of Kimberley Mum's Mood Scale to screen for perinatal anxiety and depression in remote Aboriginal health care settings. PLoS One. 2017;12(1):e0168969.

    Article  PubMed  PubMed Central  Google Scholar 

  14. San Martin Porter MA, Betts K, Kisely S, Pecoraro G, Alati R. Screening for perinatal depression and predictors of underscreening: findings of the born in Queensland study. Med J Aust. 2019;210(1):32–7.

    Article  PubMed  Google Scholar 

  15. Bessarab D, Ng'andu B. Yarning about yarning as a legitimate method in Indigenous research. Int J Crit Indig Stud. 2010;3(1):37-50.

    Article  Google Scholar 

  16. Lin I, Green C, Bessarab D. ‘Yarn with me’: applying clinical yarning to improve clinician-patient communication in Aboriginal health care. Aust J Prim Health. 2016;22(5):377–82.

    Article  PubMed  Google Scholar 

  17. NSW Department of Health. SAFE START Guidelines: Improving mental health outcomes for parents and infants. Sydney: NSW DoH; 2009:61.

  18. Kimberley Aboriginal Health Planning Forum. Perinatal Depression and Anxiety Protocol. https://kahpf.org.au/clinical-protocols. Accessed 2 Mar 2019

  19. Kimberley Mum’s Mood Scale (KMMS) Training Manual. https://kahpf.org.au/kmms. Accessed 6 July 2019.

  20. American Psychiatric Association. Diagnostic and statistical manual of mental disorders, fourth edition: DSM-IV-TR. Washington, DC: American Psychiatric Pub; 2000.

    Google Scholar 

  21. Royal Australian College of General Practitioners. GP Mental Health Treatment Plan templates. https://www.racgp.org.au/education/gps/managing-mental-health/general-practice-mental-health-standards-collabora. Accessed 6 Nov 2019.

  22. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Pinnock H, Barwick M, Carpenter CR, Eldridge S, Grandes G, Griffiths CJ, Rycroft-Malone J, Meissner P, Murray E, Patel A, et al. Standards for reporting implementation studies (StaRI) statement. BMJ. 2017;356:i6795.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Russell DJ, Zhao Y, Guthridge S, Ramjan M, Jones MP, Humphreys JS, Wakerman J. Patterns of resident health workforce turnover and retention in remote communities of the Northern Territory of Australia, 2013-2015. Hum Resour Health. 2017;15(1):52.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Gearing RE, Mian IA, Barber J, Ickowicz A. A methodology for conducting retrospective chart review research in child and adolescent psychiatry. J Can Acad Child Adolesc Psychiatry. 2006;15(3):126–34.

    PubMed  PubMed Central  Google Scholar 

  27. Mullin S, Anand E, Sinha S, Song B, Zhao J, Elkin PL. Secondary use of EHR: interpreting clinician inter-rater reliability through qualitative assessment. Stud Health Technol Inform. 2017;241:165–72.

    PubMed  PubMed Central  Google Scholar 

  28. Vassar M, Holzmann M. The retrospective chart review: important methodological considerations. J Educ Eval Health Prof. 2013;10:12.

    Article  PubMed  Google Scholar 

  29. Allison JJ, Wall TC, Spettell CM, Calhoun J, Fargason CA Jr, Kobylinski RW, Farmer R, Kiefe C. The art and science of chart review. Jt Comm J Qual Improv. 2000;26(3):115–36.

    CAS  PubMed  Google Scholar 

  30. El-Den S, O'Reilly CL, Chen TF. A systematic review on the acceptability of perinatal depression screening. J Affect Disord. 2015;188:284–303.

    Article  PubMed  Google Scholar 

  31. Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Buderer NM. Statistical methodology: I. incorporating the prevalence of disease into the sample size calculation for sensitivity and specificity. Acad Emerg Med. 1996;3(9):895–900.

    Article  CAS  PubMed  Google Scholar 

  33. Gibson J, McKenzie-McHarg K, Shakespeare J, Price J, Gray R. A systematic review of studies validating the Edinburgh postnatal depression scale in antepartum and postpartum women. Acta Psychiatr Scand. 2009;119(5):350–64.

    Article  CAS  PubMed  Google Scholar 

  34. Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753.

    Article  PubMed  Google Scholar 

  35. Handley MA, Lyles CR, McCulloch C, Cattamanchi A. Selecting and improving quasi-experimental designs in effectiveness and implementation research. Annu Rev Public Health. 2018;39:5–25.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Gomersall JS, Gibson O, Dwyer J, O'Donnell K, Stephenson M, Carter D, Canuto K, Munn Z, Aromataris E, Brown A. What Indigenous Australian clients value about primary health care: a systematic review of qualitative evidence. Aust N Z J Public Health. 2017;41(4):417–23.

    Article  PubMed  Google Scholar 

  37. NHMRC Australian health ethics committee. NHMRC Australian health ethics committee (AHEC) position statement: monitoring and reporting of safety for clinical trials involving therapeutic products. Canberra: National Health and Medical Reserach Council; 2009. http://www.nhmrc.gov.au/_files_nhmrc/file/health_ethics/hrecs/reference/090609_nhmrc_position_statement.pdf. Accessed 3 Mar 2019.

  38. Cronbach LJ, Warrington WG. Time-limit tests: estimating their reliability and degree of speeding. Psychometrika. 1951;16(2):167–88.

    Article  CAS  PubMed  Google Scholar 

  39. Maguire M, Delahunt B. Doing a thematic analysis: A practical, step-by-step guide for learning and teaching scholars. AISHE-J. 2017;9(3)3351–33514.

  40. Bartlett JG, Iwasaki Y, Gottlieb B, Hall D, Mannell R. Framework for Aboriginal-guided decolonizing research involving Metis and First Nations persons with diabetes. Soc Sci Med. 2007;65(11):2371–82.

    Article  Google Scholar 

  41. Barnett L, Kendall E. Culturally appropriate methods for enhancing the participation of Aboriginal Australians in health-promoting programs. Health Promot J Aust. 2011;22(1):27–32.

    Article  PubMed  Google Scholar 

  42. Kowal E, Anderson I, Bailie R. Moving beyond good intentions: Indigenous participation in Aboriginal and Torres Strait Islander health research. Aust N Z J Public Health. 2005;29(5):468–70.

    Article  PubMed  Google Scholar 

  43. Harachi TW, Abbott RD, Catalano RF, Haggerty KP, Fleming CB. Opening the black box: using process evaluation measures to assess implementation and theory building. Am J Community Psychol. 1999;27(5):711–31.

    Article  CAS  PubMed  Google Scholar 

  44. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O'Cathain A, Tinati T, Wight D, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Thewes B, Davis E, Girgis A, Valery PC, Giam K, Hocking A, Jackson J, He VY, Yip D, Garvey G. Routine screening of Indigenous cancer patients’ unmet support needs: a qualitative study of patient and clinician attitudes. Int J Equity Health. 2016;15(1):90.

  46. Janca A, Lyons Z, Gaspar J. Here and now Aboriginal assessment (HANAA): a follow-up survey of users. Australasian Psychiatry. 2017;25(3):288–9.

    Article  PubMed  Google Scholar 

  47. Marley JV, Singleton S, Griffiths E, Cutter M, Wright K, Falcocchio L, Scott L, Houston N, Martin J, Atkinson D. Integrating best practice and filling knowledge gaps in remote Aboriginal diabetes detection and care: Improving case detection and service delivery. Final report to the Australian Primary Health Care Research Institute 2016. http://aphcri.anu.edu.au/aphcri-network/research-completed/integrating-best-practice-and-filling-knowledge-gaps-remote. Accessed 22 Apr 2016.

  48. Marley JV, Atkinson D, Kitaura T, Nelson C, Gray D, Metcalf S, Maguire GP. The be our ally beat smoking (BOABS) study, a randomised controlled trial of an intensive smoking cessation intervention in a remote Aboriginal Australian health care setting. BMC Public Health. 2014;14:32.

  49. Marley JV, Kitaura T, Atkinson D, Metcalf S, Maguire GP, Gray D. Clinical trials in a remote Aboriginal setting: lessons from the BOABS smoking cessation study. BMC Public Health. 2014;14(1):579.

  50. National Health and Medical Research Council. Values and Ethics - Guidelines for Ethical Conduct in Aboriginal and Torres Strait Islander Health Research. Canberra: Commonwealth of Australia; 2003. https://www.nhmrc.gov.au/about-us/publications/national-statement-ethical-conduct-human-research-2007-updated-2018#toc__235. Accessed 1 Oct 2019.

Download references

Acknowledgements

This study is a collaboration between The University of Western Australia (specifically The Rural Clinical School of Western Australia), Kimberley Aboriginal Medical Services (and member services), Western Australian Country Health Service (WACHS) - Kimberley, Apunipima Cape York Health Council, Mawarnkarra Medical Service and WACHS - Pilbara. The authors gratefully acknowledge the support of these organisations. Special thanks to Katherine Ferrari, Diana Jans, Johanna Neville, Coralie Achterberg, Anna Lyon, Suzie Rayner and Kimberley Seear for their ongoing assistance in the study.

Funding

This study is funded by the National Health and Medical Research Council of Australia (grant number 1132659) and the Western Australian Department of Health, with significant in-kind contributions from the partner organisations listed above. The funding bodies have had no role in the study design, the development of the protocol manuscript, and the decision to submit the manuscript for publication.

Author information

Authors and Affiliations

  1. The Rural Clinical School of Western Australia, The University of Western Australia, 12 Napier Tce, PO Box 1377, Broome, WA, 6725, Australia

    Emma Carlin, Sarah J. Blondell, Catherine Engelke, Des Taverner, David Atkinson & Julia V. Marley

  2. Kimberley Aboriginal Medical Services, 12 Napier Tce, PO Box 1377, Broome, WA, 6725, Australia

    Emma Carlin & Julia V. Marley

  3. Apunipima Cape York Health Council, 186 McCoombe Street, PO Box 12045, Bungalow, QLD, 4870, Australia

    Yvonne Cadet-James

  4. Centre for Indigenous Health Equity Research, Central Queensland University, Cnr of Shields and Lake Streets, Cairns, QLD, 4870, Australia

    Sandra Campbell

  5. Western Australian Country Health Service – Kimberley Population Health Unit, 4/9 Napier Tce (WA 6725 Locked Bag 525), Broome, WA, 6725, Australia

    Melissa Williams

  6. Ngangk Yira: Murdoch University Research Centre for Aboriginal Health and Social Equity, Murdoch University, 90 South Street, Murdoch, WA, 6150, Australia

    Rhonda Marriott

  7. King’s College London, 1 Lambeth Palace Road, Waterloo, London, SE1 7EU, UK

    Karen Edmonds

Authors
  1. Emma Carlin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sarah J. Blondell
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yvonne Cadet-James
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Sandra Campbell
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Melissa Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Catherine Engelke
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Des Taverner
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Rhonda Marriott
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Karen Edmonds
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. David Atkinson
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Julia V. Marley
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JM and DA led the conception and design of the study, and jointly with SC, CE, RM and KE secured funding support. All authors contributed to study design and set-up. EC, JM, SB, DA, YC-J, SC co-drafted the manuscript; CE, RM, DT, MW, KE provided comments. All authors will participate in the study. All authors read, critically revised and approved the final manuscript.

Corresponding author

Correspondence to Emma Carlin.

Ethics declarations

Ethics approval and consent to participate

This study was endorsed by the KAHPF Research Subcommittee and the Pilbara Aboriginal Health Planning Forum. The study has approval from the Western Australian Aboriginal Health Ethics Committee (Project 781), the WACHS Human Research Ethics Committee (RGS 206) and the Far North Queensland Human Research Ethics Committee (Project 46663–1306). Women from sample frame A will provide written informed consent prior to participating in the study. Health professionals from sample frame B will be implementing the KMMS as part of routine clinical care. By volunteering information on the process of implementation of the KMMS, sample frame B will be implying consent to take part in this evaluation, as per National Statement on Ethical Conduct in Research (NS 2.2.5) [50].

The study was registered retrospectively (one participant consented to the Kimberley implementation arm prior to registration) with the Australian and New Zealand Clinical Trial Registry (ACTRN12619000580178).

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

KMMS Part 1 and 2. KMMS screening tool Part 1 and 2.

Additional file 2.

Questions for each Psychosocial Domain. Domains with corresponding psychosocial (open ended) questions.

Additional file 3.

The KMMS Scoring Template. KMMS Part 1 scoring sheet and exploratory questions for question 10 (I think of doing something bad to myself or others).

Additional file 4.

KMMS Diagnosis and Management Tool. Tool for diagnosis and management of mental health disorders for GPs and mental health professionals.

Additional file 5.

KMMS Assessment Quality Review Panel. Terms of reference for the panel established to review the quality and reliability of the KMMS.

Additional file 6.

KMMS Diagnosis and Management Tool Quality Review Panel. Terms of reference for the panel established to review the quality of the KMMS Diagnostic and Management Tool.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Carlin, E., Blondell, S.J., Cadet-James, Y. et al. Study protocol: a clinical trial for improving mental health screening for Aboriginal and Torres Strait Islander pregnant women and mothers of young children using the Kimberley Mum's Mood Scale. BMC Public Health 19, 1521 (2019). https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-019-7845-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-019-7845-3

Keywords

BMC Public Health

ISSN: 1471-2458

Contact us