Skip to main content
  • Research article
  • Open access
  • Published:

High-risk behaviors and their association with awareness of HIV status among participants of a large-scale prevention intervention in Athens, Greece

Abstract

Background

Aristotle was a seek-test-treat intervention during an outbreak of human immunodeficiency virus (HIV) infection among people who inject drugs (PWID) in Athens, Greece that started in 2011. The aims of this analysis were: (1) to study changes of drug injection-related and sexual behaviors over the course of Aristotle; and (2) to compare the likelihood of risky behaviors among PWID who were aware and unaware of their HIV status.

Methods

Aristotle (2012–2013) involved five successive respondent-driven sampling rounds of approximately 1400 PWID each; eligible PWID could participate in multiple rounds. Participants were interviewed using a questionnaire, were tested for HIV, and were classified as HIV-positive aware of their status (AHS), HIV-positive unaware of their status (UHS), and HIV-negative. Piecewise linear generalized estimating equation models were used to regress repeatedly measured binary outcomes (high-risk behaviors) against covariates.

Results

Aristotle recruited 3320 PWID (84.5% males, median age 34.2 years). Overall, 7110 interviews and blood samples were collected. The proportion of HIV-positive first-time participants who were aware of their HIV infection increased from 21.8% in round A to 36.4% in the last round. The odds of dividing drugs at least half of the time in the past 12 months with a syringe someone else had already used fell from round A to B by 90% [Odds Ratio (OR) (95% Confidence Interval-CI): 0.10 (0.04, 0.23)] among AHS and by 63% among UHS [OR (95% CI): 0.37 (0.19, 0.72)]. This drop was significantly larger (p = 0.02) among AHS. There were also decreases in frequency of injection and in receptive syringe sharing in the past 12 months but they were not significantly different between AHS (66 and 47%, respectively) and UHS (63 and 33%, respectively). Condom use increased only among male AHS from round B to the last round [OR (95% CI): 1.24 (1.01, 1.52)].

Conclusions

The prevalence of risky behaviors related to drug injection decreased in the context of Aristotle. Knowledge of HIV infection was associated with safer drug injection-related behaviors among PWID. This highlights the need for comprehensive interventions that scale-up HIV testing and help PWID become aware of their HIV status.

Peer Review reports

Introduction

Despite significant achievements in terms of prevention and treatment, infection with human immunodeficiency virus (HIV) is still a global health challenge with around 38 million people living with HIV [1]. Many infections, especially outside Africa, are attributed to drug injection. In particular, 15.6 million people inject drugs (PWID) globally and of these, around 3 million are infected with HIV [2]. Moreover, HIV outbreaks have recently been observed among PWID in many European settings [3,4,5,6,7] and in one location in the United States (US) [8].

The HIV epidemic in Greece was concentrated mainly in men who have sex with men with sporadic HIV transmissions in PWID [9]. Harm reduction coverage had been constantly extremely low in the country, despite substantial evidence for prevalent risky behaviors among PWID [9]. For instance, in September 2011, the waiting list at facilities in Athens for medication-assisted treatment of opioid use disorder was 8 years. Before 2011, Needle/Syringe Programs (NSP) were distributing less than 20 syringes/needles per year per person who injected drugs [10]. After 2011, the epidemiological pattern changed dramatically. HIV diagnoses among PWID in Athens, the capital city of Greece, rocketed from less than 20 annually to more than 1000 in just 3 years (2011–2013), and drug injection became the most common route of transmission in 2012 [11]. The HIV outbreak occurred in the context of a financial distress that started in 2008 and soon turned into a serious economic, political, and social crisis [10].

In response to the rapidly evolving epidemic, there were efforts to increase HIV testing rates, to scale-up harm reduction measures, and to link PWID with antiretroviral treatment. The major element of the national response was Aristotle, a large-scale, seek-test-treat intervention [12, 13]. Aristotle used a respondent-driven sampling (RDS) approach to reach PWID, who constitute a hard-to-reach population, and ran multiple waves of HIV testing in 16 months in order to capture the largest possible proportion of infected PWID. The concept behind Aristotle was that by identifying HIV-undiagnosed PWID and helping them visit drug and HIV treatment facilities soon after diagnosis, HIV transmission rates will eventually decline. Aristotle collaborated closely and harmonically with non-governmental organizations and state agencies, especially the Greek Organization against Drugs (OKANA), which offered some of its offices in downtown Athens for Aristotle services delivery. Eventually, Aristotle managed to significantly decrease the HIV-undiagnosed fraction and HIV incidence among PWID in Athens, and the number of reported HIV cases has been rather stable in that group since 2014 [14].

It is important to understand if and how prevention approaches among PWID work. HIV testing and linkage to care help prevent HIV transmission by identifying undiagnosed HIV-infected people and helping them start potent antiretroviral treatment, which reduces viral load. HIV testing may also help in terms of prevention if people who receive an HIV diagnosis change behavior to protect their sexual or injecting partners from acquiring HIV. Awareness of HIV infection was correlated with lower prevalence of high-risk sexual behavior in a literature-based meta-analysis published in the early 2000s [15]. Previous research among PWID has produced conflicting results [16,17,18,19,20,21,22,23]. For instance, some studies showed that PWID who knew that they were HIV-infected were more likely to use condoms and less likely to give their used injecting equipment to other PWID [16, 19]. Other studies, however, found that risky behaviors were more prevalent among PWID who had received a diagnosis of HIV than among those who were unaware of their HIV infection or HIV negative [22]. There were also studies that found no association between HIV awareness and drug use behavior [23]. Notification of infection with another blood-borne pathogen, i.e., hepatitis C virus (HCV), has been associated with decreasing rates of syringe sharing in one study [24] and of drug injection in another [25].

Given the uncertainty concerning the association between HIV awareness and behavior among PWID and the opportunity to address it taking advantage of the longitudinal nature of Aristotle, the aims of this analysis were: (a) to study trends in high-risk drug injection-related and sexual behaviors among Aristotle participants over the course of the intervention; and (b) to compare the likelihood of high-risk drug injection-related and sexual behaviors between people who were knowledgeable of their HIV-positive status and people who did not know that they had been infected with HIV.

Materials and methods

Description of Aristotle

Aristotle was conceptualized, designed, and implemented by a research group in the Department of Hygiene, Epidemiology, and Medical Statistics at the Medical School of the National and Kapodistrian University of Athens, and ran between mid-2012 and end of 2013. The National Strategic Reference Framework 2007–2013, the European Social Fund, national resources, and the Hellenic Scientific Society for the Study of AIDS and Sexually Transmitted Diseases funded and supported this intervention. Aristotle focused on PWID and aimed to offer HIV testing, to increase the rate of HIV diagnosis, and to improve linkage to care.

In terms of design, Aristotle [11,12,13, 26] consisted of five successive enrollment rounds (A, B, C, D, E) using respondent-driven sampling. Each enrollment round lasted 10–12 weeks with between-rounds breaks of 1 to 4 weeks. Selected PWID acted as seeds to begin the chain referral process in each round (5–11 per round). Seeds received coupons and were asked to deliver them to three PWID from their social environments. The coupons had unique numbers linking each recruiter with his/her potential recruits.

PWID who visited the Aristotle site were eligible to participate in an RDS round if they: (i) held a valid RDS coupon (all but seeds); (ii) had been involved in drug injection without prescription in the past 12 months; (iii) were aged ≥18 years; (iv) were residents of Athens Metropolitan Area; and (v) came to the Aristotle site for the first time in the current testing round with the intention to participate (PWID could participate in multiple enrollment rounds but only once in each round). All participants gave written informed consent.

Experienced Aristotle staff interviewed the participants (computer-assisted personal interviews) based on the National HIV Behavioral Surveillance System (NHBS) questionnaire for PWID, appropriately adjusted to the Greek setting and with additional items that were of interest [27]. The questionnaire included items on demographics, injecting network size, accommodation status, history of incarceration, history of previous HIV testing, HIV status, sexual practices, and drug use history and practices.

Participants gave blood that was tested for HIV by a microparticle EIA anti-HIV-1/2 assay (AxSYM HIV-1/2 gO; Abbott Laboratories, Abbott Park, IL). Western blot (MP Diagnostics, Singapore) was used to confirm reactive results.

After the interview and the blood collection, participants received their primary monetary incentive, sterile syringes and injection paraphernalia, condoms, and leaflets. The monetary incentive included 5 Euros for participation in Aristotle (interview and blood collection); 3 Euros when the participant came back to receive his/her HIV-test results; and up to 9 Euros in total when his/her recruits were enrolled in the program. Those who tested HIV positive were referred to infectious disease clinics and to Opioid Maintenance Treatment (OMT) programs of the Greek Organization Against Drugs. Needle and syringes were also distributed by the Greek Organization Against Drugs and several non-governmental organizations [12, 13]. Participants also received three coupons to distribute them to other PWID. This recruitment chain resulted in the enrollment of approximately 1400 PWID in each round.

Drug injection-related behaviors

Based on responses to relevant questionnaire items, high-risk drug injection-related behaviors were defined as follows: i) Injecting drugs at least once per day in the past 12 months; ii) Reporting receptive syringe sharing about half of the time, most of the time or all of the time the participant injected drugs in the past 12 months; iii) Reporting receptive syringe sharing the last time the participant injected drugs; iv) Practicing drug division with a syringe that someone else had already injected about half of the time, most of the time or all of the time the participant injected drugs in the past 12 months.

Sexual behaviors

High-risk sexual behavior was operationalized as condomless sexual encounters (vaginal or anal sex) in the last year (participants answered “usually no” or “never” to the question about condom use). Males were asked whether they used condom with a female or male partner. Women PWID were asked about whether their male partner used condom when they had sex.

The exact wording of questions and responses for drug injection-related and sexual behaviors is given in the Additional file 1.

HIV awareness

Participants were classified as aware of their HIV infection (AHS) if their self-reported HIV-positive status at the interview was in agreement with the positive result of their blood test. HIV-positive unaware (UHS) were those who did not know about their infection when they tested HIV positive. HIV-negative participants were those whose blood test was negative for HIV. Participants could be reclassified over the course of Aristotle if they had become aware of their HIV infection or had acquired HIV.

Statistical analysis

Differences in demographic parameters and high-risk behaviors among the different groups were assessed using chi-squared tests and Kruskal–Wallis tests. A non-parametric test for trend was used to assess changes over time.

There were some parameters that dictated the selection of a certain advanced statistical method. First, some PWID participated in more than one enrollment rounds, which resulted in clustered data with multiple measurements on some of the participants at different times. Observations from the same participants may be correlated, while those from different subjects are assumed to be independent. Failure to account for correlation of within-subject measurements can result in invalid standard errors and erroneous findings. Second, drug injection-related and sexual behaviors were binary outcomes (high-risk versus less risky behavior or no risk) in these analyses measured repeatedly for some Aristotle participants. Awareness of HIV serostatus was also a time-dependent covariate. Multiple conventional logistic regression analyses of outcomes and covariates at each time-point (round) could inflate type I error rate. Third, high-risk behaviors might not change regularly over time, i.e., the probability of change may differ between segments of Aristotle rounds. In this case, a uniform regression function cannot be applied to the data. In order to accommodate the above-mentioned issues, piecewise linear generalized estimating equation models (GEE with logit link function) were selected to regress binary repeated outcomes (separate for each outcome) against covariates allowing for different slopes of change [24, 25, 28,29,30]. GEE are an extension of generalized linear models for longitudinal data and belong to the family of marginal models that take into account the averaged relationship in the population.

The choice of change point (or breakpoint) for the piecewise models was based on the graphical examination of the data and modelling procedures. Segmented GEE models were obtained by a two-piece definition of the regression function over two intervals of the domain of covariates (one segment from round A to round B and one segment from round B to E).

Given the potential correlation of measurements on the same subject, a working correlation (a hypothesized relationship between repeated observations on a participant) has to be defined a priori for the estimation of model parameters. These analyses assumed an unstructured correlation within each Aristotle participant.

All analyses were performed in Stata 11.1 [31].

Results

Sociodemographic characteristics, drug injection-related and sexual behaviors of all participants at their first visit (it could be in any sampling round) in Aristotle

Overall, 3320 PWID were enrolled in Aristotle across all 5 rounds. Of these, 53.8% participated only in one round, 20.5% in 2 rounds, 14.1% in 3 rounds, 11.3% in 4 rounds, and 7.9% in all rounds. Therefore, the total number of interviews was 7110. Sociodemographic characteristics and risk behaviors at first participation in Aristotle by gender are shown in Table 1. Participants were mostly males (2807, 84.5%) and from Greece; one third were homeless, currently or in the past 12 months; 64.1% said that they lacked health insurance; and almost half had history of imprisonment. The median age was 34.2 years.

Table 1 Baseline sociodemographic characteristics, and drug injection-related and sexual behaviors by gender among all participants at their first visit in Aristotle (2012-2013, N=3320 People Who Inject Drugs)

The median duration of injection drug use was 12 years and the primary substance of use was heroin. More than one third of the participants reported at least daily injection of drugs with a median of 3 injections in a usual day; 20.6% reported receptive syringe sharing when they last injected; 8.0% reported receptive syringe sharing at least half the times they injected drugs in the past 12 months; and 37.2% said they divided drugs at least half of the times they injected drugs in the past 12 months with a syringe that someone else had used before.

More than half of the male participants (56.7%) reported that they consistently (always or usually yes) used condoms while 37.6% of female participants said so when they were asked about use of condoms by their male partners (Table 1).

Sociodemographic characteristics, drug injection-related and sexual behaviors by awareness of HIV infection at first participation in Aristotle

At first participation in Aristotle, of 3320 PWID, 506 (15.2%) were positive for HIV. Of the HIV-positives, 127 (25%) were aware of their infection. Awareness of HIV infection at first participation was associated with female gender, Greek nationality, history of participation in OMT programs, and less frequent drug injection (less than once per day) in the past 12 months (Table 2). Moreover, HIV positive females who knew about their infection at their first visit to Aristotle were more likely to report that their male partners used condoms than HIV positive females who were not aware of their HIV status (p = 0.022). In males, condom use was not associated with awareness of HIV infection at their first visit to Aristotle (Table 2).

Table 2 Sociodemographic characteristics, drug injection-related and sexual behaviors by awareness of HIV infection at first participation (Aristotle, 2012–2013, N = 506 HIV-positive People Who Inject Drugs)

Trends in drug injection-related behaviors

Figure 1a shows changes in high-risk injecting behaviors across Aristotle rounds. The reported prevalence of high-risk drug injection-related behaviors including injecting at least once per day in the last 12 months, dividing drugs at least half of the times the participant injected drugs in the past 12 months with a syringe someone else had used before, and receptive syringe sharing at least half of the times the participant injected drugs in the past 12 months, declined significantly (p for trend < 0.001). There was no change, however, in the proportion of PWID who reported that they had shared a syringe the last time they injected.

Fig. 1
figure 1

Prevalence of (a) drug injection-related behaviors and (b) condom use over the five rounds of Aristotle (round A to E)

Trends in sexual behaviors

Males reported use of condoms more frequently than females throughout the course of Aristotle. The reported prevalence among males remained, more or less, the same in all rounds. In females, there was a small increase from round A to B but condom use gradually declined from the second to the last round. There was not however any statistically significant change in condom use among both males and females across the Aristotle rounds (Fig. 1b).

Trends in prevalence of HIV and in the proportion of HIV-infected people who were aware of their infection among first-time participants in each round

More than half of all HIV-positives (280/506; 55.3%) in Aristotle were found in the first enrollment round (Fig. 2). The prevalence of HIV among first-time participants decreased across rounds (19.8% in round A to 10.6% in the last round).

Fig. 2
figure 2

HIV status and awareness of HIV infection among participants in Aristotle at their first visit (overall and by round)

The proportion of HIV-infected participants who knew about their infection at their first visit in Aristotle increased from 21.8% (61/280) in round A, to 31% (31/100) in round B and to 36.4% (12/33) in the last round of the program (Fig. 2).

Awareness of HIV serostatus and drug injection-related behaviors

The prevalence of drug injection-related behaviors among AHS, including injecting drug use at least once per day in the past 12 months, receptive syringe sharing at least half of the times the participant injected drugs in the past 12 months, and dividing drugs at least half of the times the participant injected drugs in the past 12 months with a syringe someone else had used before, decreased from round A to round Ε (Fig. 3a, b, c, d).

Fig. 3
figure 3

Trends in the reported prevalence of (a) injecting drugs at least once per day (Frequency of Injection – FI), (b) dividing drugs at least half of the times the participant injected drugs in the past 12 months with a syringe someone else had used before (DDUS), (c) receptive syringe sharing at least half of the times the participant injected drugs in the past 12 months (RS12), and (d) receptive syringe sharing on last injection (RSLI), by HIV status and awareness of HIV infection over the five rounds of Aristotle (A to E)

Multivariable analyses using GEE models were adjusted for gender, age, origin, homelessness, education, history of imprisonment, and history of OMT. The odds of injecting drugs at least once per day in the past 12 months among AHS decreased by 66% [Odds Ratio (OR); 95% Confidence Interval (CI): 0.34 (0.19, 0.61)] from round A to B (Table 3). Similarly, among UHS, the odds of injecting drugs at least once per day in the past 12 months were 63% less in round B than in round A [OR (95% CI): 0.37 (0.25, 0.57]. Between rounds B and E, the odds of injecting drugs at least once per day in the past 12 months were slightly reduced by 16% [OR (95% CI): 0.84 (0.74, 0.96)] and by 6% [OR (95% CI): 0.94 (0.76, 1.18)] among AHS and UHS, respectively.

Table 3 Binary dependent variables measured repeatedly over the course of Aristotle (past 12 months: frequency of injecting drugs, receptive syringe sharing, dividing drugs with a syringe someone else had already used and condom use) regressed against covariates (Aristotle round and awareness of HIV status). Results from multivariable piecewise Generalized Estimating Equation analyses (Aristotle, 2012–2013, participants = 3320, observations = 7110, adjustment for gender, age, origin, homelessness, education, history of imprisonment, and history of Opioid Maintenance Treatment)

The odds of dividing drugs about at least half of the times the participant injected drugs in the past 12 months with a syringe someone else had used before (past 12 months) fell from round A to B by 90% [OR (95% CI): 0.10 (0.04, 0.23)] among AHS and by 63% among UHS [OR (95% CI): 0.37 (0.19, 0.72)]. The decline was significantly less (p = 0.02) among UHS than among AHS. There were not any significant changes in the odds of dividing drugs at least half of the times the participant injected drugs in the past 12 months with a syringe someone else had used before (past 12 months) from round B to E in either group.

Comparing round A to B, the odds of receptive syringe sharing at least half of the times the participant injected drugs in the past 12 months decreased by 47% in the round B among AHS [OR (95% CI): 0.53 (0.31, 0.91)] and by 33% among UHS [OR (95% CI): 0.67 (0.45, 0.99)]. Between rounds B and E, the odds of receptive syringe sharing at least half of the times the participant injected drugs in the past 12 months were reduced by 19% [OR (95% CI): 0.81 (0.71, 0.93)] among AHS and by 4% [OR (95% CI): 0.96 (0.77, 1.20)] among UHS.

HIV negatives experienced smaller decreases in the odds of high-risk drug injection-related behaviors from round A to B than AHS or UHS.

Awareness of HIV serostatus and sexual behaviors

Reported condom use did not significantly change in both males and females between rounds A and B. From round B to E, condom use among AHS males increased significantly by 24% [OR (95% CI): 1.24 (1.01, 1.52)]. A non-significant increase in condom use (21%) was observed among UHS males [OR (95% CI): 1.21 (0.88, 1.67)]. However, this difference in changes of condom use between AHS and UHS did not reach statistical significance. Interestingly, between rounds B and E, there was a slight 6% decrease in condom use among male HIV-negative participants [OR (95% CI): 0.94 (0.89, 0.99)]. There were no changes in condom use from round B to E among AHS [OR (95% CI): 0.86 (0.64, 1.17)], UHS [OR (95% CI): 0.88 (0.50, 1.55)], and HIV-negatives [OR (95% CI): 0.96 (0.85, 1.08)] in the female population of Aristotle.

Discussion

In response to a big outbreak among PWID in Athens, Greece, Aristotle, an RDS approach consisted of five successive rounds of HIV testing and subsequent linkage to care, was implemented. High-risk drug injection-related behaviors decreased over time, markedly from the first to the second enrollment round and slightly thereafter. Improvements were larger among HIV-positive participants who knew about their infection, especially regarding the practice of dividing drugs with a syringe someone else had used before. HIV-infected males also reported higher levels of condom use in the period between the second and the last round.

Only 25% of all HIV-positives identified in Aristotle were aware of their serostatus at their first visit to the program. This is rather striking but could be attributed to the fact that the outbreak in Athens was recent. This finding is in agreement with previous studies, which found that HIV-infected PWID remain unaware of their serological status for a certain time [20, 21, 32,33,34,35,36,37,38]. PWID might not seek HIV testing for a variety of reasons including stigma and discrimination [39,40,41,42,43,44], fear of finding out that they are infected, and their perception of being at low risk for HIV infection [38, 45]. Moreover, reduced access to HIV testing services or affordable antiretroviral treatment due to insufficient and incorrect knowledge, long waiting time, and lack of family support [46] may be another barrier for PWID to learning their serological status.

HIV-infected participants in Aristotle, who knew about their infection, were less likely over the course of the program than the HIV-infected participants who were unaware of their status to report high-risk injection-related behaviors, including daily drug injection, receptive syringe sharing, and especially dividing drugs with a used syringe. The role of awareness of HIV infection in behavior change among PWID remains unclear. Some research groups have reported that knowledge of HIV infection is associated with less high-risk injecting behaviors [16, 21, 47, 48]. However, other researchers have reported that the prevalence of high-risk behaviors was higher among AHS PWID than among UHS [20, 22] or that injection-related behavior is unrelated to the awareness of HIV serostatus [23]. The likely effect of HIV-awareness on behavior change in Aristotle could be explained by the fact that around half of its enrollees participated in several rounds, and were thus exposed to the multiplying effect of repeated counseling and referrals to OMT and infectious disease clinics. This longitudinal effect of Aristotle might partly also explain the smaller changes towards safer behaviors that were also observed among the HIV negative participants. In fact, the adoption of safer behaviors by all Aristotle participants are reflected to some degree in the sharp reduction of HIV incidence over the course of the program [14, 26].

Some studies have reported that HIV diagnosis and counseling increase the odds of condom use in HIV-serodiscordant couples [49], among males who were aware of their HIV+ status compared to those who were unaware of their HIV+ status [18] or among HIV positive females who are aware of their infection, as opposed to HIV-negatives [50]. In our study, although HIV-positive females who were aware of their serostatus were more likely to report condom use by their male partners at their first visit, their sexual behavior did not change throughout Aristotle. This could be explained perhaps by the fact that PWID who were informed of their infection and initiated antiretroviral treatment developed a perception of safety due to treatment receipt and thereby increased condomless sex [51, 52] despite counseling. Generally, condom use is remarkably low in stable relationships as opposed in commercial or casual sexual encounters, where is typically high [53, 54].

Reported condom use among males in Aristotle was not associated with awareness of HIV infection at their first visit to the program. However, there was a statistically significant increase in reported condom use among HIV-positive males between rounds B and E. This increase did not significantly differ between those who were aware and unaware of their infection. Previous research has shown that recently HIV-infected men who have sex with men reduce high-risk sexual behavior soon after their diagnosis as we also found for male PWID in Aristotle [55, 56]. However, a behavioral rebound towards riskier sexual behaviors was noted around 9 months after HIV diagnosis [56], which highlights the importance of intense counseling to HIV-positives during the first months following the diagnosis.

This analysis has a couple of limitations: a) Behavior-related data were self-reported, which raises concerns about potential social desirability bias. Given that illicit drug use and HIV-infection stigmatize people, PWID could under-report high-risk behaviors in order to be more socially acceptable during face-to-face interviews [15, 57]. Previous studies have shown, however, that self-reports are adequately valid for this type of research [58, 59]. In terms of the effect of the type of interview, researchers studying risk behaviors, including receptive syringe sharing among PWID, have not found differences between responses by audio-computer assisted self-interview (ACASI) technology and face-to-face interviews [15]. Other researchers, however, have observed over-reporting of socially accepted behaviors in face to face interviews [19, 57, 60]; b) The effect of awareness of HIV status on high-risk behaviors was observed in the context of a large-scale combination prevention program. For less intensive programs without integrated services, the generalizability of these findings is unknown; c) Aristotle was not a randomized intervention, which makes difficult to determine to what degree was causally related with outcomes such as incidence reduction or behavior change. However, the trends in drug injection-related behaviors among the participants were assessed in an unbiased way and the conclusions could be considered as valid. Moreover, a randomized intervention during an outbreak would be unethical.

Aristotle was unique as an RDS intervention in terms of size and coverage [12]. In a relatively short period of time (16 months) and in the context of a large HIV outbreak and severe financial obstacles, it identified 88% of the people who injected drugs in downtown Athens, tested them for HIV, and helped them access services [12]. In addition, Aristotle managed to get multiple estimates of both HIV incidence and prevalence over time [14], to inform molecular analyses of HIV transmission [61], and to capture changing behavioral patterns that put PWID at risk for HIV infection. At the same time, Aristotle collaborated nicely with drug treatment-related and hospital facilities, and non-governmental organizations, and established itself in the PWID community as a useful and safe intervention [12]. The success of Aristotle serves as an epidemiological and public health paradigm of effectiveness, efficiency, and collaboration that can inform and enrich future interventions. This is of particular importance given the multiple outbreaks that were observed since 2011 around the world, even in settings with high coverage of harm reduction services [62]. We believe that Aristotle-type approaches of much smaller size and coverage should be an essential component of routine public health practice but should also be able to rapidly expand as a response to emergencies.

Conclusions

This analysis of Aristotle data showed that the prevalence of high-risk drug injection-related behaviors decreases during this type of interventions and PWID aware of their HIV-positivity are less likely over time to report high-risk drug injection-related behaviors. These improvements in behaviors may partially explain the observed great drop in HIV incidence among PWID over the course of Aristotle. Therefore, knowledge of HIV-infection among PWID seems to be important, which makes imperative to implement programs that scale-up HIV testing and help people become aware of their status.

Availability of data and materials

The datasets generated and/or analysed during the current study are not publicly available because they include personal identifiers but anonymized datasets could be available from the corresponding author on reasonable request.

Abbreviations

AHS:

HIV-positive participants aware of their infection

CI:

95% Confidence Interval

DDUS:

Dividing drugs with a syringe someone else had used before

FI:

Frequency of Injection

GEE:

Generalized estimating eq.

HCV:

Hepatitis C Virus

HIV:

Human Immunodeficiency Virus

NHBS:

National HIV Behavioral Surveillance System

OMT:

Opioid Maintenance Treatment

OR:

Odds Ratio

PWID:

People Who Inject Drugs

RDS:

Respondent Driven Sampling

RS12:

Receptive syringe sharing in past 12 months

RSLI:

Receptive syringe sharing on last injection

UHS:

HIV-positive participants unaware of their infection

References

  1. World Health Organization. HIV/AIDS. 2019. https://www.who.int/news-room/fact-sheets/detail/hiv-aids. Accessed 11 Nov 2019.

    Google Scholar 

  2. Degenhardt L, Peacock A, Colledge S, Leung J, Grebely J, Vickerman P, et al. Global prevalence of injecting drug use and sociodemographic characteristics and prevalence of HIV, HBV, and HCV in people who inject drugs: a multistage systematic review. Lancet Glob Heal. 2017;5:e1192–207.

    Article  Google Scholar 

  3. Arendt V, Guillorit L, Origer A, Sauvageot N, Vaillant M, Fischer A, et al. Injection of cocaine is associated with a recent HIV outbreak in people who inject drugs in Luxembourg. PLoS One. 2019;14:e0215570.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  4. Giese C, Igoe D, Gibbons Z, Hurley C, Stokes S, McNamara S, et al. Injection of new psychoactive substance snow blow associated with recently acquired HIV infections among homeless people who inject drugs in Dublin, Ireland, 2015. Euro Surveill. 2015;20:30036.

    Article  Google Scholar 

  5. McAuley A, Palmateer NE, Goldberg DJ, Trayner KMA, Shepherd SJ, Gunson RN, et al. Re-emergence of HIV related to injecting drug use despite a comprehensive harm reduction environment: a cross-sectional analysis. Lancet HIV. 2019;6:e315–24.

    Article  PubMed  Google Scholar 

  6. Pharris A, Wiessing L, Sfetcu O, Hedrich D, Botescu A, Fotiou A, et al. Human immunodeficiency virus in injecting drug users in Europe following a reported increase of cases in Greece and Romania, 2011. Euro Surveill. 2011;16 http://0-www-ncbi-nlm-nih-gov.brum.beds.ac.uk/pubmed/22172301. Accessed 1 Sep 2017.

  7. Ragonnet-Cronin M, Jackson C, Bradley-Stewart A, Aitken C, McAuley A, Palmateer N, et al. Recent and rapid transmission of HIV among people who inject drugs in Scotland revealed through phylogenetic analysis. J Infect Dis. 2018;217:1875–82.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Campbell EM, Jia H, Shankar A, Hanson D, Luo W, Masciotra S, et al. Detailed transmission network analysis of a large opiate-driven outbreak of HIV infection in the United States. J Infect Dis. 2017;216:1053–62.

    Article  PubMed  PubMed Central  Google Scholar 

  9. Nikolopoulos G, Paraskevis D, Hatzakis A. HIV epidemiology in Greece. Future Microbiol. 2008;3:507–16.

    Article  CAS  PubMed  Google Scholar 

  10. Nikolopoulos GK, Sypsa V, Bonovas S, Paraskevis D, Malliori-Minerva M, Hatzakis A, et al. Big events in Greece and HIV infection among people who inject drugs. Subst Use Misuse. 2015;50:825–38.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Nikolopoulos GK, Fotiou A, Kanavou E, Richardson C, Detsis M, Pharris A, et al. National income inequality and declining GDP growth rates are associated with increases in HIV diagnoses among people who inject drugs in Europe: a panel data analysis. PLoS One. 2015;10:e0122367.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  12. Hatzakis A, Sypsa V, Paraskevis D, Nikolopoulos G, Tsiara C, Micha K, et al. Design and baseline findings of a large-scale rapid response to an HIV outbreak in people who inject drugs in Athens, Greece: the ARISTOTLE programme. Addiction. 2015;110:1453–67.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Sypsa V, Paraskevis D, Malliori M, Nikolopoulos GK, Panopoulos A, Kantzanou M, et al. Homelessness and other risk factors for HIV infection in the current outbreak among injection drug users in Athens, Greece. Am J Public Health. 2015;105:196–204.

    Article  PubMed  PubMed Central  Google Scholar 

  14. Sypsa V, Psichogiou M, Paraskevis D, Nikolopoulos G, Tsiara C, Paraskeva D, et al. Rapid decline in HIV incidence among persons who inject drugs during a fast-track combination prevention program after an HIV outbreak in Athens. J Infect Dis. 2017;215:1496–505.

  15. Marks G, Crepaz N, Senterfitt JW, Janssen RS. Meta-analysis of high-risk sexual behavior in persons aware and unaware they are infected with HIV in the United States: implications for HIV prevention programs. J Acquir Immune Defic Syndr. 2005;39:446–53.

    Article  PubMed  Google Scholar 

  16. Schlumberger MG, Desenclos JC, Papaevangelou G, Richardson SC, Ancelle-Park R. Knowledge of HIV serostatus and preventive behaviour among European injecting drug users: second study. European community study group on HIV in injecting drug users. Eur J Epidemiol. 1999;15:207–15.

    Article  CAS  PubMed  Google Scholar 

  17. Grau LE, White E, Niccolai LM, Toussova OV, Verevochkin SV, Kozlov AP, et al. HIV disclosure, condom use, and awareness of HIV infection among HIV-positive, heterosexual drug injectors in St. Petersburg, Russian Federation. AIDS Behav. 2011;15:45–57.

    Article  PubMed  Google Scholar 

  18. Mazhnaya A, Andreeva TI, Samuels S, DeHovitz J, Salyuk T, McNutt L-A. The potential for bridging: HIV status awareness and risky sexual behaviour of injection drug users who have non-injecting permanent partners in Ukraine. J Int AIDS Soc. 2014;17:18825.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Heimer R, Levina OS, Osipenko V, Ruiz MS, Sergeyev B, Sirotkin AV, et al. Impact of incarceration experiences on reported HIV status and associated risk behaviours and disease comorbidities. Eur J Pub Health. 2015;25:1089–94.

    Article  Google Scholar 

  20. Abel-Ollo K, Rahu M, Rajaleid K, Talu A, Rüütel K, Platt L, et al. Knowledge of HIV serostatus and risk behaviour among injecting drug users in Estonia. AIDS Care. 2009;21:851–7.

    Article  CAS  PubMed  Google Scholar 

  21. Rhodes T, Donoghoe M, Hunter G, Stimson G. Continued risk behaviour among HIV positive drug injectors in London: implications for intervention. Addiction. 1993;88:1553–60.

    Article  CAS  PubMed  Google Scholar 

  22. Avants SK, Warburton LA, Hawkins KA, Margolin A. Continuation of high-risk behavior by HIV-positive drug users: treatment implications. J Subst Abus Treat. 2000;19:15–22.

    Article  CAS  Google Scholar 

  23. Noor SW, Ross MW, Lai D, Risser JM. Drug and sexual HIV risk behaviours related to knowledge of HIV serostatus among injection drug users in Houston, Texas. Int J STD AIDS. 2014;25:89–95.

    Article  PubMed  Google Scholar 

  24. Bruneau J, Zang G, Abrahamowicz M, Jutras-Aswad D, Daniel M, Roy E. Sustained drug use changes after hepatitis C screening and counseling among recently infected persons who inject drugs: a longitudinal study. Clin Infect Dis. 2014;58:755–61.

    Article  PubMed  Google Scholar 

  25. Aspinall EJ, Weir A, Sacks-Davis R, Spelman T, Grebely J, Higgs P, et al. Does informing people who inject drugs of their hepatitis C status influence their injecting behaviour? Analysis of the networks II study. Int J Drug Policy. 2014;25:179–82.

    Article  CAS  PubMed  Google Scholar 

  26. Chan PA, Flanigan TP. Effective HIV prevention interventions and the need for rapid mobilization to address HIV outbreaks among at-risk populations. J Infect Dis. 2017;215:1491–2.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Gallagher KM, Sullivan PS, Lansky A, Onorato IM. Behavioral Surveillance among People at Risk for HIV Infection in the U.S.: The National HIV Behavioral Surveillance System. Public Health Rep. 2007;122(1_suppl):32–8.

    Article  PubMed  PubMed Central  Google Scholar 

  28. Aktas Samur A, Coskunfirat N, Saka O. Comparison of predictor approaches for longitudinal binary outcomes: application to anesthesiology data. PeerJ. 2014;2:e648.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Liang K-Y, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika. 1986;73:13–22.

    Article  Google Scholar 

  30. Huh D, Flaherty BP, Simoni JM. Optimizing the analysis of adherence interventions using logistic generalized estimating equations. AIDS Behav. 2012;16:422–31.

    Article  PubMed  PubMed Central  Google Scholar 

  31. StataCorp. Stata Statistical Software Release 11.1. Texas: StataCorp LP Coll Stn; 2009.

  32. Rhodes T, Platt L, Maximova S, Koshkina E, Latishevskaya N, Hickman M, et al. Prevalence of HIV, hepatitis C and syphilis among injecting drug users in Russia: a multi-city study. Addiction. 2006;101:252–66.

    Article  PubMed  Google Scholar 

  33. Niccolai LM, Toussova OV, Verevochkin SV, Barbour R, Heimer R, Kozlov AP. High HIV prevalence, suboptimal HIV testing, and low knowledge of HIV-positive Serostatus among injection drug users in St. Petersburg, Russia. AIDS Behav. 2010;14:932–41.

    Article  PubMed  PubMed Central  Google Scholar 

  34. Solomon SS, McFall AM, Lucas GM, Srikrishnan AK, Kumar MS, Anand S, et al. Respondent-driven sampling for identification of HIV- and HCV-infected people who inject drugs and men who have sex with men in India: a cross-sectional, community-based analysis. PLoS Med. 2017;14:e1002460.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Smith LR, Patterson TL, Magis-Rodriguez C, Ojeda VD, Burgos JL, Rojas SA, et al. Engagement in the HIV care continuum among key populations in Tijuana, Mexico. AIDS Behav. 2016;20:1017–25.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Mehta SH, Lucas GM, Solomon S, Srikrishnan AK, McFall AM, Dhingra N, et al. HIV Care Continuum Among Men Who Have Sex With Men and Persons Who Inject Drugs in India: Barriers to Successful Engagement. Clin Infect Dis. 2015;61:civ669.

    Article  Google Scholar 

  37. Abadie R, Goldenberg S, Welch-Lazoritz M, Fisher CB. Establishing trust in HIV/HCV research among people who inject drugs (PWID): insights from empirical research. PLoS One. 2018;13:e0208410.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Broz D, Wejnert C, Pham HT, DiNenno E, Heffelfinger JD, Cribbin M, et al. HIV Infection and Risk, Prevention, and Testing Behaviors Among Injecting Drug Users — National HIV Behavioral Surveillance System, 20 U.S. Cities, 2009. Morbidity and Mortality Weekly Report: Surveill Summaries. 2014;63:1–51.

  39. Qian H-Z, Schumacher J, Chen H, Ruan Y-H. Injection drug use and HIV/AIDS in China: review of current situation, prevention and policy implications. Harm Reduct J. 2006;3:4.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Balabanova Y, Coker R, Atun RA, Drobniewski F. Stigma and HIV infection in Russia. AIDS Care. 2006;18:846–52.

    Article  CAS  PubMed  Google Scholar 

  41. Cooke A, Saleem H, Mushi D, Mbwambo J, Hassan S, Lambdin BH. Convenience without disclosure: a formative research study of a proposed integrated methadone and antiretroviral therapy service delivery model in Dar Es Salaam, Tanzania. Addict Sci Clin Pract. 2017;12:23.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Nikolopoulos G, Pavlitina E, Muth SSQ, Schneider J, Psichogiou M, Williams LLD, et al. A network intervention that locates and intervenes with recently HIV-infected persons: The Transmission Reduction Intervention Project (TRIP). Sci Rep. 2016;6:38100.

  43. Terlikbayeva A, Zhussupov B, Primbetova S, Gilbert L, Atabekov N, Giyasova G, et al. Access to HIV counseling and testing among people who inject drugs in Central Asia: strategies for improving access and linkages to treatment and care. Drug Alcohol Depend. 2013;132:S61–4.

    Article  PubMed  Google Scholar 

  44. Ti L, Hayashi K, Hattirat S, Suwannawong P, Kaplan K, Kerr T. ‘Drug users stick together’: HIV testing in peer-based drop-in centres among people who inject drugs in Thailand. Sex Health. 2015;12:263.

    Article  PubMed  Google Scholar 

  45. Ahmed T, Long TN, Huong PT, Stewart DE. Drug injecting and HIV risk among injecting drug users in Hai Phong, Vietnam: a qualitative analysis. BMC Public Health. 2015;15:32.

  46. Kumar S, Gupte HA, Isaakidis P, Mishra JK, Munjattu JF. “They don’t like us … .”: Barriers to antiretroviral and opioid substitution therapy among homeless HIV positive people who inject drugs in Delhi: A mixed method study. PLoS One. 2018;13:e0203262.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  47. Noroozi A, Mirzazadeh A, Farhoudian A, Hajebi A, Khankeh HR, Higgs P, et al. Impact of HIV status notification on risk behaviors among men who inject drugs in Kermanshah, west of Iran. J Res Health Sci. 2016;16:116–21.

    PubMed  PubMed Central  Google Scholar 

  48. Armstrong G, Medhi GK, Mahanta J, Paranjape RS, Armstrong G, Medhi GK, et al. Undiagnosed HIV among people who inject drugs in Manipur , India. AIDS Care. 2015;27:288–92.

    Article  PubMed  Google Scholar 

  49. Rosenberg NE, Pettifor AE, De Bruyn G, Westreich D, Delany-Moretlwe S, Behets F, et al. HIV testing and counseling leads to immediate consistent condom use among south African stable HIV-discordant couples. J Acquir Immune Defic Syndr. 2013;62:226–33.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Turner AN, Miller WC, Padian NS, Kaufman JS, Behets FM, Chipato T, et al. Unprotected sex following HIV testing among women in Uganda and Zimbabwe: short- and long-term comparisons with pre-test behaviour. Int J Epidemiol. 2009;38:997–1007.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Kalichman SC, Price D, Eaton LA, Burnham K, Sullivan M, Finneran S, et al. Diminishing perceived threat of AIDS and increasing sexual risks of HIV among men who have sex with men, 1997–2015. Arch Sex Behav. 2017;46:895–902.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Chen Y. Treatment-related optimistic beliefs and risk of HIV transmission: a review of recent findings (2009-2012) in an era of treatment as prevention. Curr HIV/AIDS Rep. 2013;10:79–88.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  53. Chamratrithirong A, Kaiser P. The dynamics of condom use with regular and casual partners: analysis of the 2006 National Sexual Behavior Survey of Thailand. PLoS One. 2012;7:e42009.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  54. Bouhnik A-D, Préau M, Lert F, Peretti-Watel P, Schiltz M-A, Obadia Y, et al. Unsafe sex in regular partnerships among heterosexual persons living with HIV: evidence from a large representative sample of individuals attending outpatients services in France (ANRS-EN12-VESPA study). AIDS. 2007;21(Suppl 1):S57–62.

    Article  PubMed  Google Scholar 

  55. Gorbach PM, Drumright LN, Daar ES, Little SJ. Transmission behaviors of recently HIV-infected men who have sex with men. JAIDS J Acquir Immune Defic Syndr. 2006;42:80–5.

    Article  PubMed  Google Scholar 

  56. Gorbach PM, Weiss RE, Jeffries R, Javanbakht M, Drumright LN, Daar ES, et al. Behaviors of recently HIV-infected men who have sex with men in the year postdiagnosis: effects of drug use and partner types. J Acquir Immune Defic Syndr. 2011;56:176–82.

    Article  PubMed  PubMed Central  Google Scholar 

  57. Des Jarlais DC, Paone D, Milliken J, Turner CF, Miller H, Gribble J, et al. Audio-computer interviewing to measure risk behaviour for HIV among injecting drug users: a quasi-randomised trial. Lancet. 1999;353:1657–61.

    Article  CAS  PubMed  Google Scholar 

  58. Des Jarlais DC, Friedmann P, Hagan H, Friedman SR. The protective effect of AIDS-related behavioral change among injection drug users: a cross-national study. WHO multi-Centre study of AIDS and injecting drug use. Am J Public Health. 1996;86:1780–5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  59. Magura S, Goldsmith D, Casriel C, Goldstein PJ, Lipton DS. The validity of methadone clients’ self-reported drug use. Int J Addict. 1987;22:727–49.

    Article  CAS  PubMed  Google Scholar 

  60. Colchero MA, Bautista-Arredondo S, Cortés-Ortiz MA, Romero-Martinez M, Salas J, Sosa-Rubí SG, et al. Impact and economic evaluations of a combination prevention programme for men who have sex with men in Mexico. AIDS. 2016;30:293–300.

    PubMed  Google Scholar 

  61. Paraskevis D, Paraschiv S, Sypsa V, Nikolopoulos G, Tsiara C, Magiorkinis G, et al. Enhanced HIV-1 surveillance using molecular epidemiology to study and monitor HIV-1 outbreaks among intravenous drug users (IDUs) in Athens and Bucharest. Infect Genet Evol. 2015;35:109–21.

    Article  PubMed  Google Scholar 

  62. Des Jarlais D, Sypsa V, Feelemyer J, Abagiu A, Arendt V, Devaux C. Complacency is the new problem: Comparative Analysis of Recent Outbreaks of HIV among Persons Who Inject Drugs in Europe and North America. In: 22nd International AIDS Conference. Amsterdam; 2018. Available online at http://www.aids2018.org/Portals/4/File/AIDS2018_Abstract_book.pdf?ver=2018-08-06-160624-427

Download references

Acknowledgements

The authors would like to acknowledge the contribution of the following people. Aristotle staff: C. Bagos, M. Esmaili, M. Hasan, E. Karamanou, F. Leobilla, C. Mourtezou, E. Sidrou, M. Zigouritsas, M. Dimitropoulou, N. Kaguelari, M. Michail, S. Papadopoulos and A. Vlahos; Medical School, National and Kapodistrian University of Athens, Athens, Greece: V. Benetou, A. Gkegka, E. Hatzitheodorou, P. Iliopoulos, M. Katsimicha, G. Kokolesi, V. Milona, H. Papachristou, C. Rocca, M. Souvatzi, S. Tripou and A. Vassilakis; Organization Against Drugs: A. Panopoulos, K. Micha and K. Gazgalidis; NGO ‘Positive Voice’; NGO ‘Praksis’. The authors would also like to thank T. Wendel (City University of New York) for providing the questionnaire of the National HIV Behavioral Surveillance study.

Funding

This work was supported by the National Strategic Reference Framework 2007–2013 (Operational Program “Human Resources Development” 2007–2013, Priority Axis 14- Attica, Central Macedonia, Western Macedonia) [MIS 365008] and co-funded by the European Social Fund and national resources. Additional financial support was provided by the Hellenic Scientific Society for the Study of AIDS and STDs. The funding bodies had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

IDP was involved in conception of the study, interpretation of data, drafting of the manuscript, critical revision of the manuscript for important intellectual content, and approval of the final version. SKD was involved in drafting of the manuscript, interpretation of data, critical revision of the manuscript for important intellectual content, and approval of the final version. IG was involved in analysis of data, critical revision of the manuscript for important intellectual content, and approval of the final version. VS was involved in conception and design of the study, acquisition, analysis and interpretation of the data, critical revision of the manuscript for important intellectual content, and approval of the final version. MM was involved in design of the study, interpretation of data, critical revision of the manuscript for important intellectual content, and approval of the final version. KP was involved in analysis of data, critical revision of the manuscript for important intellectual content, and approval of the final version. DDJ was involved in interpretation of data, critical revision of the manuscript for important intellectual content, and approval of the final version. GKN was involved in interpretation of the data, drafting of the manuscript, critical revision of the manuscript for important intellectual content, and approval of the final version. AH was involved in conception and design of the study, acquisition and interpretation of data, critical revision of the manuscript for important intellectual content, and approval of the final version.

Corresponding author

Correspondence to Georgios K. Nikolopoulos.

Ethics declarations

Ethics approval and consent to participate

The Institutional Review Board of the Medical School of the National and Kapodistrian University of Athens approved Aristotle. All participants gave written informed consent.

Consent for publication

Not Applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Exact wording of questions and responses for drug injection-related and sexual behaviors.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pavlopoulou, I.D., Dikalioti, S.K., Gountas, I. et al. High-risk behaviors and their association with awareness of HIV status among participants of a large-scale prevention intervention in Athens, Greece. BMC Public Health 20, 105 (2020). https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-020-8178-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/s12889-020-8178-y

Keywords