- Research article
- Open Access
- Open Peer Review
Dynamics of HPV vaccination initiation in Flanders (Belgium) 2007-2009: a Cox regression model
© Lefevere et al; licensee BioMed Central Ltd. 2011
- Received: 31 March 2011
- Accepted: 14 June 2011
- Published: 14 June 2011
We investigated dynamic patterns and predictors of HPV vaccination initiation in Flanders (Belgium) by girls aged 12 to 18, between 2007 and 2009, the period immediately after the introduction of the HPV vaccines on the Belgian market. During this period the initiative for vaccination was taken by the girl, her family or the general practitioner/pediatrician/gynecologist.
We used a Cox regression model with time constant and time varying predictors to model hazard rates of HPV vaccination initiation. The sample existed of 117,151 female members of the National Alliance of Christian Mutualities, the largest sickness fund in Flanders.
The study showed that the hazard of HPV vaccination initiation was higher (1) for older girls, (2) for girls with a more favorable socio-economic background, (3) under more generous reimbursement regimes (with this effect being more pronounced for girls with weak socioeconomic backgrounds), (4) for girls that were informed personally about the reimbursement rules.
When the initiative for HPV vaccination lies with the girls, their families or the physicians (no organized setting) the uptake of the vaccines is affected by both individual and organizational factors.
- Preferential Treatment
- Sickness Fund
- Supplementary Insurance
- Vaccination Uptake
- Compulsory Insurance
On May 2nd 2007 the Belgian Superior Health Council (SHC) made its first recommendations regarding HPV-vaccination. It recommended, among others, that organized (i.e. school-based) HPV vaccination should be offered each year to a one-year birth cohort of girls aged 10, 11, 12 or 13 years . In spite of these recommendations, only from September 2010 on school-based HPV vaccination was introduced in Flanders (northern part of Belgium) for girls aged 12 years. Until then, the initiative for vaccination lied with the girls, their families or the physicians (general practitioners/paediatricians/gynaecologists).
In Belgium vaccination of adolescents can take place in- or outside the school-based vaccination system. When vaccines are offered inside the school-based system School Health Services are responsible for monitoring the vaccination status of the adolescents, collecting necessary immunization data, informing parents and children and offering the recommended vaccinations. Parents are free to accept this offer or to get their child vaccinated by a paediatrician, gynaecologist or general practitioner. Vaccines offered to adolescents within the school-based system as well as their administration are free of charge for the vaccinee. When adolescent vaccines are not incorporated in the school-based vaccination system the initiative for vaccination lies with the parents, adolescents or physicians. In that case, the administration costs of the vaccines have to be paid by the vaccinees. For some vaccines the vaccinees have to pay the full price, for others partial reimbursement is provided via the health insurance system. This insurance system is compulsory and covers the entire population. It is organized through private, non-profit sickness funds. The two largest sickness funds are the Christian (National Alliance of Christian Mutualities, henceforth NACM) and the Socialist Mutualities, together insuring about 75% of the population . Two reimbursement regimes exist. If a vaccine is included in the broad benefit package of the "Compulsory insurance" it is (partly) reimbursed by the national government and the reimbursement rates are identical for all sickness funds. A vaccine can also be included in the "Supplementary insurance" of a sickness fund (usually at a lower reimbursement rate than under the Compulsory insurance), a package of supplementary insurance benefits that a sickness fund is free to compose. The reimbursement rates are established by the sickness fund itself, and only hold for its own members.
We studied the dynamic patterns of HPV vaccination initiation in Flanders during the first 2.5 years after the introduction of the vaccines on the Belgian market (January 2007 -June 2009), so before the HPV-vaccines were offered free of charge through the school-based vaccination system. During our period of analysis, the vaccines were partially reimbursed by the health insurance system. The reimbursement regime (Compulsory versus Supplementary insurance) varied over time, mainly depending on the age of the girls (for details see below) and the membership of a respective sickness fund. We used a Cox regression model with time constant and time varying predictors to determine factors affecting the hazard of HPV vaccination initiation.
We analyzed data from one sickness fund, the NACM, which covers 53% of the Flemish population. All data extractions and analyses were performed at the Medical Management Department of the NACM under supervision of a medical advisor.
We selected girls aged 12 to 18 (years of birth 1989 to 1996) who were member of the NACM on December 31st 2006 and who were living in Flanders (N = 151,058). We excluded girls for whom one of the predictor variables (see below) was missing (N = 7,792) and those for whom a vaccine was reimbursed before they had become eligible for reimbursement (N = 1,113), assuming this to be the consequence of inaccuracies in the data. This left us with 142,153 girls.
These 142,153 girls belonged to 117,151 families. Because the similarity in vaccination behavior between sisters could affect the standard errors in our analysis, we randomly selected one girl per family to be included in the study. In this way, the final sample consisted of 117,151 girls.
The date of reimbursement of the first dose of a HPV-vaccine was retrieved from the reimbursement claims of the NACM.
Two demographic background variables (year of birth of the girls and province of residence) were available from the membership files of the NACM.
Two predictors reflecting the socio-economic background of the girls were the median income of the neighborhood in which they were living (in quintiles), and a variable indicating whether they were entitled to preferential treatment or not. To construct the first variable we used data from the Belgian Directorate-General Statistics and Economic Information on median net taxable incomes per neighborhood for 2006 (based on tax declarations). We classified each Flemish neighborhood into 1 of 5 income quintiles, linked the address of each girl to the neighborhood, and each neighborhood to the corresponding income quintile. The second variable was the right to preferential treatment. In the Belgian health insurance, certain categories of people enjoy this "preferential treatment", which means they pay lower co-payments. At the time of the analysis, there were two basic grounds for preferential treatment eligibility. First, people receiving certain social benefits (social assistance, guaranteed income for elderly, guaranteed income for disabled), and their partners and descendants, were automatically entitled to preferential treatment. Second, certain categories of people (most importantly: orphans, widows, widowers, disabled, elderly, long term unemployed, children with severe mental or physical illnesses) and their partners and descendants were entitled to preferential treatment after an income test had shown that their household income was below a certain threshold. In both cases, a low household income is a direct or indirect condition for preferential treatment. In our analysis a girl was said to have a right to preferential treatment if at least someone in the family was entitled to this preferential treatment (indicating a low household income) on December 31st 2006.
A final variable added to the analysis was whether or not the girl had received an information letter on the inclusion of HPV vaccination in the package of Compulsory insurance. When this measure was introduced on November 1st 2007, the NACM proactively informed the girls approaching the maximum age for reimbursement (girls born between November 16th 1991 and December 31st 1992) on the reimbursement rules. In the letter (sent on October 31st 2007) objective information about the vaccine and the reimbursement was given. Emphasis was put on the fact that they did not have a lot of time left to get their first vaccine, since no reimbursement would be granted after their 16th birthday.
First, we looked at the bivariate associations between HPV vaccination initiation and some background characteristics. The significance of these associations was assessed by means of the (two-sided) chi-square test. For this analysis, HPV vaccination initiation was an indicator denoting whether or not at least one dose of the HPV vaccine was reimbursed to a girl during our period of analysis.
Next, we estimated a Cox regression model with time-constant and time-dependent covariates (SAS procedure PROC PHREG) to model the time to HPV vaccination initiation. HPV vaccination initiation was then the age (in days) at which the first HPV vaccine dose for a girl was reimbursed. It was calculated as the number of days between the date of reimbursement of the first dose of a HPV vaccine and the date of birth of the girl. Year of birth of the girl, province of residence, preferential treatment and median income of the neighborhood where the girl was living were added as time-constant variables. Three time-varying variables were added. The first two indicated the reimbursement regime, with the Compulsory insurance as the reference category and the two other regimes (Supplementary insurance strict and flexible) as time varying indicators taking on value 1 in periods when the regime was in place and value 0 otherwise. The second was the receipt of a NACM letter. For each girl born between November 16th 1991 and December 31st 1992, this variable was an indicator taking value 1 in the period from November 1st 2007 to the sixteenth birthday of the girl and value 0 at other times. For the other girls in the analysis, the indicator took on value 0 over the whole period of analysis. Because it was possible that the cost of the vaccines and the NACM letter had a different impact on HPV vaccination initiation by people from different socio-economic backgrounds [4, 5] we added two interaction effects: one between the type of reimbursement regime (i.e. Supplementary insurance (flexible and strict taken together) versus NIHDI reimbursement) and the right to preferential treatment, and one between receipt of the NACM letter and the right to preferential treatment.
Following the suggestion by Therneau and Grambsch periods in which a girl was not at risk (either because the vaccine did not exist or because the girl was not eligible for reimbursement) were treated as missing .
The results of our Cox regression are expressed in Hazard Ratios (HR). A HR indicates the relative likelihood of HPV vaccination initiation in two groups of people with different values of a predictor at any given point in time. It can also be interpreted as the likelihood that a girl in the group with higher hazard initiates HPV vaccination first , an interpretation that is intuitively easier to understand.
HPV vaccination initiation according to background characteristics
No vaccination initiation
P (chi square)
Year of birth
Median income neighborhoodA
Cox regression model
Cox regression model: Hazard of HPV vaccination initiation
Year of birth
Median income neighborhood
Quintile 3 (base)
Preferential treatment (Yes) * NACM reimbursement (strict or flexible)
First, girls eligible for reimbursement under the Compulsory insurance had a substantially higher hazard of HPV vaccination initiation than girls eligible for reimbursement under the Supplementary insurance. Controlling for other factors, the hazard of starting HPV vaccination under the strict Supplementary insurance was only 9% of the hazard under the Complementary insurance ([HR] = 0.09, 95% CI 0.09-0.09). The hazard of starting HPV vaccination under the flexible Supplementary insurance was even lower: only 1% of the hazard under the Complementary insurance ([HR] = 0.01, 95% CI 0.01-0.01). For people with preferential treatment this effect was stronger, as indicated by the negative sign of the interaction between having a right to preferential treatment and being eligible for Supplementary insurance reimbursement.
Second, the hazard of HPV vaccination initiation was higher for girls with a more favorable socio-economic background. The hazard of HPV vaccination initiation for girls with preferential treatment was only 55% of the hazard for girls without preferential treatment ([HR] = 0.55, 95% CI 0.52-0.58). Likewise, the hazard differed according to the median income of the neighborhood where the girl was living.
Fourth, girls who were personally informed about the Compulsory insurance reimbursement and the fact that they were approaching the age limit had a substantially higher hazard of HPV vaccination initiation ([HR] = 2.28, 95% CI 2.08-2.50).
By introducing a variable in the model that indicated whether a girl had no, one or two or more sisters in the same age group we tested whether having a sister affected the vaccination behavior. Introducing this variable did not significantly change the parameter estimates of the other variables.
The organization of HPV vaccination and local circumstances vary widely between countries, and so does HPV vaccination uptake. Previous large-scale studies using individual level data investigated HPV vaccination uptake in an organized setting, be it through mass vaccination sessions  or via school-based vaccination [9–11]. We looked at HPV vaccination initiation in a non-organized setting, whereby the initiative for vaccination lied with the girls, their family or the gynecologist/pediatrician/general practitioner. We focused on vaccination initiation and not on vaccination completion (a complete regimen of the vaccine consists of 3 doses). Note that of the 45,614 girls that started HPV vaccination before November 2008 (leaving them at least 9 months to complete the vaccine regimen within our period of analysis, the recommended interval between the first and the last dose being 6 months) 86% completed the regimen by June 2009.
There can be various reasons why the probability of HPV vaccination was higher under the Compulsory insurance as compared to the Supplementary insurance. Most likely the generosity of the system played an important role. The full price of the HPV vaccines was 130.22 euro per dose (3 doses required to be fully vaccinated). Under the Compulsory insurance, the reimbursement was 119.42 euro per dose (123.02 euro for people eligible for preferential treatment), leaving a co-payment of 10.80 (7.20) euro per dose. Under the Supplementary insurance, the reimbursement was only 50 euro per dose (75 euro in case of preferential treatment). Reducing out of pocket costs has been shown to improve vaccination uptake for various children, adolescent and adult vaccines [4, 12–15]. In addition, the administrative procedure of each of the reimbursement regimes might also have been important. Under the Compulsory insurance the girl buying the vaccine only had to pay the non-refundable part of the price of the vaccine. Under the Supplementary insurance the girl had to first advance the full price of the vaccine, after which part of it was refunded. Further, there was also substantially more media attention and advertising (towards girls, their families and medical doctors) for the Compulsory insurance. These might have had an important influence on the uptake of the vaccine: it has been shown that mass media interventions can significantly affect various health behaviors .
Vaccination uptake was substantially lower among girls from lower socio-economic backgrounds. Such association between socio-economic status and adolescent vaccination has been found in other studies, too [8, 17–22]. Socio-economic differences in HPV vaccination uptake are particularly relevant since people with low SES have a higher risk of contracting cervical cancer [23, 24]. An obvious explanation might be the financial barrier caused by the co-payments [4, 12–15]. However, most likely other reasons have also played a role, such as a differential influence of media attention on people with different socio-economic backgrounds or advertising being more directed to certain categories of people. Free, school-based HPV vaccination, as organized in Flanders from September 2010 on, might help to overcome this problem. School vaccination programs are indeed considered as the best way to achieve good adolescent vaccination uptake . Evaluating the performance of school vaccination programs in Flanders with regard to socio-economic differences in vaccination uptake however remains difficult: socio-economic differences are found for some of the vaccines currently included in the school vaccination program, too, but these might be partially attributed to differences in the availability of documentation on vaccination at home, since studies have to rely on documentation available at home .
Older girls had a substantially higher probability of vaccination initiation than younger girls. While these findings are in line with recent findings from the US , in the Netherlands a different relationship between age and HPV vaccination has been found, with both the oldest and the youngest age categories having a slightly lower HPV vaccination uptake . A possible explanation for the age effect we found is an increased parental acceptance of the vaccine as the age of the daughter increases . Another possible explanation is procrastination: if girls had a long period of eligibility for reimbursement before them, they might have been less inclined to start with vaccination.
Finally, the letter by which girls were informed about their eligibility for HPV vaccine reimbursement and the approaching age limit had a large influence on vaccination initiation. This is in line with previous research in which patient reminder and recall systems have been shown to significantly affect vaccination behavior .
We studied determinants of HPV vaccination initiation in Flanders (Belgium). Despite the fact that during our period of analysis the initiative for vaccination lied with the girls, their family or the gynecologists/pediatricians/general practitioners (no organized setting), vaccination uptake was high for certain subcategories of girls. However, large socioeconomic differences were found. This suggests that school-based vaccination, as it was introduced in Flanders in September 2010 (although with the possibility to refuse the vaccine or to get vaccinated by a physician outside the school-based system), might be preferred. Future research could give more insight in the evolution of HPV vaccination uptake under this school-based system, as well as in the factors underlying the observed socioeconomic differences.
Acknowledgements and Funding
Funding was provided by the Research Foundation Flanders (FWO) within the framework of the PhD of EL. NH also gratefully acknowledges financial support from 'SIMID', a strategic basic research project funded by the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT), project number 060081 and by the IAP research network number P6/03 of the Belgian Government (Belgian Science Policy).
The research was carried out independently: the Research Foundation Flanders/Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT)/IAP research network had no role in study design, collection/analysis/interpretation of the data, in writing the report or in the decision to submit the paper for publication.
All data extractions and analyses were performed at the Medical Management Department of the NACM under supervision of a medical advisor. Since we worked with anonymized administrative data no additional ethical approval was required.
- Vaccinatie tegen infecties veroorzaakt door het Humaan papillomavirus. [http://www.health.belgium.be/eportal/Aboutus/relatedinstitutions/SuperiorHealthCouncil/publications/factsheetsvaccination/index.htm]
- Schokkaert E, Van de Voorde C: Health care reform in Belgium. Health Economics. 2005, 14: S25-S39. 10.1002/hec.1027.View ArticlePubMedGoogle Scholar
- Simoens C, Sabbe M, Van Damme P, Beutels P, Arbyn M: Introduction of human papillomavirus (HPV) vaccination in Belgium, 2007-2008. Eurosurveillance. 2009, 14 (46): 21-24.Google Scholar
- Molinari NA, Kolasa M, Messonnier M, Schieber R: Out-of-pocket costs of childhood immunizations: a comparison by type of insurance plan. Pediatrics. 2007, 120 (5): 1148-1156. 10.1542/peds.2006-3654.View ArticleGoogle Scholar
- Bertrand M, Mullainathan S, Shafir E: Behavioral economics and marketing in aid of decision-making among the poor. Journal of Public Policy and Marketing. 2006, 25 (1): 8-23. 10.1509/jppm.25.1.8.View ArticleGoogle Scholar
- Therneau TM, Grambsch PM: Modeling survival data. Extending the Cox model. 2000, New York: Springer, 1: 2000View ArticleGoogle Scholar
- Spruance SL, Reid JE, Grace M, Samore M: Hazard ratio in clinical trials. Antimicrob Agents Chemother. 2004, 48 (8): 2787-2792. 10.1128/AAC.48.8.2787-2792.2004.View ArticlePubMedPubMed CentralGoogle Scholar
- Rondy M, van Lier A, van de Kassteele J, Rust L, de Melker H: Determinants for HPV vaccine uptake in the Netherlands: A multilevel study. Vaccine. 28 (9): 2070-2075.Google Scholar
- Ogilvie G, Anderson M, Marra F, McNeil S, Pielak K, Dawar M, McIvor M, Ehlen T, Dobson S, Money D, Patrick D, Naus M: A Population-Based Evaluation of a Publicly Funded, School-Based HPV Vaccine Program in British Columbia, Canada: Parental Factors Associated with HPV Vaccine Receipt. Plos Medicine. 7 (5):Google Scholar
- Brabin L, Roberts SA, Stretch R, Baxter D, Chambers G, Kitchener H, McCann R: Uptake of first two doses of human papillomavirus vaccine by adolescent schoolgirls in Manchester: prospective cohort study. British Medical Journal. 2008, 336 (7652): 1056-1058. 10.1136/bmj.39541.534109.BE.View ArticlePubMedPubMed CentralGoogle Scholar
- Roberts SA, Brabin L, Stretch R, Baxter D, Elton P, Kitchener H, McCann R: Human Papillomavirus vaccination and social inequality: results from a prospective cohort study. Epidemiology and Infection. 2011, 139 (3): 400-405. 10.1017/S095026881000066X.View ArticlePubMedGoogle Scholar
- Schaffer SJ, Humiston SG, Shone LP, Averhoff FM, Szilagyi PG: Adolescent immunization practices - A national survey of US physicians. Archives of Pediatrics & Adolescent Medicine. 2001, 155 (5): 566-571.View ArticleGoogle Scholar
- Centers for Disease Control and Prevention: Vaccine-preventable diseases: improving vaccination coverage in children, adolescents, and adults. A report on recommendations from the Task Force on Community Preventive Services. Morbidity and Mortality Weekly Report. 1999, 1-15.Google Scholar
- Newacheck PW, Hughes DC, Stoddard JJ: Children's access to primary care: differences by race, income and insurance status. Pediatrics. 1996, 97 (1): 26-32.PubMedGoogle Scholar
- Humiston SG, Rosenthal SL: Challenges to vaccinating adolescents - Vaccine implementation issues. Pediatric Infectious Disease Journal. 2005, 24 (6): S134-S140.View ArticlePubMedGoogle Scholar
- Grilli R, Ramsay C, Minozzi S: Mass media interventions: effects on health services utilisation. Cochrane Database of Systematic Reviews. 2002, 1Google Scholar
- Chao C, Velicer C, Slezak JM, Jacobsen SJ: Correlates for Human Papillomavirus Vaccination of Adolescent Girls and Young Women in a Managed Care Organization. American Journal of Epidemiology. 2010, 171 (3): 357-367. 10.1093/aje/kwp365.View ArticlePubMedPubMed CentralGoogle Scholar
- Middleman AB, Robertson LM, Young C, Durant RH, Emans SJ: Predictors of time to completion of the hepatitis B vaccination series among adolescents. J Adolesc Health. 1999, 25 (5): 323-327. 10.1016/S1054-139X(99)00063-4.View ArticlePubMedGoogle Scholar
- Seid M, Simmes DR, Linton LS, Leah CE, Edwards CC, Peddecord KM: Correlates of vaccination for hepatitis B among adolescents - Results front a parent survey. Archives of Pediatrics & Adolescent Medicine. 2001, 155 (8): 921-926.View ArticleGoogle Scholar
- Vandermeulen C, Roelants M, Theeten H, Depoorter AM, Van Damme P, Hoppenbrouwers K: Vaccination coverage in 14-year-old adolescents: Documentation, timeliness, and sociodemographic determinants. Pediatrics. 2008, 121 (3): E428-E434. 10.1542/peds.2007-1415.View ArticlePubMedGoogle Scholar
- Wallace LA, Bramley JC, Ahmed S, Duff R, Hutchinson SJ, Carman WF, Kitchin NRE, Goldberg DJ: Determinants of universal adolescent hepatitis B vaccine uptake. Archives of Disease in Childhood. 2004, 89 (11): 1041-1042. 10.1136/adc.2003.043687.View ArticlePubMedPubMed CentralGoogle Scholar
- Goldstein ST, Cassidy WM, Hodgson W, Mahoney FJ: Factors associated with student participation in a school-based hepatitis B immunization program. J Sch Health. 2001, 71 (5): 184-187. 10.1111/j.1746-1561.2001.tb07313.x.View ArticlePubMedGoogle Scholar
- Faggiano F, Partanen T, Kogevinas M, Boffetta P: Socioeconomic differences in cancer incidence and mortality. IARC Scientific Publications. 1997, 138:Google Scholar
- Newmann SJ, Garner EO: Social inequities along the cervical cancer continuum: a structured review. Cancer Causes & Control. 2005, 16 (1): 63-70. 10.1007/s10552-004-1290-y.View ArticleGoogle Scholar
- Hoppenbrouwers K, Vandermeulen C, Roelants M, Boonen M, Van Damme P, Theeten H, Depoorter AM: Studie van de vaccinatiegraad bij jonge kinderen en adolescenten in Vlaanderen in 2008. 2009, Vlaamse Overheid, Vlaams Agentschap Zorg en Gezondheid, Afdeling Toezicht Volksgezondheid, Team infectieziektenGoogle Scholar
- Dempsey A, Cohn L, Dalton V, Ruffin M: Patient and clinic factors associated with adolescent human papillomavirus vaccine utilization within a university-based health system. Vaccine. 2010, 28 (4): 989-995. 10.1016/j.vaccine.2009.10.133.View ArticlePubMedGoogle Scholar
- Dempsey A, Zimet GD, Davis R, Koutsky L: Factors that are associated with parental acceptability of Human Papillomavirus Vaccines: a randomized intervention study of written information about HPV. Pediatrics. 2006, 117 (5): 1486-1493. 10.1542/peds.2005-1381.View ArticlePubMedGoogle Scholar
- Szilagyi PG, Bordley C, Vann JC, Chelminski A, Kraus RM, Margolis PA, Rodewald LE: Effect of patient reminder/recall interventions on immunization rates - A review. JAMA - Journal of the American Medical Association. 1998, 284 (14): 1820-1827.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://0-www.biomedcentral.com.brum.beds.ac.uk/1471-2458/11/470/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.