Skip to main content
  • Research article
  • Open access
  • Published:

Validity and reliability of a self-report instrument to assess social support and physical environmental correlates of physical activity in adolescents

Abstract

Background

The purpose of this study was to examine the internal consistency, test-retest reliability, construct validity and predictive validity of a new German self-report instrument to assess the influence of social support and the physical environment on physical activity in adolescents.

Methods

Based on theoretical consideration, the short scales on social support and physical environment were developed and cross-validated in two independent study samples of 9 to 17 year-old girls and boys. The longitudinal sample of Study I (n = 196) was recruited from a German comprehensive school, and subjects in this study completed the questionnaire twice with a between-test interval of seven days. Cronbach’s alphas were computed to determine the internal consistency of the factors. Test-retest reliability of the latent factors was assessed using intra-class coefficients. Factorial validity of the scales was assessed using principle components analysis. Construct validity was determined using a cross-validation technique by performing confirmatory factor analysis with the independent nationwide cross-sectional sample of Study II (n = 430). Correlations between factors and three measures of physical activity (objectively measured moderate-to-vigorous physical activity (MVPA), self-reported habitual MVPA and self-reported recent MVPA) were calculated to determine the predictive validity of the instrument.

Results

Construct validity of the social support scale (two factors: parental support and peer support) and the physical environment scale (four factors: convenience, public recreation facilities, safety and private sport providers) was shown. Both scales had moderate test-retest reliability. The factors of the social support scale also had good internal consistency and predictive validity. Internal consistency and predictive validity of the physical environment scale were low to acceptable.

Conclusions

The results of this study indicate moderate to good reliability and construct validity of the social support scale and physical environment scale. Predictive validity was only confirmed for the social support scale but not for the physical environment scale. Hence, it remains unclear if a person’s physical environment has a direct or an indirect effect on physical activity behavior or a moderation function.

Peer Review reports

Background

For people of all ages, being physically active is a well-established precondition to health [14]. Especially for adolescents, an active lifestyle is necessary for growing up healthy and has been associated with numerous health benefits [5, 6]. For example, being regularly physically active increases cardiorespiratory fitness and high-density lipoprotein cholesterol and enhances psychological health [7]. International activity guidelines for adolescents require a minimum level of moderate-to-vigorous physical activity (MVPA) of 60 minutes per day [8, 9]. Yet, there is scientific consensus that many adolescents do not engage in a sufficient level of physical activity (PA) [10, 11].

Socio-ecological and socio-cognitive models explain health behaviors such as PA and have also been applied to children and adolescents [12]. These models postulate an interaction of individual and environmental factors that influence human health behaviors [1315]. It has been suggested [16] that environment-changing interventions are important in the field of public health because they may reach a large proportion of the population and achieve sustainable effects. Especially in adolescence, health promotion strategies should consider social and physical environmental aspects [14].

The concept of social support plays an important role in socio-ecological and socio-cognitive theories and is one of the most important social determinants on health behavior. This concept differs conceptually from social norms, modeling, social influence and social networks [17]. In adolescents, the main critical distinction in the social support construct has been made between the different sources or providers of support, respectively. Adolescence is the period of the second separation-individualization process where relationships are getting refined and renegotiated and the social environment changes [18]. While peers may take on a more prominent socially influential role, parents—who were the most important reference persons during childhood—continue to exert considerable influence on adolescents’ behavior. Other reference persons such as grandparents or teachers are less frequent sources of support as children are getting older [19]. As the most important reference persons, parents and peers are the main providers of supportive behavior for adolescents [18]. In addition, the findings of previous studies summarized by various reviews suggest positive effects of parental and peer support on adolescent PA [2024]. A meta-analysis confirms a significant moderate positive effect of parental behavior on children’s and adolescents’ PA behavior [22].

Furthermore, physical environments provide potential opportunities and barriers to engage in physically active lifestyles [25]. While various models postulate influences of physical environmental aspects on health behaviors, no comprehensive definition of the physical environment has been established. The behavior specific model, the ecological model of active living [15] describes the influences of the environment on active living on multiple levels. The perceived physical environment as one predictive dimension for active living includes the aspects safety, attractiveness, comfort, accessibility and convenience [15].

In the last decade public health research has focused on physical environmental influences in adolescents’ PA [26]. The state of research has been summarized in several reviews [2729] which have mostly confirmed the impact of the physical environmental dimensions postulated in the ecological model of active living. The most recent review [29] found associations between PA and some variables of the perceived physical environment including walking/biking facilities, traffic speed/volume, unspecified traffic safety and access to recreation facilities. Limstrand [27] identified significant correlations between environmental aspects such as short distance, nearby parks, playgrounds, sidewalks, perceived safety and young people’s use of sports facilities. A meta-analysis on the perceived environment and PA in adults revealed that having shops and services within walking distance explained the greatest amount of variance in PA [25].

While results of previous studies emphasize the importance of social support and physical environmental factors for increasing PA among adolescents, there is a lack of longitudinal and European studies, respectively [21, 28]. Appropriate methods for assessing social support and physical environment in adolescents are necessary to bridge this gap. During the last decade, research efforts have increasingly focused on the development of new instruments on this topic [3037]. However, some of these instruments are very detailed and extensive measurement methods [32, 33, 36], and most existing questionnaires are in English language and have been developed for use in North-America or Australia [31, 32, 36]. Because of differences in sports culture (e.g. sports clubs vs. institutionalized sports) and land-use culture (e.g. urban construction), cross-cultural invariance of the instruments can not be expected implicitly [35]. Thus, applying a questionnaire that accounts for the structural and social conditions of the country where a study will take place is critical [35].

Therefore, the development of appropriate, valid and reliable instruments on social support and physical environmental correlates of adolescent’s PA is necessary for longitudinal and European studies. The aim of this study was to assess the psychometric properties of a new German short self-report instrument for measuring social support and physical environmental determinants of PA in adolescents. Specifically, we assessed the construct validity, internal consistency, test-retest reliability and predictive validity.

Methods

Design

After questionnaire development, two separate studies were carried out to test the reliability and validity via cross-validation technique. Study I was conducted to estimate the factorial structure, reliability and predictive validity of the instrument. Study II was conducted to confirm the factorial structure of the amended scales that were determined in Study I via confirmatory factor analysis (CFA).

Both studies were approved by the ethics committee of the University of Konstanz and were conducted according to the Declaration of Helsinki.

Questionnaire development

The instrument on social support and physical environment of PA was specifically developed for use in the “Motorik-Modul” study (MoMo), a longitudinal survey of “Physical Fitness and Physical Activity as Determinants of Health Development of Children and Adolescents” [38]. Items on peer support were derived from the validated scales developed by Ommundsen and colleagues [35], and items on parental support mainly came from a German study on leisure time of adolescents [39]. One item on importance of sports participation was newly developed. Physical environment scales should include a range of items that cover different potential predictors of the physical environment [32]. Therefore, the physical environment scale included three factors (accessibility, convenience and safety) depending on the dimensions of the ecological model of active living [15] as described above. These dimensions have also been identified as the most important physical environment determinants of PA in adults [40] and presumably are also important for adolescents’ PA [27, 29]. Safety could be another aspect of the social environment. However, because safety has been part of physical environmental concepts [41] and is intimately linked with multiple characteristics of the physical environment [26], we included the safety dimension in the scale. All items of the physical environment scale were newly developed by an expert group of the MoMo project team. Five seventh-grade students completed the final versions of the scales to test their comprehensibility. The original version of this instrument is available on request from the first author.

Study I: factorial structure, reliability and predictive validity

Participants and data collection

For Study I, a longitudinal sample of 109 boys and 87 girls (N = 196) aged between 9 and 17 years (M = 12.8; SD = 1.6) was recruited from a comprehensive secondary school in Konstanz, Germany. Grade 5 to grade 9 students of all three traditional types of the tripartite German secondary school system were included (Hauptschule: N = 28; Realschule: N = 63; and Gymnasium: N = 105). After receiving informed consent by the participant and their parent, the participants completed the social support and physical environment self-report instrument and the MoMo Physical Activity Questionnaire for adolescents (MoMo-PAQ) twice at a between-test interval of seven days (t1 and t2). Between t1 and t2, participants wore an accelerometer and completed the Previous Day Physical Activity Recall (PDPAR) [42] for seven days. The study was conducted on schooldays from April to July 2009.

Measures

Social support

The social support scale includes two factors that are related to the two main providers of social support: parental support (8 items) and peer support (3 items). The answers are based on a four-point rating scale (e.g. “How important is sport in your family?” 1—“not at all” to 4—“very important”). Higher scores indicated higher perceptions of social support.

Physical environment

The factors of the physical environment scale were accessibility of recreation facilities (4 items), convenience (3 items) and safety (4 items). The answers are based on a four-point rating scale (e.g. “In the area I live in, there are sports clubs.” 1—“none” to 4—“many”). Higher scores correspond to a more activity friendly environment.

Physical activity

Objective assessments of PA were obtained using the ActiGraph GT1M accelerometer (ActiGraph; Pensacola, FL, USA). The ActiGraph GT1M is a biaxial accelerometer designed to detect vertical and horizontal accelerations ranging in magnitude from 0.05 to 2.00 G’s with a frequency response of 0.25 to 2.50 Hz. The measurement intervals were set to 10-second intervals. Cut points established by Freedson and colleagues [43] were used to calculate adolescents’ MVPA. The Actigraph GT1M has been shown to be a valid and reliable tool for assessing MVPA in children and adolescents [43, 44].

The MoMo Physical Activity Questionnaire (MoMo-PAQ) was used to assess self-reported habitual MVPA in adolescents [45]. The MoMo-PAQ consists of 28 items and measures frequency, duration, intensity and setting of PA. Data obtained with the MoMo-PAQ are sufficiently reliable (test-retest reliability: ICC = 0.68) and correlates significantly (r = 0.29) with accelerometry data [45].

The PDPAR [42] is a self-report measure of PA designed specifically for the cognitive abilities of children and adolescents [46]. In the current study, the PDPAR was used to measure the PA of the preceding week, which was termed ‘recent PA’. A separate table for each day in the week was provided for assessing PA of the preceding day. Each table was divided into several 60-minute time blocks. For each time block, participants could choose one of 38 enumerated activities that were grouped into the following categories: eating, sleeping/bathing, transportation, work/school, leisure time physical activities, and sports. Each activity could be rated according to its intensity (light, moderate, high and very high). The PDPAR has been shown to be a reliable and valid measure of PA of the preceding day in adolescents [47].

Statistical analysis

Statistical analyses were performed using PASW statistical software version 18.0 (SPSS Inc., Chicago, IL, USA). In Study I, the amount of missing data was very low for both the social support and physical environment scale (1.8% and 2.0% missing values, respectively). The MCAR-Test by Little [48] was not significant for the social support (χ2 = 121.2; df = 170) and physical environment scale (χ2 = 130.7; df = 121). Because the proportion of missing data was very low and not systematic, we used the method of list wise deletion for handling missing data.

Reliability

Internal consistency of the factors was estimated using Cronbach’s alpha and deemed acceptable for values greater than 0.6 [49, 50]. The internal consistency measured using Cronbach’s alpha is influenced by the extent of covariation among the items and by the number of items in the scales [49, 51]. Hence, there is a trade-off between scale brevity and good reliability. Items that contributed least to the factor’s internal consistency were removed [49]. The seven-day test-retest reliability of the latent factors was assessed using intra-class correlation. ICC estimates above 0.75 were considered as good reliability scores, estimates between 0.50 and 0.75 as moderate reliability scores, and estimates below 0.50 as poor reliability scores, respectively [52]. Reliability calculations were repeated with final factors that were determined using principal components analysis (PCA) as described below.

Factorial structure

To determine the factor structure of the instrument, separate PCAs with varimax (orthogonal) rotation were conducted with baseline data of Study I for each of the two scales. Analysis of eigenvalues in the scree plot [53] and the eigenvalue rule [54] were used to determine the number of factors to remain in the given scales. Items were required to have a loading of 0.45 or greater for being assigned to a factor [55]. Otherwise, the scale was modified by removing items with lower factor loadings to achieve better psychometric properties, and the PCA was subsequently re-run [33].

Predictive validity

Social support and physical environment are key predictors of adolescents' PA. Thus, we expected a positive correlation between the social support and physical environmental factors and PA behavior. To test the predictive validity of the instrument, different measures of PA were used. Bivariate correlations of the factors (measured at t1) with objectively measured MVPA (collected using accelerometry over seven consecutive days), self-reported recent MVPA (seven-day aggregate of PDPAR), and self-reported habitual MVPA (MoMo-PAQ; measured at t2) were calculated.

Study 2: confirmation of construct validity by cross-validation technique

Participants and data collection

Construct validity of the questionnaire was examined in Study II. The sample of this study consisted of 430 participants from the German Health Interview and Examination Survey for Children and Adolescents (KiGGS), a representative nation-wide German study [56] conducted from September 2009 to September 2010. The mean age was 13.7 years (SD = 1.7 years) and the sample included 221 boys (51.4%) and 209 girls (48.6%). After informed consent was obtained from the participant and their parent, the participants completed the social support and physical environment self-report instrument as described above.

Measures

Social support and physical environment were measured using the same scales as described above for Study I.

Statistical analysis

Statistical analyses were performed using AMOS statistical software version 18.0 (SPSS Inc., Chicago, IL, USA). In Study II, the amount of missing data was very low for both the social support scale and the physical environment scale (0.7% and 0.3% missing values, respectively). The MCAR-Test by Little [48] was not significant for the social support (χ2 = 78.3; df = 93) and physical environment scale (χ2 = 57.0; df = 54). Because the proportion of missing data was very low and not systematic, we used the method of list wise deletion for handling missing data.

Construct validity

To test the results of the explorative factor analysis of Study I (PCA), a cross-validation was conducted using CFA with the independent data set of Study II. To assess the appropriateness of the models, several indices of fit were used. The χ2statistic assesses absolute fit of the model to the data, is very sensitive to sample size and suggests rejection of the hypothesized model in most cases [57]. The root mean square error of approximation (RMSEA) describes closeness of fit. Values of the RMSEA ≤ 0.06 reflect close and acceptable fit of the model [58]. In addition, if zero is contained in the 90% confidence interval (CI) around the RMSEA point estimate, a good fit is indicated. The Comparative Fit Index (CFI) tests the relative improvement in fit by comparing the proposed model to a baseline model [59]. Values for the CFI around 0.90 were considered acceptable while values around 0.95 indicated a good fit [58, 59].

Results

Descriptive statistics of demographic characteristics and social support scale scores of both studies are summarized in Table 1. Subjects in Study I participated on average in 39.6 min (SD=22.2 min) objectively measured MVPA per day and 68.5 min (SD=17.2 min) self-reported recent MVPA per day measured by the PDPAR. The self-reported habitual MVPA measured by the MoMo-PAQ was 88.6 min (SD=85.5 min) per day.

Table 1 Mean ± 1 standard deviation demographics and social support and physical environment factors of Study I and Study II

Social support scale

Three items were removed from the social support scale (Final versions of the scales are presented in Additional file 1), because they did not contribute to the internal consistency of their factor. According to the Kaiser and scree criterion, the PCA conducted in Study I (Table 2) extracted two factors from the social support scale. These factors describe the constructs of parental support and peer support. Communalities of the items ranged from 0.47 to 0.73, and the factor loadings ranged from 0.66 to 0.85. Both factors explained 58.2% of variance. The factor structure resulting from the PCA was cross-validated by CFA with the sample of Study II. According to the criteria of Hu [58], the fit of the measurement model in the sample of Study II was good for the two-factor structure of the social support scale (χ2=40.50; df=19; p<0.01; CFI=0.98; RMSEA=0.05 [90% CI=0.03-0.07]).

Table 2 Factor structure (varimax rotated solution) and reliability of social support scale (N = 196)

Cronbach’s alphas of both social support factors (α parental support =0.78; α peer support =0.70) were acceptable (Table 2). The parental support scale had good (ICC=0.83) and the peer support scale had moderate (ICC = 0.67) test-retest reliability, respectively. To assess the predictive validity, Pearson correlations between the parental support and peer support factors and the three different PA indices were calculated for Study I (Table 3). Parent support and peer support showed statistically significant positive correlations with all PA indices (range: 0.22–0.31).

Table 3 Pearson correlations between PA indices and social support factors of Study I (N = 196)

Physical environment scale

The PCA of the final physical environment scale (Additional file 1) extracted four factors that comprised two items each (Table 4). These factors explained 71.8% of variance. One item was removed from the scale because it lowered the alpha of the factor safety. Another two items were removed from the scale because they had a loading of 0.45 or greater on one of the factors [55]. The items belonging to accessibility of recreation facilities loaded on two factors that differentiate between public recreation facilities and private sport providers. Two other items loaded on the factor safety and two on convenience. The factor loadings of the physical environmental items ranged from 0.62 to 0.87 and their communalities ranged from 0.49 to 0.79, respectively. The cross-validation with the CFA in Study II showed a good fit for the four-factor model (χ2=32.13; df=14; p<0.01; CFI=0.96; RMSEA=0.06 [90% CI=0.03-0.08]).

Table 4 Factor structure (varimax rotated solution) and reliability of physical environment scale (N = 196)

The physical environment factors convenience and public recreation facilities provided acceptable internal consistency (Table 4). The alphas of private sport providers and safety were low (α private sport providers  = 0.48 and α safety  = 0.42). The one-week test-retest reliability calculated by intra-class correlations was moderate for all factors (Table 4). To assess the predictive validity, Pearson correlations between the factors of the physical environment factors and the three different PA indices were calculated for Study I (Table 5). Only convenience was significantly correlated with self-reported habitual MVPA (r = 0.24).

Table 5 Pearson correlations between PA indices and physical environmental factors of Study I (N=196)

Discussion

The aim of this study was to assess the psychometric properties of a new German short self-report instrument for measuring social support and physical environmental determinants of PA in adolescents. The longitudinal design of Study I allowed for examination of test-retest reliability and predictive validity of the social support and physical environment scales. In addition, the internal consistency and construct validity were assessed.

Social support

According to theoretical considerations [18], the scale comprised the two factors that characterize the two main providers of social support in adolescents: parental support and peer support. The two-factorial structure that was identified in Study I using PCA was confirmed using cross-validation technique by performing CFA with the independent nationwide cross-sectional sample of Study II. The CFA showed good model fit for the two factor model which suggests adequate construct validity of this new social support scale. The fit indices of this study were comparable to those reported by Dishman and colleagues [30] for a two-factor model of social support that includes parental and friend support.

The factors parental support and peer support showed sufficient internal consistency. In comparison with other instruments on social support, the current scale featured comparable internal consistency and test-retest reliability. The alpha estimates were slightly higher than those reported for some other instruments of social support for children [32, 34] and adolescents [33, 35]. However, Pirasteh and colleagues [37] found a higher internal consistency of a five-item friend support scale in a validation study of a psychosocial determinants questionnaire in Iranian adolescent girls (α = 0.77). Satisfying internal consistency of the brief factor scales suggests that there was a good balance between scale length and reliability. Hence, this scale might be suitable in large-scale health surveys that require short scales.

In this study, the test-retest reliability of the latent factors was moderate to good indicating test-retest-reliability during an interval of one week. In addition, test-retest coefficients were comparable to other instruments that were developed for children and adolescents [3032, 37]. The correlation coefficients were higher for parental support than for peer support. This finding is consistent with the results of a study by Dishman and colleagues [30] that test-retest reliability for parental support was higher than that for friends support over a two-week interval. This result indicates that either the reliability of the scale for parental support is higher than that of the scale for peer support or that the construct of parental support is more stable over time than the construct of peer support. This discrepancy in reliability between factors may be caused by the fact that the items on parental support partly relate to more general perceptions (e.g. “How important is it for your parents that you do sport?”) than the potentially more variable aspects of items on peer support (e.g. “How often do you do sport with your friends?”).

Both factors of the social support scale correlated positively with all PA measures (objective MVPA, self-reported recent MVPA and self-reported habitual MVPA) suggesting predictive validity of the instrument. Adolescents who received greater social support from their parents and their peers were more likely to be physically active (measured objectively as well as self-reported) than those who received less social support. The correlation coefficients in this study are comparable to those reported in other studies on the relationship between social support and adolescent PA [22, 60]. The highest longitudinal correlations of both parental support and peer support were observed with self-reported habitual MVPA (r parental support  = 0.30 and r peer support = 0.31, respectively). The results of this study suggest that social support of parents and peers predicts rather habitual MVPA than recent MVPA (measured objectively as well as self-reported). Because the social support scale contains habitual variables of supportive behavior (e.g. “How often do your parents watch you doing sport?” – “never” to “always”), the higher correlation coefficients may have been caused by the conceptual conformance of the measures of habitual MVPA and habitual social support.

Physical environment

The CFA showed a good fit for the four-factor model and provides evidence for the construct validity of the physical environment scale. Fit indices were comparable with the indices identified by Ommundsen and colleagues [35] for a model of physical environment containing the three factors opportunity, facility and license. The variability of factor structures across physical environmental questionnaires may be related to the diversity of the construct and its definitions and the lack of behavior-specific theories on physical environmental influences on PA behavior [15, 61].

The current scale on the physical environment has a four-factor structure with the latent factors convenience, public recreation facilities, safety and private sport providers. The items that were developed for measuring accessibility of recreation facilities built upon two separate factors that distinguish between private sport providers and public recreation facilities. These factors seem to describe different aspects of the physical environment that may offer different opportunities for adolescents for being physically active. It is possible that these items load on two separate factors because the incidence of these facilities is traceable to the population density in the residential area. In Germany, private sports providers are more likely to be located in the center of cities whereas public recreation facilities such as playgrounds or soccer fields may be located in neighborhoods with lower population density and outside of city centers.

The internal consistency of two of the physical environment factors was low which may be related to the brevity of the factors as only two-item measures. However, other validation studies of physical environment instruments on different target populations also showed low internal consistency on the factor level [32, 34, 35, 62], which may be related to the heterogeneity among the physical environment items. Some characteristics of the physical environmental that are relevant for adolescent’s PA may be independent of each other. For example, there is no association between the accessibility of different types of recreation facilities such as soccer fields or playgrounds. Therefore, the physical environment construct may not be appropriately assessed by internal consistency as a measure of reliability [63].

The results of this study showed satisfying one-week test-retest reliability that was comparable to that of other physical environment instruments for children or adolescents [31, 32, 36]. Nevertheless, it should be noted that most of the dimensions of the physical environment measured here and in the instruments described above are relatively stable local conditions (e.g. access, convenience). Consequently, the limitations of test-retest reliability are likely related to changes in response behavior of participants. Adolescents seem to have varying perceptions of the physical environment or are not able to describe aspects of their physical environment appropriately. Rephrasing items and providing a description of the area of interest (e.g. neighborhood) might improve the participants’ understanding of the questions and consequently increase reliability.

The predictive validity of the physical environment factors could not be confirmed. The correlation coefficients of relationships between the physical environment factors and overall PA indices were in most cases not statistically significant. Only the factor convenience positively correlated with self-reported habitual MVPA in adolescents. This result supports findings of Rosenberg and colleagues [36] who reported correlations between land use mix-access (which is a scale of 6 items on access of stores, places and transit stops, parking opportunities, and walking barriers) and routinely walking to shops and routinely walking to parks in adolescents. There is inconclusive evidence on predictive effects of physical environment measures on adolescents’ PA [28] and the concept that the environment has direct effects on behavior is contentious [64]. Hence, the physical environment may be a prerequisite and a moderator of the relationship between psychosocial correlates such as social support and PA behavior in adolescents without a direct effect [65]. In addition, the influence of environmental factors on behavior may develop slowly [64]. The timespan between the measurement points of physical environmental variables and PA behavior in the current study was one week. This period may be too short to detect physical environmental effects. Hence, future research should focus on longitudinal data with longer between-test intervals. Finally, the physical environment should be investigated as a moderator of associations between other PA correlates and adolescents’ PA behavior [65].

Strength/ limitations

The strength of this study was that the questionnaire was developed based on theoretical considerations and built upon previous instruments. It was cross-validated with two independent study samples of 9 to 17 years old girls and boys. Nevertheless, this study had some limitations. For instance, our considerations were based on two studies with suboptimal sample size. The results of test-retest correlations should be carefully considered because these results are based only on the sample of the Study I with 196 participants. In addition, Study I included a sample of adolescents from only one public school, and hence these students may have had a somewhat similar physical environment. The variability in physical environment variables may have been higher if participants had originated from different areas.

In addition, the instrument has not been validated in a comparison with a 'gold standard' because to date a 'gold standard' for measuring social support or physical environment in adolescents is lacking [34]. Different methods are available for objectively examining the physical environment. However, objectively measured and subjectively measured physical environments do not equally correlate to PA in adolescents [29] and differ by definition, because the objectively measured environment is the actual environment while the subjectively measured environment is the person’s perception of environmental attributes. Hence, future studies could validate the physical environment scale by comparison with objective measurement methods and the social support scale by comparison with proxy-report methods of social support (e.g. parent-report).

Conclusions

The results of this study provided some evidence on reliability and validity of the social support scale and physical environment scale. Reliability of the two scales is comparable to that of the other existing scales measuring the same constructs. The construct validity of the both scales was confirmed by cross-validation using two independent samples. However, further studies on large samples from diverse neighborhoods and implementing criterion validation techniques are warranted to improve evidence on the measurement properties of the instrument. The predictive validity was only confirmed for the social support scale but not for physical environment scale. In accordance with theoretical considerations and results of other studies [64, 65], this issue raises the question whether physical environment has a direct effect on PA behavior or has a moderation function.

References

  1. Haskell WL, Blair SN, Hill JO: Physical activity: health outcomes and importance for public health policy. Prev Med. 2009, 49 (4): 280-282. 10.1016/j.ypmed.2009.05.002.

    Article  PubMed  Google Scholar 

  2. Dencker M, Andersen LB: Health-related aspects of objectively measured daily physical activity in children. Clin Physiol Funct Imaging. 2008, 28 (3): 133-144. 10.1111/j.1475-097X.2008.00788.x.

    Article  PubMed  Google Scholar 

  3. Nelson ME, Rejeski WJ, Blair SN, Duncan PW, Judge JO, King AC, Macera CA, Castaneda-Sceppa C: Physical Activity and Public Health in Older Adults: Recommendation from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc. 2007, 39 (8): 1435-1445. 10.1249/mss.0b013e3180616aa2.

    Article  PubMed  Google Scholar 

  4. Warburton DER, Nicol CW, Bredin SSD: Health benefits of physical activity: the evidence. Can Med Assoc J. 2006, 174 (6): 801-809. 10.1503/cmaj.051351.

    Article  Google Scholar 

  5. Hallal PC, Victora CG, Azevedo MR, Wells JC: Adolescent physical activity and health: a systematic review. Sports Med. 2006, 36 (12): 1019-1030. 10.2165/00007256-200636120-00003.

    Article  PubMed  Google Scholar 

  6. Janssen I, Leblanc AG: Systematic review of the health benefits of physical activity and fitness in school-aged children and youth. Int J Behav Nutr Phys Act. 2010, 7: 40-10.1186/1479-5868-7-40.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Janssen I: Physical activity guidelines for children and youth. Appl Physiol Nutr Metab. 2007, 32: S109-S121. 10.1139/H07-109.

    Article  Google Scholar 

  8. Cavill N, Biddle S, Sallis JF: Health enhancing physical activity for young people: Statement of the United Kingdom Expert Consensus Conference. Pediatr Exerc Sci. 2001, 13 (1): 12-25.

    Google Scholar 

  9. Strong WB, Malina RM, Blimkie CJR, Daniels SR, Dishman RK, Gutin B, Hergenroeder AC, Must A, Nixon PA, Pivarnik JM, Rowland T, Trost S, Trudeau FO: Evidence based physical activity for school-age youth. J Pediatr. 2005, 146 (6): 732-737. 10.1016/j.jpeds.2005.01.055.

    Article  PubMed  Google Scholar 

  10. Armstrong N, Welsman JR: The physical activity patterns of European youth with reference to methods of assessment. Sports Med. 2006, 36 (12): 1067-1086. 10.2165/00007256-200636120-00005.

    Article  PubMed  Google Scholar 

  11. Ekelund U, Tomkinson G, Armstrong N: What proportion of youth are physically active? Measurement issues, levels and recent time trends. Br J Sports Med. 2011, 45 (11): 859-865. 10.1136/bjsports-2011-090190.

    Article  PubMed  Google Scholar 

  12. Sallis JF, Owen N: Physical activity & behavioral medicine. Thousand Oaks, Calif. 1999, Sage, London

    Google Scholar 

  13. Bandura A: Social foundations of thought and action: a social cognitive theory. 1986, Prentice-Hall;, Englewood Cliffs. London

    Google Scholar 

  14. Mcleroy KR, Bibeau D, Steckler A, Glanz K: An Ecological Perspective on Health Promotion Programs. Health Educ Q. 1988, 15 (4): 351-377. 10.1177/109019818801500401.

    Article  CAS  PubMed  Google Scholar 

  15. Sallis JF, Cervero RB, Ascher W, Henderson KA, Kraft MK, Kerr J: An ecological approach to creating active living communities. Annu Rev Public Health. 2006, 27: 297-322. 10.1146/annurev.publhealth.27.021405.102100.

    Article  PubMed  Google Scholar 

  16. Spittaels H, Foster C, Oppert JM, Rutter H, Oja P, Sjostrom M, De Bourdeaudhuij I: Assessment of environmental correlates of physical activity: development of a European questionnaire. Int J Behav Nutr Phys Act. 2009, 6: 39-10.1186/1479-5868-6-39.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Barrera M: Distinctions between Social Support Concepts, Measures, and Models. Am J Community Psychol. 1986, 14 (4): 413-445. 10.1007/BF00922627.

    Article  Google Scholar 

  18. Cauce AM, Mason C, Gonzales N, Hiraga Y, Liu G: Social Support during Adolescence: Methological and Theoretical Considerations. In: Social Networks and Social Support in Childhood and Adolescence. edn. Edited by: Nestmann F, Hurrelmann K. 1994, de Gruyter, New York, 89-

    Google Scholar 

  19. Furman W, Buhrmester D: Age and sex differences in perceptions of networks of personal relationships. Child Dev. 1992, 63 (1): 103-115. 10.2307/1130905.

    Article  CAS  PubMed  Google Scholar 

  20. Beets MW, Cardinal BJ, Alderman BL: Parental Social Support and the Physical Activity-Related Behaviors of Youth: A Review. Health Educ Behav. 2010, 37 (5): 621-644. 10.1177/1090198110363884.

    Article  PubMed  Google Scholar 

  21. Edwardson CL, Gorely T: Parental influences on different types and intensities of physical activity in youth: A systematic review. Psychol Sport and Exer. 2010, 11 (6): 522-535. 10.1016/j.psychsport.2010.05.001.

    Article  Google Scholar 

  22. Pugliese J, Tinsley B: Parental socialization of child and adolescent physical activity: a meta-analysis. J Fam Psychol. 2007, 21 (3): 331-343.

    Article  PubMed  Google Scholar 

  23. Sallis JF, Prochaska JJ, Taylor WC: A review of correlates of physical activity of children and adolescents. Med Sci Sports Exerc. 2000, 32 (5): 963-975.

    Article  CAS  PubMed  Google Scholar 

  24. Van der Horst K, Paw MJ, Twisk JW, Van Mechelen W: A brief review on correlates of physical activity and sedentariness in youth. Med Sci Sports Exerc. 2007, 39 (8): 1241-1250. 10.1249/mss.0b013e318059bf35.

    Article  PubMed  Google Scholar 

  25. Duncan MJ, Spence JC, Mummery WK: Perceived environment and physical activity: a meta-analysis of selected environmental characteristics. Int J Behav Nutr Phys Act. 2005, 2: 11-10.1186/1479-5868-2-11.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Davison KK, Lawson CT: Do attributes in the physical environment influence children's physical activity? A review of the literature. Int J Behav Nutr Phys Act. 2006, 3: 19-10.1186/1479-5868-3-19.

    Article  PubMed  PubMed Central  Google Scholar 

  27. Limstrand T: Environmental characteristics relevant to young people's use of sports facilities: a review. Scand J Med Sci Sports. 2008, 18 (3): 275-287. 10.1111/j.1600-0838.2007.00742.x.

    Article  CAS  PubMed  Google Scholar 

  28. Ferreira I, Van der Horst K, Wendel-Vos W, Kremers S, van Lenthe FJ, Brug J: Environmental correlates of physical activity in youth - a review and update. Obes Rev. 2007, 8 (2): 129-154. 10.1111/j.1467-789X.2006.00264.x.

    Article  CAS  PubMed  Google Scholar 

  29. Ding D, Sallis JF, Kerr J, Lee S, Rosenberg DE: Neighborhood environment and physical activity among youth - A review. Am J Prev Med. 2011, 41 (4): 442-455. 10.1016/j.amepre.2011.06.036.

    Article  PubMed  Google Scholar 

  30. Dishman RK, Hales DP, Sallis JF, Saunders R, Dunn AL, Bedimo-Rung AL, Ring KB: Validity of Social-Cognitive Measures for Physical Activity in Middle-School Girls. J Pediatr Psychol. 2010, 35 (1): 72-88. 10.1093/jpepsy/jsp031.

    Article  PubMed  Google Scholar 

  31. Gattshall ML, Shoup JA, Marshall JA, Crane LA, Estabrooks PA: Validation of a survey instrument to assess home environments for physical activity and healthy eating in overweight children. Int J Behav Nutr Phys Act. 2008, 5: 3-10.1186/1479-5868-5-3.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Hume C, Ball K, Salmon J: Development and reliability of a self-report questionnaire to examine children's perceptions of the physical activity environment at home and in the neighbourhood. Int J Behav Nutr Phys Act. 2006, 3: 16-10.1186/1479-5868-3-16.

    Article  PubMed  PubMed Central  Google Scholar 

  33. Jago R, Fox KR, Page AS, Brockman R, Thompson JL: Development of scales to assess children's perceptions of friend and parental influences on physical activity. Int J Behav Nutr Phys Act. 2009, 6: 67-10.1186/1479-5868-6-67.

    Article  PubMed  PubMed Central  Google Scholar 

  34. McMinn AM, van Sluijs EMF, Harvey NC, Cooper C, Inskip HM, Godfrey KM, Griffin SJ: Validation of a maternal questionnaire on correlates of physical activity in preschool children. Int J Behav Nutr Phys Act. 2009, 6: 81-10.1186/1479-5868-6-81.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Ommundsen Y, Page A, Ku PW, Cooper AR: Cross-cultural, age and gender validation of a computerised questionnaire measuring personal, social and environmental associations with children's physical activity: the European Youth Heart Study. Int J Behav Nutr Phys Act. 2008, 5: 29-10.1186/1479-5868-5-29.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Rosenberg D, Ding D, Sallis JF, Kerr J, Norman GJ, Durant N, Harris SK, Saelens BE: Neighborhood Environment Walkability Scale for Youth (NEWS-Y): reliability and relationship with physical activity. Prev Med. 2009, 49 (2–3): 213-218.

    Article  PubMed  Google Scholar 

  37. Pirasteh A, Hidarnia A, Asghari A, Faghihzadeh S, Ghofranipour F: Development and validation of psychosocial determinants measures of physical activity among Iranian adolescent girls. BMC Publ Health. 2008, 8: 150-10.1186/1471-2458-8-150.

    Article  Google Scholar 

  38. Mewes N, Bös K, Jekauc D, Wagner MO, Worth A, Woll A: Physical fitness and physical activity as determinants of health development in children and adolescents: The MoMo Longitudinal Study. Bulletin of the International Council of Sport Science and Physical Education (ICSSPE). 63: 74-78.

  39. Burrmann U: Sport im Kontext von Freizeitengagements Jugendlicher: aus dem Brandenburgischen Längsschnitt 1998–2002. 2005, Sport und Buch Strauß, Köln

    Google Scholar 

  40. Wendel-Vos W, Droomers M, Kremers S, Brug J, van Lenthe F: Potential environmental determinants of physical activity in adults: a systematic review. Obes Rev. 2007, 8 (5): 425-440. 10.1111/j.1467-789X.2007.00370.x.

    Article  CAS  PubMed  Google Scholar 

  41. Pikora T, Giles-Corti B, Bull F, Jamrozik K, Donovan R: Developing a framework for assessment of the environmental determinants of walking and cycling. Soc Sci Med. 2003, 56 (8): 1693-1703. 10.1016/S0277-9536(02)00163-6.

    Article  PubMed  Google Scholar 

  42. Weston AT, Petosa R, Pate RR: Validation of an instrument for measurement of physical activity in youth. Med Sci Sports Exerc. 1997, 29 (1): 138-143. 10.1097/00005768-199701000-00020.

    Article  CAS  PubMed  Google Scholar 

  43. Freedson P, Pober D, Janz KF: Calibration of accelerometer output for children. Med Sci Sports Exerc. 2005, 37 (11 Suppl): S523-S530.

    Article  PubMed  Google Scholar 

  44. Ekelund U, Sardinha LB, Anderssen SA, Harro M, Franks PW, Brage S, Cooper AR, Andersen LB, Riddoch C, Froberg K: Associations between objectively assessed physical activity and indicators of body fatness in 9- to 10-y-old European children: a population-based study from 4 distinct regions in Europe (the European Youth Heart Study). Am J Clin Nutr. 2004, 80 (3): 584-590.

    CAS  PubMed  Google Scholar 

  45. Jekauc D, Wagner MO, Kahlert D, Woll A: Reliability and Validity of MoMo-Physical-Activity-Questionnaire for Adolescents (MoMo-AFB). Diagnostica in press

  46. Trost SG, Marshall AL, Miller R, Hurley JT, Hunt JA: Validation of a 24-h physical activity recall in indigenous and non-indigenous Australian adolescents. J Sci Med Sport. 2007, 10 (6): 428-435. 10.1016/j.jsams.2006.07.018.

    Article  PubMed  Google Scholar 

  47. Trost SG, Ward DS, McGraw B, Pate RR: Validity of the previous day physical activity recall (PDPAR) in fifth-grade children. Pediatr Exerc Sci. 1999, 11 (4): 341-348.

    Google Scholar 

  48. Little RJA: A Test of Missing Completely at Random for Multivariate Data with Missing Values. J Am Stat Assoc. 1988, 83 (404): 1198-1202. 10.1080/01621459.1988.10478722.

    Article  Google Scholar 

  49. DeVellis RF: Scale development: theory and applications. 2nd edition. Thousand Oaks, Calif. 2003, Sage, London

    Google Scholar 

  50. Sim J, Wright CC: Research in health care: concepts, designs and methods. 2000, Nelson Thornes, Cheltenham

    Google Scholar 

  51. Cortina JM: What Is Coefficient Alpha - an Examination of Theory and Applications. J Appl Psychol. 1993, 78 (1): 98-104.

    Article  Google Scholar 

  52. Portney LG, Watkins MP: Foundations of clinical research: applications to practice. 2009, Pearson/Prentice Hall, Upper Saddle River, N.J, 3

    Google Scholar 

  53. Cattell RB: Scree Test for Number of Factors. Multivar Behav Res. 1966, 1 (2): 245-276. 10.1207/s15327906mbr0102_10.

    Article  CAS  Google Scholar 

  54. Kaiser HF: The Application of Electronic-Computers to Factor-Analysis. Educ Psychol Meas. 1960, 20 (1): 141-151. 10.1177/001316446002000116.

    Article  Google Scholar 

  55. Tabachnick BG, Fidell LS: Using multivariate statistics. 2007, Pearson/Allyn and Bacon, Boston, Mass, 5

    Google Scholar 

  56. Kurth BM, Kamtsiuris P, Holling H, Schlaud M, Dolle R, Ellert U, Kahl H, Knopf H, Lange M, Mensink GB, Neuhauser H, Rosario AS, Scheidt-Nave C, Schenk L, Schlack R, Stolzenberg H, Thamm M, Thierfelder W, Wolf U: The challenge of comprehensively mapping children's health in a nation-wide health survey: design of the German KiGGS-Study. BMC Publ Health. 2008, 8: 196-10.1186/1471-2458-8-196.

    Article  Google Scholar 

  57. Bollen KA: Structural equations with latent variables. 1989, Wiley, New York, NY

    Book  Google Scholar 

  58. Hu LT, Bentler PM: Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Struct Equ Modeling. 1999, 6 (1): 1-55. 10.1080/10705519909540118.

    Article  Google Scholar 

  59. Bentler PM, Bonett DG: Significance Tests and Goodness of Fit in the Analysis of Covariance-Structures. Psychol Bull. 1980, 88 (3): 588-606.

    Article  Google Scholar 

  60. Prochaska JJ, Rodgers MW, Sallis JF: Association of parent and peer support with adolescent physical activity. Res Q Exerc Sport. 2002, 73 (2): 206-210.

    Article  PubMed  Google Scholar 

  61. Giles-Corti B, Timperio A, Bull F, Pikora T: Understanding physical activity environmental correlates: increased specificity for ecological models. Exerc Sport Sci Rev. 2005, 33 (4): 175-181. 10.1097/00003677-200510000-00005.

    Article  PubMed  Google Scholar 

  62. Bucksch J, Spittaels H: Reliability and validity findings of the ALPHA environmental questionnaire in Germany. J Public Health. 2011, 19 (5): 417-423. 10.1007/s10389-011-0416-4.

    Article  Google Scholar 

  63. Bollen K, Lennox R: Conventional Wisdom on Measurement - a Structural Equation Perspective. Psychol Bull. 1991, 110 (2): 305-314.

    Article  Google Scholar 

  64. Spence JC, Lee RE: Toward a comprehensive model of physical activity. Psychol Sport Exerc. 2003, 4 (1): 7-24. 10.1016/S1469-0292(02)00014-6.

    Article  Google Scholar 

  65. Graham DJ, Schneider M, Dickerson SS: Environmental resources moderate the relationship between social support and school sports participation among adolescents: a cross-sectional analysis. Int J Behav Nutr Phys Act. 2011, 8: 34-10.1186/1479-5868-8-34.

    Article  PubMed  PubMed Central  Google Scholar 

Pre-publication history

Download references

Acknowledgements

The authors thank all participants of this study. We would also like to express our appreciation to PD Dr. Annegret Mündermann (University of Konstanz) and Dr. Stefanie Everke Buchanan (University of Konstanz/ Zeppelin University of Friedrichshafen) for their writing assistance on behalf of the authors. Both studies were funded by a project grant from the German Bundesministerium für Bildung und Forschung (Federal Ministry of Education and Research) and by the German Bundesministerium für Gesundheit (Federal Ministry of Health). The first author thanks the Ministry of Science of the German State of Baden-Württemberg for supporting this project by a grant scholarship of the Brigitte Schlieben-Lange-Programm.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anne K Reimers.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

AKR was responsible for the overall conception and design of this manuscript, statistical analysis and interpretation of data. DJ designed Study I, contributed to the design of Study II, collected the data of Study I, contributed to the statistical analysis and provided edits to the manuscript. FM and NM revised the manuscript. AW designed Studies I and II. All authors read and approved the final manuscript.

Electronic supplementary material

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Reimers, A.K., Jekauc, D., Mess, F. et al. Validity and reliability of a self-report instrument to assess social support and physical environmental correlates of physical activity in adolescents. BMC Public Health 12, 705 (2012). https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2458-12-705

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://0-doi-org.brum.beds.ac.uk/10.1186/1471-2458-12-705

Keywords