European Journal of Adapted Physical Activity 10, 20-30 (2017) | DOI: 10.5507/euj.2017.007

Validity and Reliability Evidence of Smart Start in Preschoool-aged Children with/without a Developmental Delay and/or a Disability

Jaehun Jung, So-Yeun Kim, Lauriece L. Zittel, Marilyn A. Looney
1 Oregon State University, USA
2 Northern Illinois University, USA

The purpose of this study was to investigate validity and reliability evidence of Smart Start in male (n =35) and female (n = 25) children with/without a disability. Fundamental movement skills (FMS) of preschoolers (with a disability, n = 32; and without a disability, n = 28) aged between 37 to 64 months were examined using Smart Start and the Test of Gross Motor Development-Second Edition. The correlation between total scores of the two instruments was r = .89, p < .01. Across three raters, the average percentages of agreement, modified kappa coefficients, and intraclass correlation coefficients (ICCs) for intra-rater reliability using Smart Start on all participants were .92, .83, and .96, respectively. For inter-rater reliability, the average percentages of agreement, modified kappa coefficients, and ICCs based on all participants were .86, .71, and .93, respectively. The major findings provide preliminary evidence to support concurrent validity and intra- and inter-rater reliability of the Smart Start for assessing FMS of preschoolers with/without a disability.

Keywords: assessment, fundamental movement skills, preschooler

Published: July 31, 2017  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Jung, J., So-Yeun, K., Zittel, L.L., & Looney, M.A. (2017). Validity and Reliability Evidence of Smart Start in Preschoool-aged Children with/without a Developmental Delay and/or a Disability. European Journal of Adapted Physical Activity, 10(2), 20-30. doi: 10.5507/euj.2017.007
Share...
Download citation
  • BibTeX (.bib)
  • Bookends (.ris)
  • EasyBib (.ris)
  • EndNote (.enw)
  • EndNote 8 (.xml)
  • ISI WoS (.isi)
  • Medlars (.medlars)
  • Mendeley (.ris)
  • MODS (.xml)
  • Papers (.ris)
  • RefWorks (.txt)
  • RefManager (.ris)
  • RIS (.ris)
  • MS Word (.xml)
  • Zotero (.ris)
    • Open full article

    References

    1. Altman, D. G. (1990). Practical statistics for medical research. Boca Raton, FL: CRC Press. Go to original source...
    2. Barnett, L. M., van Beurden, E., Morgan, P. J., Brooks, L. O., & Beard, J. R. (2009). Childhood motor skill proficiency as predictor of adolescent physical activity. Journal of Adolescent Health, 44, 252-259. Go to original source... Go to PubMed...
    3. Brewer, C. J., & Jones, R. L. (2002). A five-stage process for establishing contextually valid systematic observation instruments: The case of rugby union. Sport Psychologist, 16(2), 138-159. Go to original source...
    4. Burns, M. K., MacQuarrie, L. L., & Campbell, D. T. (1999). The difference between curriculum-based assessment and curriculum-based measurement: A focus on purpose and result. Communique, 27(6), 18-19.
    5. Capio, C. M., Sit, C. H. P., & Abernethy, B. (2011). Fundamental movement skills testing in children with cerebral palsy. Disability & Rehabilitation, 33, 2519-2528. Go to original source... Go to PubMed...
    6. Cliff, D. P., Okely, A. O., Smith, L. M., & McKeen, K. (2009). Relationships between fundamental movement skills and objectively measured physical activity in preschool children. Pediatric Exercise Science, 21, 436-449. Go to original source... Go to PubMed...
    7. Cusick, A., Vasquez, M., Knowles, L., & Wallen, M. (2005). Effect of rater training on reliability of Melbourne Assessment of Unilateral Upper Limb Function scores. Developmental Medicine & Child Neurology, 47(1), 39-45. Go to original source... Go to PubMed...
    8. Darst, P. W., Zakrajsek, D., & Mancini, V. H. (1989). Analyzing physical education and sport instruction. Champaign IL: Human Kinetics.
    9. Deno, S. L. (1987). Curriculum-based measurement. Teaching Exceptional Children, 20, 41. Go to original source...
    10. Evaggelinou, C., Tsigilis, N., & Papa, A. (2002). Construct validity of the Test of Gross Motor Development: A crossvalidation approach. Adapted Physical Activity Quarterly, 19, 483-495. Go to original source... Go to PubMed...
    11. Fisher, A., Reilly, J. J., Kelly, L. A., Montgomery, C., Williamson, A., Payton, J. A., & Grant, S. (2005). Fundamental movement skills and habitual physical activity in young children. Medicine & Science in Sports & Exercise, 37, 684-688. doi: 10.1249/01.MSS.0000159138.48107.7D Go to original source... Go to PubMed...
    12. Folio, M. K., & Fewell, R. (2000). Peabody Developmental Motor Scales: Examiner's Manual (2nd ed.) Austin, TX: PRO-ED, Inc.
    13. Gallahue, D., & Ozman, J. (2006). Understanding motor development: Infants, children, adolescents, adults (6th ed.). New York, NY: McGraw-Hill Humanities.
    14. Gickling, E. E., & Thompson, V. P. (1985). A personal view of curriculum-based assessment. Exceptional Children, 52, 205-218. Go to original source...
    15. Graf, C., Koch, B., Kretschmann-Kandel, E., Falkowski, G., Christ, H., Coburger, S.... Dordel, S. (2004). Correlation between BMI, leisure habits and motor abilities in childhood (CHILT-Project). International Journal of Obesity, 28, 22-26. doi:10.1038/sj.ijo.0802428 Go to original source... Go to PubMed...
    16. Graham, M., Milanowski, A., & Miller, J. (2012). Measuring and Promoting Inter-Rater Agreement of Teacher and Principal Performance Ratings. Online Submission. Retrieved from http://eric.ed.gov/?id=ED532068
    17. Hardy, L. L., King, L., Farrell, L., Macniven, R., & Howlett, S. (2010). Fundamental movement skills among Australian preschool children. Journal of Science and Medicine in Sport, 13, 503-508. Go to original source... Go to PubMed...
    18. Houwen, S., Hartman, E., Jonker, L., & Visscher, C. (2010). Reliability and validity of the TGMD-2 in primary-schoolage children with visual impairments. Adapted Physical Activity Quarterly, 27, 143-159. Go to original source... Go to PubMed...
    19. IBM Corp. Released (2011). IBM SPSS Statistics for Windows, Version 20.0. Armonk, NY: IBM Corp.
    20. Looney, M. A., & Gilbert, J. (2012). Validity of alternative cutoff scores for the back-saver sit and reach test. Measurement in Physical Education and Exercise Science, 16, 268-283. Go to original source...
    21. Majnemer A. (1998). Benefits of early intervention for children with developmental disabilities. Seminars in Pediatric Neurology, 5, 62-69. Go to original source...
    22. McLean, M. (2005). Using curriculum-based assessment to determine eligibility: Time for a paradigm shift? Journal of Early Intervention, 28, 23-27. Go to original source...
    23. Morison, P., White, S. H., & Feuer, M. J. (1996). The use of IQ tests in special education decision making and planning: Summary of two workshops. Washington, DC: National Academy Press.
    24. Neisworth, J. T., & Bagnato, S. J. (2004). The mismeasure of young children: The authentic assessment alternative. Infants & Young Children, 17, 198-212. Go to original source...
    25. Okely, A. D., Booth, M. L., & Patterson, J. W. (2001). Relationship of physical activity to fundamental movement skills among adolescents. Medicine & Science in Sports & Exercise, 33, 1899-1904. doi: 10.1097/00005768-200111000-00015 Go to original source... Go to PubMed...
    26. Ong, C. D. (2001). Intracoder and intercoder reliability of the key element scores from the Smart Start locomotor skill key element checklist. (Unpublished master's thesis). Northern Illinois University, DeKalb, IL.
    27. Partington, M., & Cushion, C. (2013). An investigation of the practice activities and coaching behaviors of professional top-level youth soccer coaches. Scandinavian Journal of Medicine & Science in Sports, 23, 374-382. doi: 10.1111/j.1600-0838.2011.01383.x Go to original source... Go to PubMed...
    28. Potter, M. L., & Wamre, H. M. (1990). Curriculum-based measurement and developmental reading models: Opportunities for cross-validation. Exceptional Children, 57, 16-25. Go to original source...
    29. Roberts, S., & Fairclough, S. (2012). A five-stage process for the development and validation of a systematic observation instrument: The system for observing the teaching of games in physical education (SOTG-PE). European Physical Education Review, 18, 97-113. Go to original source...
    30. Robinson, L. E., & Goodway, J. D. (2009). Instructional climates in preschool children who are at-risk. Part I: Object-control skill development. Research Quarterly for Exercise and Sport, 80, 533-542. doi:10.1080/02701367.2009.10599591. Go to original source... Go to PubMed...
    31. Cusick, A., Vasquez, M., Knowles, L., & Wallen, M. (2005). Effect of rater training on reliability of Melbourne Assessment of Unilateral Upper Limb Function scores. Developmental Medicine & Child Neurology, 47(1), 39-45. Go to original source... Go to PubMed...
    32. Graham, M., Milanowski, A., & Miller, J. (2012). Measuring and Promoting Inter-Rater Agreement of Teacher and Principal Performance Ratings. Online Submission. Retrieved from http://eric.ed.gov/?id=ED532068
    33. Shevell, M., Ashwal, S., Donley, D., Flint, J., Gingold, M., Hirtz, D., … Sheth, R. D. (2003). Practice parameter: evaluation of the child with global developmental delay: report of the Quality Standards Subcommittee of the American Academy of Neurology and The Practice Committee of the Child Neurology Society. Neurology, 60(3), 367-380. Go to original source... Go to PubMed...
    34. Shortell, T. (2001). An Introduction to Data Analysis & Presentation. Retrieved from http://academic. Brooklyn. Cuny. edu/ soc/courses/712/chap18. Html.
    35. Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability. Psychological Bulletin, 86(2), 420-428. Go to original source...
    36. Simons, J., Daly, D., Theodorou, F., Caron, C., Simons, J., & Andoniadou, E. (2008). Validity and reliability of the TGMD-2 in 7-10-year-old Flemish children with intellectual disability. Adapted Physical Activity Quarterly, 25, 71-82. Go to original source... Go to PubMed...
    37. Stodden, D. F., Goodway, J. D., Langendorfer, S. J., Roberton, M. A., Rudisill, M. E., Garcia, C., & Garcia, L. E. (2008). A developmental perspective on the role of motor skill competence in physical activity: An emergent relationship. Quest, 60, 290-306. doi:10.1080/00336297.2008.10483582 Go to original source...
    38. Sun, S. H., Sun, H. L., Zhu, Y. C., Huang, L. C., & Hsieh, Y. L. (2011). Concurrent validity of preschooler gross motor quality scale with test of gross motor development-2. Research in Developmental Disabilities, 32, 1163-1168. doi:10.1016/j.ridd.2011.01.007 Go to original source... Go to PubMed...
    39. Sundvall, L., Ingerslev, H. J., Knudsen, U. B., & Kirkegaard, K. (2013). Inter-and intra-observer variability of time-lapse annotations. Human Reproduction, 28, 3215-3221. Go to original source... Go to PubMed...
    40. Ulrich, D. (2000). Test of gross motor development. Examiner's manual (2nd ed.). Austin, Texas: PRO-ED.
    41. Valentini, N. C. (2012). Validity and reliability of the TGMD-2 for Brazilian children. Journal of Motor Behavior, 44, 275-280. doi:10.1080/00222895.2012.700967. Go to original source... Go to PubMed...
    42. Weiner, I. B., & Craighead, W. E. (2010). The Corsini encyclopedia of psychology (Vol. 4). Hoboken, NJ: John Wiley & Sons. Go to original source...
    43. Wessel, J., & Zittel, L.L. (1995). Smart Start: A Preschool Movement Curriculum for Children of All Abilities. Austin, TX: PRO-ED.
    44. Williams, H. G., Pfeiffer, K. A., Dowda, M., Jeter C., Jones S., & Pater R. R. (2009). A field-based testing protocol for assessing gross motor skills in preschool children: The CHAMPS motor skills protocol. Measurement in Physical Education and Exercise Science, 13, 151-165. doi:10.1080/10913670903048036 Go to original source... Go to PubMed...
    45. Williams, H. G., Pfeiffer, K. A., O'Neill, J. R., Dowda, M., McIver, K. L., Brwon, W. H., & Pate, R. R. (2008). Motor skill performance and physical activity in preschool children. Obesity, 16, 1421-1426. doi: 10.1038/oby.2008.214 Go to original source... Go to PubMed...
    46. Wrotniak, B. H., Epstein, L. H., Dorn, J. M., Jones, K. E., & Kondilis, V. A. (2006). The relationship between motor proficiency and physical activity in children. Pediatrics, 118, 1758-1764. Go to original source... Go to PubMed...
    47. Wuang, Y. P., Wang, C. C., Huang, M. H., & Su, C. Y. (2008). Profiles and cognitive predictors of motor functions among early school-age children with mild intellectual disabilities. Journal of Intellectual Disability Research, 52, 1048-1060. doi: 10.1111/j.1365-2788.2008.01096.x Go to original source... Go to PubMed...
    48. Yun, J., & Ulrich, D. (2002). Estimating measurement validity: A Tutorial. Adapted Physical Activity Quarterly, 19, 32-47. Go to original source... Go to PubMed...

    This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.


    Return to the content