European Journal of Adapted Physical Activity 15, 2 (2022) | DOI: 10.5507/euj.2021.006

Reliability and validity of an observational system to qualify performance indicators in goalball matches: Scal-Go proposal

Isabella Alves1,, Leonardo Gomide1,, Maria Julia Rocha1,, Tatiana Vizu1,, Rodrigo Aquino2,, Rafael Menezes1,, Otávio Furtado3, Márcio Morato1*
1 School of Physical Education and Sport of Ribeirão Preto, University of São Paulo, Ribeirão Preto, Brazil
2 Research Group in Soccer Science, Department of Sports, Center of Physical Education and Sports, Federal University of Espírito Santo, Vitória, Brazil
3 School of Physical Education and Sport, University of São Paulo, São Paulo, Brazil

Which situations compose the success and failure in goalball matches? Our aims were to develop a scale to assess performance indicators in goalball and, to evaluate this proposed scale according to contextual variables (i.e., team level, match outcome and match status). Non-participant match observation method was applied in 24 goalball matches from the Paralympic Games 2016. Firstly, an observational system development was composed by performance indicators (named as Scal-Go). Success and failure from offensive and defensive phases were stratified into a spreadsheet. Following, inter and intra reliability stages were conducted together with content validity, certified by goalball’s experts. Scal-Go achieved high agreement levels for inter- (.752 and .919) and intra-observers (.846 and .974) reliability. Also, content validity was certified by goalball experts. The results showed high frequency of standard preceding actions (80.3%), strongly appropriate defences (57.8%), and acceptable attacks (57.4%). In addition, since players’ performance was associated to contextual variables, specific actions and situations are performed differently within team levels, match outcome, and match status. Match interruptions, accurate shots, goal scored first, quick defences, defensive infraction and penalty situations must be included in training process.

Keywords: adapted physical activity; performance analysis; qualification system; Paralympic sport

Received: December 11, 2020; Revised: April 19, 2021; Accepted: May 25, 2021; Published online: February 1, 2022  Show citation

ACS AIP APA ASA Harvard Chicago Chicago Notes IEEE ISO690 MLA NLM Turabian Vancouver
Alves, I., Gomide, L., Rocha, M.J., Vizu, T., Aquino, R., Menezes, R., Furtado, O., & Morato, M. (2022). Reliability and validity of an observational system to qualify performance indicators in goalball matches: Scal-Go proposal. European Journal of Adapted Physical Activity, 15, Article 2. https://doi.org/10.5507/euj.2021.006
Share...
Download citation
  • BibTeX (.bib)
  • Bookends (.ris)
  • EasyBib (.ris)
  • EndNote (.enw)
  • EndNote 8 (.xml)
  • ISI WoS (.isi)
  • Medlars (.medlars)
  • Mendeley (.ris)
  • MODS (.xml)
  • Papers (.ris)
  • RefWorks (.txt)
  • RefManager (.ris)
  • RIS (.ris)
  • MS Word (.xml)
  • Zotero (.ris)
    • Open full article

    References

    1. Almeida, C. H., Ferreira, A. P., & Volossovitch, A. (2014). Effects of match location, match status and quality of opposition on regaining possession in UEFA Champions League. Journal of Human Kinetics, 41(1), 203-214. https://doi.org/10.2478/hukin-2014-0048 Go to original source... Go to PubMed...
    2. Altman, D.G. (1991). Practical statistics for medical research. Chapman & Hall. Go to original source...
    3. Alves, I. dos S., Kalva-Filho, C. A., Aquino, R., Travitzki, L., Tosim, A., Papoti, M., & Morato, M. P. (2018). Relationships between aerobic and anaerobic parameters with gametechnical performance in elite goalball athletes. Frontiers in Physiology, 9(1636), 1-10. https://doi.org/10.3389/fphys.2018.01636 Go to original source... Go to PubMed...
    4. Amorim, M., Corredeira, R., Sampaio, E., Bastos, T., & Botelho, M. (2010). Goalball: uma modalidade desportiva de competição [Goalball: a competitive sport]. Revista Portuguesa de Ciências do Desporto, 10(1), 221-229. Go to original source...
    5. Anguera, M. T., & Mendo, A. H. (2013). La metodología observacional en el ámbito del deporte [Observational methodology in the field of sport]. Revista de Ciencias del Deporte, 9(3), 135-160.
    6. Aquino, R., Carling, C., Palucci Vieira, L. H., Martins, G., Jabor, G., Machado, J., Santiago, P., Garganta, J., & Puggina, E. (2020). Influence of situational variables, team formation, and playing position on match running performance and social network analysis in brazilian professional soccer players. Journal of Strength and Conditioning Research, 34(3), 808-817. https://doi.org/10.1519/JSC.0000000000002725 Go to original source... Go to PubMed...
    7. Batterham, A. M., & Hopkins, W. G. (2006). Making meaningful inferences about magnitudes. International Journal of Sports Physiology and Performance, 1(1), 50-57. https://doi.org/10.1123/ijspp.1.1.50 Go to original source... Go to PubMed...
    8. Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: A practical and
    9. powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological), 57(1), 289-300.
    10. Bowerman, S., Davis, R., Ford, S., & Nichols, D. (2011). Phases of movement of goalball throw related to ball velocity. Insight: Research and Practice in Visual Impairment and Blindness, 4(4), 153-159.
    11. Castellano, J., Casamichana, D., & Lago, C. (2012). The use of match statistics that discriminate between successful and unsuccessful soccer teams. Journal of Human Kinetics, 31(1), 139-147. https://doi.org/10.2478/v10078-012-0015-7 Go to original source... Go to PubMed...
    12. Costa, I. T., Garganta, J., Greco, P. J., Mesquita, I., & Maia, J. (2011). Sistema de avaliação táctica no Futebol (FUT-SAT): Desenvolvimento e validação preliminar [System of tactical assessment in Soccer (FUT-SAT): Development and preliminary validation]. Motricidade, 7(1), 69-84. https://doi.org/10.6063/motricidade.7(1).121 Go to original source...
    13. Colak, T., Bamaç, B., Aydin, M., Meriç, B., & Özbek, A. (2004). Physical fitness levels of blind and visually impaired goalball team players. Isokinetics and Exercise Science, 12(4), 247-252. https://doi.org/10.3233/IES-2004-0182 Go to original source...
    14. Cronbach, L. J. (1988). Five perspectives on validity argument. In: Wainer, H.; Braun, H. I. (Eds.), Test Validity (pp. 3-17). Lawrence Erlbaum Associates.
    15. Davids, K. (1988). Ecological validity in understanding sport performance: some problems of definition. Quest, 40(2), 126-136. https://doi.org/10.1080/00336297.1988.10483894 Go to original source...
    16. Fleiss, J. L., Levin, B., & Paik, M. C. (2013). Statistical methods for rates and proportions. New Jersey: John Wiley & Sons.
    17. Francis, J., Oen, A., & Peters, D. M. (2019a). A new reliable performance analysis template for quantifying action variables in elite men's wheelchair basketball. Frontiers in Psychology, 10 ,16. https://doi.org/10.3389/fpsyg.2019.00016 Go to original source... Go to PubMed...
    18. Francis, J., Owen, A., & Peters, D. M. (2019b). Making every "point" count: Identifying the key determinants of team success in elite men's wheelchair basketball. Frontiers in Psychology, 10, 1431. https://doi.org/10.3389/fpsyg.2019.01431 Go to original source... Go to PubMed...
    19. Francis, J. W., Owen, A. J., & Peters, D. M. (2021). Predicting field-goal success according to offensive, defensive and contextual variables in elite men's wheelchair basketball. PLoS ONE, 16(1), e0244257. https://doi.org/10.1371/journal.pone.0244257 Go to original source... Go to PubMed...
    20. Fritz, C. O., Morris, P. E., & Richler, J. J. (2012). Effect size estimates: current use, calculations, and interpretation. Journal of Experimental Psychology: General, 141(1), 2-18. https://doi.org/10.1037/a0024338 Go to original source... Go to PubMed...
    21. Furtado, O. L. P., Häyrinen, M., Alves, I. S., Travitzki, L., & Morato, M. P. (2021). Factors associated with penalty outcome on male elite goalball. Adapted Physical Activity Quarterly, 38(3), 506-518. https://doi.org/10.1123/apaq.2020-0117 Go to original source... Go to PubMed...
    22. Gómez, M. Á., Pérez, J., Molik, B., Szyman, R. J., & Sampaio, J. (2014). Performance analysis of elite men's and women's wheelchair basketball teams. Journal of Sports Sciences, 32(11), 1066-1075. https://doi.org/10.1080/02640414.2013.879334 Go to original source... Go to PubMed...
    23. Hopkins, W. G. (2000). Measures of reliability in sports medicine and science. Sports Medicine, 30(1), 1-15. https://doi.org/10.2165/00007256-200030010-00001 Go to original source... Go to PubMed...
    24. Hughes, M. D., & Bartlett, R. M. (2002). The use of performance indicators in performance analysis. Journal of Sports Sciences, 20(10), 739-754. https://doi.org/10.1080/026404102320675602 Go to original source... Go to PubMed...
    25. International Blind Sports Federation. (2020, May 6). Classification Rules. Sport Classes Profiles for Athletes with Vision Impairment. https://www.ibsasport.org/sports/files/1180-Rules-2018-2021-IBSA-Goalball-Rules-and-Regulations-(Effective:--6-May-2020).pdf
    26. Lago, C. (2009). The influence of match location, quality of opposition, and match status on possession strategies in professional association football. Journal of Sports Sciences, 27(13), 1463-1469. https://doi.org/10.1080/02640410903131681 Go to original source... Go to PubMed...
    27. Link, D., & Weber, C. (2018). Finding the gap: An empirical study of the most effective shots in elite goalball. PLoS One, 13(4). https://doi.org/10.1371/journal.pone.0196679 Go to original source... Go to PubMed...
    28. Magalhães, T. P., Furtado, O. L. P. C., Morato, M. P., Gamero, D. H., & Misuta, M. S. (2014, November 05-07) Análise cinemática das ações ofensivas no goalball em situação de jogo: deslocamento do jogador e arremesso [Kinematic analysis of offensive actions in goalball in game situation: player displacement and pitch] [Poster presentation]. IV Congresso Paradesportivo Internacional, Florianólis, SC, Brazil.
    29. Marsza³ek, J., Gómez, M. Á., & Molik, B. (2018). Game performance differences between winning and losing sitting volleyball teams regarding teams' ability. International Journal of Performance Analysis in Sport, 18(2), 367-379. https://doi.org/10.1080/24748668.2018.1477027 Go to original source...
    30. McGarry, T., Anderson, D. I., Wallace, S. A., Hughes, M. D., & Franks, I. M. (2002). Sport competition as a dynamical self-organizing system. Journal of Sports Sciences, 20(10), 771-781. https://doi.org/10.1080/026404102320675620 Go to original source... Go to PubMed...
    31. Molik, B., Morgulec-Adamowicz, N., Kosmol, A., Perkowski, K., Bednarczuk, G., Skowronski, W., Gomez, M. G., Koc, K., Rutkowska, I., & Szyman, R. J. (2015). Game performance evaluation in male goalball players. Journal of Human Kinetics, 48(1), 43-51. https://doi.org/10.1515/hukin-2015-0090 Go to original source... Go to PubMed...
    32. Molik, B., Morgulec-Adamowicz, N., Marsza³ek, J., Kosmol, A., Rutkowska, I., Jakubicka, A., … Gómez, M. Á. (2017). Evaluation of game performance in elite male sitting volleyball players. Adapted Physical Activity Quarterly, 34(2), 104-124. https://doi.org/10.1123/apaq.2015-0028 Go to original source... Go to PubMed...
    33. Monezi, L. A. A., Magalhães, T. P. P., Morato, M. P. P., Mercadante, L. A. A., Furtado, O. L. P. C., & Misuta, M. S. S. (2019). Time-motion analysis of goalball players in attacks: differences of the player positions and the throwing techniques. Sports Biomechanics, 18(5) 470-481. https://doi.org/10.1080/14763141.2018.1433871 Go to original source... Go to PubMed...
    34. Morato, M. P., Furtado, O. L. P., Gamero, D. H., Magalhães, T. P., & de Almeida, J. J. G. (2017). Development and evaluation of an observational system for goalball match analysis. Revista Brasileira de Ciências do Esporte, 39(4), 398-407. https://doi.org/10.1016/j.rbce.2016.08.002 Go to original source...
    35. Morato, M. P., Gomes, M. S. P., & Almeida, J. J. G. de. (2012). Os processos auto-organizacionais do goalball [The self-organizations processes of goalball]. Revista Brasileira de Ciências do Esporte, 34(3), 741-760. https://doi.org/10.1590/S0101-32892012000300015 Go to original source...
    36. Morato, M.P., Menezes, R. P., Fonseca, S., & Furtado, O. L. P. D. C. (2018). Faster balls increase the probability of scoring a goal in female and male elite goalball. Revista Brasileira de Ciencias do Esporte, 40(4), 427-434. https://doi.org/10.1016/j.rbce.2018.03.027 Go to original source...
    37. O'Donoghue, P. O. (2010). Research methods for sports. Routledge.
    38. Picolo, J. G. D., Travitzki, L., Alves, I. dos S., & Morato, M. P. (2021). Estratégias ofensivas e defensivas eficazes no goalball [Effective offensives and defensives strategies in Goalball] Motrivivência, 33(64), 1-19. https://doi.org/10.5007/2175-8042.2021.e82157 Go to original source...
    39. Silva, G. P., Pereira, V. R., Deprá, P. P., & Gorla, J. I. (2010). Tempo de reação e a eficiência do jogador de goalball na interceptação/defesa do lançamento/ataque [Reaction time and efficiency of the goalball player in interception/defense of throwing/attack]. Motricidade, 6(4), 13-22. Go to original source...
    40. Silva, P., Garganta, J., Araújo, D., Davids, K., & Aguiar, P. (2013). Shared knowledge or shared affordances? Insights from an ecological dynamics approach to team coordination in sports. Sports Medicine, 43(9), 765-772. http://doi.org/10.1007/s40279-013-0070-9 Go to original source... Go to PubMed...
    41. Stamou, E., Theodorakis, Y., Kokaridas, D., Perkos, S., & Kessanopoulou, M. (2007). The effect of self-talk on the penalty execution in goalball. The British Journal of Visual Impairment, 25(3), 233-247. https://doi.org/10.1177/0264619607079800 Go to original source...
    42. Taylor, J. B., Mellalieu, S. D., James, N., & Shearer, D. A. (2008). The influence of match location, quality of opposition, and match status on technical performance in professional association football. Journal of Sports Sciences, 26(9), 885-895. https://doi.org/10.1080/02640410701836887 Go to original source... Go to PubMed...
    43. Taylor, J., Mellalieu, S., James, N., & Barter, P. (2010). Situation variable effects and tactical performance in professional association football. International Journal of Performance Analysis in Sport, 10, 255-269. https://doi.org/10.1080/24748668.2010.11868520 Go to original source...
    44. Thomas, J. R., Nelson, J. K., & Silverman, S. J. (2009). Métodos de pesquisa em atividade física [Research methods in physical activity]. Artmed Editora.
    45. Tosim, A., Junior, A. P., Leitão, M. T. K., & Simões, R. (2008). Sistemas técnicos e táticos no goalball. Revista Mackenzie de Educação Física e Esporte, 7(2), 141-148.

    This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits use, distribution, and reproduction in any medium, provided the original publication is properly cited. No use, distribution or reproduction is permitted which does not comply with these terms.


    Return to the content