Usefulness of the “Pruéb@te UNAM” Platform for Admission to Higher Education
Keywords:
Entrance examinations, Computer assisted learning, Practical examinations, Summative evaluation, Student selection
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
Abstract
The admission process to higher education in several universities includes standardized high-stakes examinations, that frequently are associated with special preparation courses designed to help applicants to master test-taking strategies, as well as to review and practice the knowledge assessed in the test. The goal of this study was to compare the performance in the college admission exam to the National Autonomous University of Mexico (UNAM) in users of the digital platform “Pruéb@te UNAM Licenciatura” versus non-users, and to establish the correlation between being selected and platform use. A quantitative observational, comparative and cross-sectional design was used. The study population was integrated by 178.364 applicants for a college career at UNAM, of these 8.063 used the platform. Users had higher scores in the admission exam than non-users (p < 0,001; d = 0,76). Practicing more than 10 hours (p < 0,001; d = 0,89) and completing up to five mock exams (p < 0,001; d = 0,88) were associated with higher results. The use of a platform for training and rehearsal in simulated tests is associated with a higher score on the university admission exam. Test-enhanced learning can be useful to understand and improve applicants' performance in high-stakes summative examinations.
Downloads
References
Altermatt, E. y Kim, M. (2004). Getting girls de-stereotyped for SAT exams. Education Digest: Essential Readings Condensed for Quick Review, 70(1), 43-48.
Appelrouth, J., Moore, D., Zabrucky, K. y Cheung, J. (2018). Preparing for high-stakes admissions tests: A moderation mediation analysis. International Research in Higher Education, 3(3), 32-50. https://doi.org/10.5430/irhe.v3n3p32
Appelrouth, J. y Zabrucky, K. (2017). Preparing for the SAT: A review. College and University, 92(1), 2-17.
Appelrouth, J., Zabrucky, K. y Moore, D. (2017). Preparing students for college admissions tests. Assessment in Education: Principles, Policy y Practice, 24(1), 78-95. https://doi.org/10.1080/0969594X.2015.1075958
Arendasy, M., Sommer, M., Gutiérrez-Lobos, K. y Fritz, J. (2016). Do individual differences in test preparation compromise the measurement fairness of admission tests? Intelligence, 55, 44-56. https://doi.org/10.1016/j.intell.2016.01.004
Brame, C. y Biel, R. (2015). Test-enhanced learning: The potential for testing to promote greater learning in undergraduate science courses. Life Sciences Education, 14(2), 1-12. https://doi.org/10.1187/cbe.14-11-0208
Briggs, D. (2009). Preparation for college admission exams. National Association for College Admission Counseling.
Buchmann, C., Condron, D. y Roscigno, V. (2010). Shadow education, American style: Test preparation, the SAT and College Enrollment. Social Forces, 89(2), 435-461. https://doi.org/10.1353/sof.2010.0105
Buzo, E., Ortega, E. y Martínez, A. (2018). Pruéb@te UNAM, opción para preparar el examen de admisión a la licenciatura. Revista Digital Universitaria, 19(6), 1-11. http://doi.org/10.22201/codeic.16076079e.2018.v19n6.a10
Byrnes, J. y Takahira, S. (1993). Explaining gender differences on SAT math items. Developmental Psychology, 29(5), 805-810. https://doi.org/10.1037/0012-1649.29.5.805
Cárcamo, C. y Mola, J. (2012). Diferencias por sexo en el desempeño académico en Colombia: Un análisis regional. Economía y Región, 6(1), 133-169.
Carrasco, S. (2011). El seminario de orientación al examen de admisión a la BUAP. Un diseño instruccional exitoso para potenciar las habilidades de razonamiento. Perfiles Educativos, 33(134), 52-64.
Díaz, K., Ravest, J. y Queupil, J. (2019). Brechas de género en los resultados de pruebas de selección universitaria en Chile. ¿Qué sucede en los extremos superior e inferior de la distribución de puntajes? Pensamiento Educativo. Revista de Investigación Educacional Latinoamericana, 56(1), 1-19. https://doi.org/10.7764/PEL.56.1.2019.5
Eum, K. y Rice, K. (2011). Test anxiety, perfectionism, goal orientation, and academic performance. Anxiety, Stress, and Coping, 24(2), 157-172. https://doi.org/10.1080/10615806.2010.488723
González, G., Nogueira, F., del Valle, M. y Grossi, C. (2020). Trayectorias educativas en el marco de la implementación del ingreso irrestricto en una universidad argentina. Revista Internacional de Educación para la Justicia Social, 9(2), 109-129. https://doi.org/10.15366/riejs2020.9.2.006
Green, M., Moeller, J. y Spak, J. (2018). Test enhanced-learning in health professions education. A systematic review. Medical Teacher, 40(4), 337-350. https://doi.org/10.1080/0142159X.2018.1430354
Khodabakhshzadeh, H., Zardkanloo, R. y Alipoor, I. (2017). The effect of mock tests on Iranian EFL learners’ test scores. International Journal of Education y Literacy Studies, 5(3), 47-51. https://dx.doi.org/10.7575/aiac.ijels.v.5n.3p.47
Larsen, D., Butler, A. y Roedinger, H. (2008). Test-enhanced learning in medical education. Medical Education, 42, 959-966. https://doi.org/10.1111/j.1365-2923.2008.03124.x
Leeming, F. (2002). The exam-a-day procedure improves performance in psychology classes. Teaching of Psychology, 23(3), 210-212. https://doi.org/10.1207/S15328023TOP2903_06
Loken, E., Radlinski, F., Crespi, V. H., Millet, J. y Cushing, L. (2004). Online study behavior of 100,000 students preparing for the SAT, ACT and GRE. Journal Educational Computing Research, 30(3), 255-262.
Manterola, C. y Otzen, T. (2014). Estudios observacionales: Los diseños utilizados con mayor frecuencia en investigación clínica. International Journal of Morphology, 32(2), 634-645. https://doi.org/10.4067/S0717-95022014000200042
McConnell, M., St-Onge, C. y Young, M. (2015). The benefits of testing for learning on later performance. Advances in Health Sciences Education, 20, 305-320. https://doi.org/10.1007/s10459-014-9529-1
McGaghie, W. C., Downing, S. M. y Kubilius, R. (2004). What is the impact of commercial test preparation courses on medical examination performance? Teaching and Learning in Medicine, 16(2), 202–211. https://doi.org/10.1207/s15328015tlm1602_14
Montgomery, P. y Lilly, J. (2012). Systematic reviews of the effects of preparatory courses on university entrance examinations in high school-age students. International Journal of Social Welfare, 21, 3-12. https://doi.org/10.1111/j.1468-2397.2011.00812.x
Moore, R., Sanchez, E. y San Pedro, M. O. (2018). Investigating test prep impact on score gains using quasi-experimental propensity score matching. ACT, Inc.
Niederle, M. y Vesterlund, L. (2010). Explaining the gender gap in math test scores: The role of competition. Journal of Economic Perspectives, 24(2), 129-144. https://doi.org/10.1257/jep.24.2.129
OECD. (2018). Education at a glance 2018: OECD Indicators. OECD. https://doi.org/10.1787/19991487
Pegalajar, M. (2020). Estrategias de trabajo autónomo en estudiantes universitarios noveles de educación. REICE. Revista Iberoamericana sobre Calidad, Eficacia y Cambio en Educación, 18(3), 29-45. https://doi.org/10.15366/reice2020.18.3.002
Powers, D. (1999). Coaching and the SAT I. The College Board.
Powers, D. (2012). Understanding the impact of special preparation for admissions tests. En R. B. (Eds.), Advancing human assessment. The methodological, psychological and policy contributions of ETS (pp. 553-564). Springer. https://doi.org/10.1007/978-3-319-58689-2_17
Rosefsky, A., Lavore, E. y Flores-Ivich, G. (2016). The international baccalaureate diploma programme in Mexico as preparation for higher education. A Journal of Comparative and International Education, 46(3), 344-368. https://doi.org/10.1080/03057925.2014.896188
Sanchez, E. (2019). Can using ACT online prep improve score gains? ACT Research y Policy.
Sánchez-Mendiola, M. y Delgado-Maldonado, L. (2017). Exámenes de alto impacto: Implicaciones educativas. Investigación en Educación Médica, 6(21), 52-62. https://doi.org/10.1016/j.riem.2016.12.001
Schaefle, S. (2018). The relationship between GEAR UP program involvement and Latina/o students’ performance on high-stakes tests. Journal of Latinos and Education, 17(3), 201-214. https://doi.org/10.1080/15348431.2017.1310653
SEP. (2019). Principales cifras del sistema educativo nacional 2018-2019. SEP.
Szafranski, D., Barrera, T. y Norton, P. (2012). Test anxiety inventory: 30 years later. Anxiety, Stress y Coping, 25(6), 667-677. https://doi.org/10.1080/10615806.2012.663490
Warne, R., Larsen, R., Anderson, B. y Odasso, A. (2015). The impact of participation in the advanced placement program on students' college admissions test scores. The Journal of Educational Research, 108(5), 400-416. https://doi.org/10.1080/00220671.2014.917253
Winke, P. y Lim, H. (2017). The effects of test preparation on second-language listening test perfomance. Language Assessment Quarterly, 14(4), 380-397. https://doi.org/10.1080/15434303.2017.1399396