Development and Validation of OBE-based Syllabus Evaluation Tool
Abstract
This study describes the development and validation of an evaluation tool to measure the quality of OBE-based syllabi and its compliance to flexible learning. This tool made used a two-stage approach. In the development stage, the items were carefully generated based on the answers from the experts. The tool was then scrutinized and examined by validators to review the items including its content and language used. Thus, a 17-item evaluation tool was developed. In the validation stage, the tool was pilot tested on 49 respondents and found to have a good level of reliability. The results of the construct validity using EFA with 288 respondents from the HEIs faculties in the region showed that the scale has two factors. The performance criteria were composed of ten (10) items while there were seven (7) items in the teaching-learning process component. The findings concluded that interplay between performance criteria and teaching-learning process indicators can be used to ensure the quality of the flexible learning-compliant OBE-based syllabi. Thus, confirmation of the structure of the developed evaluation tool is highly recommended.
Keywords:
syllabus evaluation tool, instrument development and validation
References
Biggs, J. (1999). Teaching for quality learning at university. Open University Press.
Biggs & Tang. (2007). Teaching for quality learning at university (Third edition).The Society for Research into Higher Education & Open University Press, Mc Graw Hill.
Breckler, S. J. (1990). Applications of covariance structure modeling in psychology: Cause for concern? Psychological Bulletin, 107, 260-273. https://doi.org/10.1037/0033- 2909.107.2.260.
Burger, M. (2008). The alignment of teaching, learning and assessment in English home language in grade10 in District 9, Johannesburg. MA Thesis, University of South Africa.
Caguimbal, D. et al.(2013). Level of awareness of the maritime students on the outcomes-based education. Educational Research International, 2(1), 7-12.
Centre for Holistic Teaching and Learning. (2021). Hong Kong Baptist University. Retrieved from https://chtl-bu.hkbu. edu.hk/main/teaching-and-learning/ obtl/
Cockett, A., & Jackson, C. (2018). The use of assessment rubrics to enhance feedback in higher education: An integrative literature review. Nurse Education Today, 69, 8-13.
Commission on Higher Education. (2020).CHED memorandum order no. 46 series of 2020. https://ched.gov.ph/ wp-content/uploads/2017/10/CMO- No.46-s2012.pdf
David, F.P. (2002). Understanding and doing research: A handbook for beginners. Panorama Printing Inc.
Delors, J. et.al. (1996). Learning: The treasure within. Report to UNESCO of the International Commision on Education for the Twenty-First Century.
Deneen, C. Brown, G., Bond, T., & Shroff, R. (2013). Understanding outcome-based education changes in teacher education: Evaluation of a new instrument with preliminary finding. Asia-Pacific Journal of Teacher Education, 41(4), 441-456. https:// www.tandfonline.com /doi/abs/10.1080/1359866X.2013.787392
DeVellis, R. (1991). Scale development: Theory and applications. Sage.
Fu, L. Y., & Shang, F. F. (2021). Cultivating innovative talents in journalism and communication practice in universities based on OBE concept—An example of teaching reform of online and offline hybrid first-class courses. Cuanbo Yu
Banqua, No. 1.
Gharajedaghi, J. (2011) Systems thinking(Third Edition).
Goldstein, M. (2006). Subjective Bayesian analysis: Principles and practice. Bayesian Analysis, 1(3) 403-420. https://doi.org/10.1214/06-BA116
Green, H. L. (1993). Defining quality. Assessment and Evaluation in Higher Education, 8(1), 9-34.
Guo, P., Wang, L., & Chen, L. (2017). Reform of automobile electronic technology teaching-mode based on OBE educational theory. Journal of Education and Praxis Research. 3, (1),1-5. http://www.cayley-nielson.com/jepr
Guskey, T. (1994, September). Defining the differences between outcome-based education and mastery learning. The School Administrator, 51, 34-37.
IN40BE Summit. (2022). Outcome-based education vs. traditional education. Retrieved from
https://in4obe.org/ assessment-evaluation
Kirk, D., & Welborn, L. (1992, March). The impact of outcome-based education and the library media program. Colorado Libraries, 18, 5-9.
Harden, R. M. (1999) AMEE Guide No. 14: Outcome-based education: Part 1-An introduction to outcome-based education. Medical Teacher, 21(1), 7-14, DOI: 10.1080/01421599
Harden, R. M., Crosby, J. R., & Davis, M. H. (1999). An introduction to outcome-based education. Med Teacher, 21(1):7–14, 8.
Lam, B. H., & Tsui, K. T. (2016).Curriculum mapping as deliberation– examining the alignment of subject learning outcomes and course curricula. Studies in Higher Education, 41(8), 1371-1388.
Mangali, G. R., Biscocho, S. S., Mary Rose M. Salagubang, M. R. M., & Del Castillo, A. P. (2019). Teaching and learning experiences in Letran’s partial implementation of outcomesbased education. International Journal of Multidisciplinary Research and Publications (IJMRAP), 2(1), 49-57.
McNeir, G. (1993). Outcome-based education: Tools for restructuring. Oregon School Study Council Bulletin.
Ministry of Education, Science, Vocational Training and Early Education. (2013). Zambia’s National Assessment Report 2012: Learning Achievement at the Middle Primary School Level. Lusaka: MoESVTEE
Ministry of Education, Science, Vocational Training and Early education (2013). Zambia education curriculum framework. Curriculum Development Centre.
Mulenga, I. M., & Luangala, J. R. (2015). Curriculum design in contemporary teacher education: What makes job analysis a vital preliminary ingredient? International Journal of Humanities, Social Sciences and Education, 2(1), 39-51.
Rong, H. (2021). On the OBE-based of connotations and paths in college English Golden Course [J]. Modern Communication, (15): 34-36.
Snyder, K. J., Acker-Hocevar, M., & Snyder, K. M. (2008). Living on the edge of chaos: Leading schools into the global age (2nd Ed.). Mental Health Law & Policy Faculty Publications. 34. https://digitalcommons.usf.edu/mhlp_ facpub/34
Spady, W. G. (1993). Outcome-based education. ACSA Report, 5, Belconnen: pii Australian Curriculum Studies Association.
Spady, W. G.. (1994). OBE: Reform in search of a definition. (2011-10-13) [2016-10-26]. http://encyclopedia.the- freedictionary.com/Outcome-Based Education.
Spady, W. G., & A. Schlebusch. 1999. Curriculum 2005: A guide for parents. Renaissance, Tafelberg.
Tam, M. (2014). Outcomes-based approach to quality assessment and curriculum improvement in higher education. Quality Assurance in Education, 22 (2): 158– 168. doi:10.1108/QAE-09-2011-0059.
Thai Nguyen University (2013). Project on standardizing language skills for TNU academic staffs and students of the 2013-2015 and the 2016-2020 periods. http://www.tnu.edu.vn/Pages/-tnuvb- portal_VanBanPhapQuy-tnudoc-44- tnusite-1.html
Waxman, H. C. (2001). Research on school-based improvement programs:Its implications for curriculum implementation. Education, 15(3), 318-322.
Biggs & Tang. (2007). Teaching for quality learning at university (Third edition).The Society for Research into Higher Education & Open University Press, Mc Graw Hill.
Breckler, S. J. (1990). Applications of covariance structure modeling in psychology: Cause for concern? Psychological Bulletin, 107, 260-273. https://doi.org/10.1037/0033- 2909.107.2.260.
Burger, M. (2008). The alignment of teaching, learning and assessment in English home language in grade10 in District 9, Johannesburg. MA Thesis, University of South Africa.
Caguimbal, D. et al.(2013). Level of awareness of the maritime students on the outcomes-based education. Educational Research International, 2(1), 7-12.
Centre for Holistic Teaching and Learning. (2021). Hong Kong Baptist University. Retrieved from https://chtl-bu.hkbu. edu.hk/main/teaching-and-learning/ obtl/
Cockett, A., & Jackson, C. (2018). The use of assessment rubrics to enhance feedback in higher education: An integrative literature review. Nurse Education Today, 69, 8-13.
Commission on Higher Education. (2020).CHED memorandum order no. 46 series of 2020. https://ched.gov.ph/ wp-content/uploads/2017/10/CMO- No.46-s2012.pdf
David, F.P. (2002). Understanding and doing research: A handbook for beginners. Panorama Printing Inc.
Delors, J. et.al. (1996). Learning: The treasure within. Report to UNESCO of the International Commision on Education for the Twenty-First Century.
Deneen, C. Brown, G., Bond, T., & Shroff, R. (2013). Understanding outcome-based education changes in teacher education: Evaluation of a new instrument with preliminary finding. Asia-Pacific Journal of Teacher Education, 41(4), 441-456. https:// www.tandfonline.com /doi/abs/10.1080/1359866X.2013.787392
DeVellis, R. (1991). Scale development: Theory and applications. Sage.
Fu, L. Y., & Shang, F. F. (2021). Cultivating innovative talents in journalism and communication practice in universities based on OBE concept—An example of teaching reform of online and offline hybrid first-class courses. Cuanbo Yu
Banqua, No. 1.
Gharajedaghi, J. (2011) Systems thinking(Third Edition).
Goldstein, M. (2006). Subjective Bayesian analysis: Principles and practice. Bayesian Analysis, 1(3) 403-420. https://doi.org/10.1214/06-BA116
Green, H. L. (1993). Defining quality. Assessment and Evaluation in Higher Education, 8(1), 9-34.
Guo, P., Wang, L., & Chen, L. (2017). Reform of automobile electronic technology teaching-mode based on OBE educational theory. Journal of Education and Praxis Research. 3, (1),1-5. http://www.cayley-nielson.com/jepr
Guskey, T. (1994, September). Defining the differences between outcome-based education and mastery learning. The School Administrator, 51, 34-37.
IN40BE Summit. (2022). Outcome-based education vs. traditional education. Retrieved from
https://in4obe.org/ assessment-evaluation
Kirk, D., & Welborn, L. (1992, March). The impact of outcome-based education and the library media program. Colorado Libraries, 18, 5-9.
Harden, R. M. (1999) AMEE Guide No. 14: Outcome-based education: Part 1-An introduction to outcome-based education. Medical Teacher, 21(1), 7-14, DOI: 10.1080/01421599
Harden, R. M., Crosby, J. R., & Davis, M. H. (1999). An introduction to outcome-based education. Med Teacher, 21(1):7–14, 8.
Lam, B. H., & Tsui, K. T. (2016).Curriculum mapping as deliberation– examining the alignment of subject learning outcomes and course curricula. Studies in Higher Education, 41(8), 1371-1388.
Mangali, G. R., Biscocho, S. S., Mary Rose M. Salagubang, M. R. M., & Del Castillo, A. P. (2019). Teaching and learning experiences in Letran’s partial implementation of outcomesbased education. International Journal of Multidisciplinary Research and Publications (IJMRAP), 2(1), 49-57.
McNeir, G. (1993). Outcome-based education: Tools for restructuring. Oregon School Study Council Bulletin.
Ministry of Education, Science, Vocational Training and Early Education. (2013). Zambia’s National Assessment Report 2012: Learning Achievement at the Middle Primary School Level. Lusaka: MoESVTEE
Ministry of Education, Science, Vocational Training and Early education (2013). Zambia education curriculum framework. Curriculum Development Centre.
Mulenga, I. M., & Luangala, J. R. (2015). Curriculum design in contemporary teacher education: What makes job analysis a vital preliminary ingredient? International Journal of Humanities, Social Sciences and Education, 2(1), 39-51.
Rong, H. (2021). On the OBE-based of connotations and paths in college English Golden Course [J]. Modern Communication, (15): 34-36.
Snyder, K. J., Acker-Hocevar, M., & Snyder, K. M. (2008). Living on the edge of chaos: Leading schools into the global age (2nd Ed.). Mental Health Law & Policy Faculty Publications. 34. https://digitalcommons.usf.edu/mhlp_ facpub/34
Spady, W. G. (1993). Outcome-based education. ACSA Report, 5, Belconnen: pii Australian Curriculum Studies Association.
Spady, W. G.. (1994). OBE: Reform in search of a definition. (2011-10-13) [2016-10-26]. http://encyclopedia.the- freedictionary.com/Outcome-Based Education.
Spady, W. G., & A. Schlebusch. 1999. Curriculum 2005: A guide for parents. Renaissance, Tafelberg.
Tam, M. (2014). Outcomes-based approach to quality assessment and curriculum improvement in higher education. Quality Assurance in Education, 22 (2): 158– 168. doi:10.1108/QAE-09-2011-0059.
Thai Nguyen University (2013). Project on standardizing language skills for TNU academic staffs and students of the 2013-2015 and the 2016-2020 periods. http://www.tnu.edu.vn/Pages/-tnuvb- portal_VanBanPhapQuy-tnudoc-44- tnusite-1.html
Waxman, H. C. (2001). Research on school-based improvement programs:Its implications for curriculum implementation. Education, 15(3), 318-322.
Published
2022-12-13
Section
Articles
Copyright (c) 2022 Asia Pacific Journal of Social and Behavioral Sciences
Copyright holder is the Bukidnon State University.