10.57647/jals.2025.0502.01

Construction and Validation of a Questionnaire Evaluating the TEFL BA curriculum in Farhangiyan University: A Case of CIPP Model for Instructors

PDF
  • Mahdi Arabi1,
  • Hamid Ashraf*1,
  • Khalil Motallebzadeh2,
  1. Department of Foreign Languages Teaching, ToH. C., Islamic Azad University, Torbat Heydarieh, Iran
  2. Department of English, Tabaran Institute of Higher Education, Mashhad, Iran

Received: 2025-09-21

Revised: 2025-10-30

Accepted: 2025-12-08

Published in Issue 2025-12-30

Copyright (c) 2025 Mahdi Arabi, Hamid Ashraf, Khalil Motallebzadeh (Author)

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

How to Cite

Arabi, M., Ashraf, H., & Motallebzadeh, K. (2025). Construction and Validation of a Questionnaire Evaluating the TEFL BA curriculum in Farhangiyan University: A Case of CIPP Model for Instructors. Journal of Applied Linguistics Studies, 5(2). https://doi.org/10.57647/jals.2025.0502.01
Crossref
Scopus
Google Scholar
Europe PMC

PDF views: 0

Abstract

While evaluation of a newly developed program is necessary, the new ELT curriculum at Farhangian University has not been evaluated yet, and the most recent evaluation done is based on the previous ELT curriculum, which was implemented in Farhangian University before the new curriculum was developed. Therefore, the current study was done to conduct quantitative research to design a CIPP curriculum model evaluation for instructors of Farhangian University. Initially, an 87-item questionnaire for instructors was designed. 10 experts were selected to take part in the expert validation process of the study. Then, 200 EFL instructors of Farhangian universities of Iran were selected to participate (using a convenience sampling method) in the validation process of the study. To show the content validation of the questionnaires in the pilot phase of the study, the instructor questionnaire with 87 items was distributed among the 10 experts of the study. After calculating CVR and CVI, 17 items of the instructor questionnaire were removed. Then, the questionnaire with 70 Likert-scale items was distributed among the 200 participants of the study. The results of EFA, CFA and Cronbach’s Alpha revealed that the designed CIPP curriculum model questionnaire for instructors included 70 items and five components had acceptable validity and reliability. This suggests that curriculum developers should regularly review and update the curriculum to ensure it aligns with the country's evolving educational goals, including the integration of new pedagogical strategies, technologies, and international trends.

Keywords

  • CIPP Model,
  • Context,
  • Input,
  • Process,
  • Product,
  • TEFL Curriculum
PDF

References

  1. Agus, A., Juliadharma, M., & Djamaluddin, M. (2023). Application of the CIPP model in evaluation of the inclusive education curriculum in Madrasah Aliyah. Nidhomul Haq: Jurnal Manajemen Pendidikan Islam, 8(1), 31-50.‏
  2. Ahid, N., & Chamid, N. (2021). Implementation of Indonesian national qualification framework based curriculum in higher Islamic education. Journal Pendidikan Islam, 7(1), Art. 1.
  3. Alanshori, M. Z., Maulidi, A., Muhlisin, A., Kusaeri, K., & Suparto, S. (2025). The application of the CIPP evaluation model in educational programs in Indonesia. Scaffolding: Jurnal Pendidikan Islam Dan Multikulturalisme, 7(2), 103–122.
  4. Aliakbari, M., & Ghoreyshi, M. (2013). On the evaluation of the master of arts program in teaching English as a foreign language (TEFL) at Ilam University. European Online Journal of Natural and Social Sciences: Proceedings, 2(2s), 525-545.
  5. Aliakbari, M. & Tabatabaei, F. S. (2019). Evaluation of Iranian teacher education programs for EFL student-teachers. Journal of Modern Research in English Language Studies, 6(1), 131-105.
  6. Ayyusufi, A. M., Anshori, A., & Muthoifin, M. (2022). Evaluation of the CIPP model on the Tahfidz program in Islamic boarding schools. Nazhruna: Jurnal Pendidikan Islam, 5(2), 466-484.‏
  7. Aziz, S., Mahmood, M. & Rehman, Z. (2018). Implementation of CIPP model for quality evaluation at school level: A case study. Journal of Education and Educational Development, 5(1), 189-206.
  8. Bazargan, A. & Farasatkhah, M, (2017). Monitoring and Evaluation in Higher Education. Tehran: Samt Publication.
  9. Bharvad, A. J. (2010). Curriculum evaluation. International Research Journal, 1(12), 72-74.
  10. Brinbum, L, R. (1998). Curriculum development in higher education: process and innovations. London and New York: Routledge.
  11. Dizon, A. G. (2022). Historical development of CIPP as a curriculum evaluation model. Journal of the History of Education Society, 52 (1), 109- 128.
  12. Drakos, J. (2005). Ideas for developing a personal EFL teaching curriculum. The Internet TESL Journal, XI (3), 1-3.
  13. Duan, P., Xiang, J., Niu, H., & Han, C. (2023). Construction of evaluation index for Chinese engineering undergraduates based on CIPP model. Sage Open, 13(1), 1–14.
  14. Farrell, T. S. C. (2012). Reflecting on reflective practice: (Re)Visiting Dewey and Schön. TESOL Journal, 3(1), 7–16.
  15. Foroozandeh, E., Riazi, A. & Sadighi, F. (2007). TEFL program evaluation at master's level in Iran. Teaching English Language, 2(2), 71-100.
  16. Forss, K. Rebien, C. C. & Carlsson, J. (2002). Process use of evaluation: Types of use that precede lessons learned and feedback. Evaluation, 8 (1), 29- 45.
  17. Gifari, M. K., & Arifin, Z. (2024). Literature review: Evaluation of the Kurikulum Merdeka using the CIPP model. Inovasi Kurikulum, 21(3), 1747-1762.‏
  18. Ihsan, I., Pabbajah, M., Abdullah, I., & Hidayati, H. (2021). The contestation of national and religious curricula in Indonesia’s madrasas since the passage of the uuspn. Educational Studies, 0(0), 1–14.
  19. Insko, C. A., Thompson, V. D., Stroebe, W., Shaud, K. F., Pinner, B. E., & Layton, B. D. (1973). Implied evaluation and the similarity attraction effect. Journal of Personality and Social Psychology, 25(3), 297–308.
  20. Karimnia, A., & Kay, E. (2015). An evaluation of the undergraduate TEFL program in Iran: A Multi-Case Study. International Journal of Instruction, 8(2), 83-98.
  21. Kumalasari, S. M., & Fikroh, R. A. (2023). Development of android-based augmented reality Learning media on atomic matter. Jurnal Pendidikan Sains Indonesia, 11(3), 683–696.
  22. Layton, D. (1973). Science for people New York: Science History Publications. Ornstein, A.C. Hunkins, Curriculum Foundation, Principles and Issues. USA: Prentice Hall.
  23. Lee, C. D. (2017). Integrating research on how people learn and learning across settings as a window of opportunity to address inequality in educational processes and outcomes. Review of Research in Education, 41(1), 88–111.
  24. Liu, F., Zhang, T., Zhang, Ch., Liu, L., Wang, L. & Liu, B. (2023). A review of the evaluation system for curriculum learning. Electronics, 12, 1676.
  25. Madaus, G. F., Scriven, M. S., Stufflebeam, D. L. & Stufflebeam, D. L. (1983). The CIPP model for program evaluation: Evaluation models: viewpoints on educational and human services evaluation. Open Access Library Journal, 2(9), 117-141.
  26. Maasoumpanah, Z., Tahririan, M.S., Afzali, k., & Alibabaee. A. (2017). Evaluation of the undergraduate TEFL program at Farhangian University: Merits and demerits. Iranian Journal of Applied Linguistics (IJAL), 20(2), 157-193.
  27. Maasoumpanah, Z.,Tahririan, M.S., Afzali, k., Alibabaee. A. (2017). An evaluation of practicum courses at Farhangian University. Iranian Journal of Language Teaching Research, 7(2),101-119.
  28. Medgyes, P. & Nikolov, M. (2000). Curriculum development in foreign language education: The interface between political and professional decisions, in The Oxford handbook of applied linguistics.
  29. Muji, A. P., Gistituati, N., Bentri, A., & Falma, F. O. (2021). Evaluation of the implementation of the Sekolah Penggerak curriculum using the context, input, process and product evaluation model in high schools. JPPI (Jurnal Penelitian Pendidikan Indonesia), 7(3), 377–385.
  30. Najafi, N. V., Khamseh, A. A., & Mirzazadeh, A. (2020). An integrated sustainable and flexible supplier evaluation model under uncertainty by game theory and subjective/objective data: Iranian casting industry. Global Journal of Flexible Systems Management, 21(4), 309–322.
  31. Nation, I. S. P. & John Macalister (2010). Language Curriculum Design. New York & London: Routledge.
  32. Nouraey, P., Al- Badi, A., Riasati, M. J. & Lyn Maata, R. (2020). Educational program and curriculum evaluation models: A mini systematic review of the recent trends. Universal Journal of Educational Research, 8 (9), 4048- 4055.
  33. Nurhaliza, N., Munajat, N., & Rifai, I. (2025). The CIPP model in evaluating the independent curriculum: A study of Islamic religious education and ethics in Muhammadiyah Kleco II elementary school Kotagede, Yogyakarta. Kalijaga Journal of Islamic Religious Education, 1(1), 108-133.‏
  34. Randall, R. S. (1969). An operational application of the CIPP model for evaluation. Educational Technology, 9 (7), 40- 44.
  35. Ratnaya, G., Indriaswuri, R., Widayanthi, D. G. C., & Atmaja, I. M. P. D. (2022). CIPP evaluation model for vocational education: A critical review. Education Quarterly Reviews, 5(3), 1–8.
  36. Rebia, P. S., Suharno, Tamrin, A. G., & Akhyar, M. (2023). Evaluation of product-based education training class at vocational high school using the CIPP Model. Journal of Curriculum and Teaching, 12 (3), 135–146.
  37. Sankaran, S., & Saad, N. (2022). Evaluating the Bachelor of education program based on the context, input, process, and product model. Frontiers in Education, 7(6), 1–8.
  38. Santoso, P., Sari, E., & Karnati, N. (2024). Evaluation of the Indonesian language training program at the Defence language training center. Journal of Ecohumanism, 3(3), 956–980.
  39. Shi, X. (2024). Evaluation of practice courses in preschool education based on CIPP evaluation model. SHS Web of Conferences, 10(8), 190–195.
  40. Soontornwipast, K. (2008). An impact evaluation of a masters TEFL program operating at a language institute in Thailand (Doctoral dissertation, Victoria University). Journal of English Language Teaching and Learning, 3(17), 115-146.
  41. Stufflebeam, D. L. (2004). The 21st century CIPP model. Evaluation Roots, 9(8), 245-266.
  42. Sudiami, D. (2019). Internalization of social value based on character education strengthening through scouting extracurricular activities in public junior high school 1 Batang. Journal of Educational Social Studies, 8(1), 9- 18.
  43. Suryanto, A., Aman, Yuliana, L., Purwanto, N. A., Firdaus, F. M., & Fadhli, R. (2024). Context input process product evaluation of hybrid learning practices in Indonesian universities. International Journal of Evaluation and Research in Education, 13(1), 475–487.
  44. Tamsiyati, E., Agissa, A. W., Yuniar, & Junaidah. (2025). The impact of eliminating national examinations on educational evaluation quality in Indonesia: A policy analysis on equity and accountability. International Journal of Education and Literature, 4(1), 294–304.
  45. Tuna, H. & Başdal, M. (2021). Curriculum evaluation of tourism undergraduate programs in Turkey: A CIPP model-based framework. Journal of Hospitality, Leisure, Sport & Tourism Education, 29 (2021), 100324.
  46. Tunc, F. (2010). Evaluation of an English language teaching program at a public university using CIPP model (Master's thesis, Middle East Technical University).
  47. Warju, W. (2016). Educational program evaluation using CIPP model. INVOTEC, 12(1), 36- 42.
  48. Wheeler, D.K. (1967) Curriculum Process. London: U.K. University of London Press Ltd.
  49. Wiyono, B. B., Komariah, A., Hidayat, H., & Kusumaningrum, D. E. (2025). The structural effects of evaluation types in the implementation process of the independent learning program in higher education. Discover Sustainability, 6(1), 321–338.
  50. Yoshany, N., Mahmoodabad, S. S. M., Moradi, L., & Sharma, M. (2025). Beyond traditional training: a comprehensive CIPP evaluation of medical internships: assessing program design, implementation, and clinical competency outcomes. BMC Medical Education, 25(1), 1–8.
  51. Zamanian, M., & Mobashshernia, R. (2011). A survey of PhD programs in TEFL: Curricular strengths and weaknesses in Iranian universities. International Journal of Language Studies, 5(1).