Article Sidebar

Submitted
Oct 27, 2020
Published
Oct 26, 2020
Download
PDF
Statistic
Read Counter : 322 Download : 258

Main Article Content

Abstract

Establishing test validity is among the highly significant issues in language assessment which can be achieved by employing well-established validity frameworks. Adopting validity frameworks could generate valid and reliable tests that inform more systematic decisions. Using Weir’s socio-cognitive framework (2005), this paper aims to highlight the validation process of the reading questions in the General Education Diploma of English Language Test (GEDELT) of 2016/2017 in Oman. Findings revealed that context-validity is inadequately satisfied due to the test response format, absence of allotted time for each question and the exhaustion that the test takers may experience due to the length of the test. Theory-based validity witnesses strengths from utilizing a large number of texts and a weakness from overemphasis on the skill of scanning to locate specific information. Scoring-validity is considered high since types of task response, marking guides and electronic marking reduce markers' subjectivity and minimize human error. The study draws its conclusions in light of the findings of test validity. 

Keywords

Weir framework socio-cognitive validation test validity reading.

Article Details

References

  1. Alderson, J.C. (2000). Assessing reading. Cambridge: Cambridge University Press.
  2. Al-Ismaili, A. A. (2015). Ensuring the context validity of English reading tests for aca-demic purposes (EAP) in Oman (Doctoral dissertation, University of Bradford, UK). Retrieved from https://bradscholars.brad.ac.uk/handle/10454/15710
  3. Al-Issa, A. S., & Al-Bulushi, A. H. (2012). English language teaching reform in Sultanate of Oman: The case of theory and practice disparity. Educational Re-search for Policy and Practice, 11(2), 141-176.‏ https://doi.org/10.1007/s10671-011-9110-0
  4. Al-Kharusi, H. (2011). Teachers' classroom assessment skills: Influence of gender, subject area, grade level, teaching expe-rience and in-service assessment train-ing. Journal of Turkish Science Education, 8(2), 39-48.
  5. Al-Lawati, N. (2002). Washback effect of secondary certificate English examina-tion on teaching and learning process-es. (Unpublished master’s thesis). Sul-tan Qaboos University, Oman.
  6. Al-Mekhlafi, A., Al-Mamari, M., & Al-Barwani, T. (2019). The question of communicative language ability in EFL testing: The case of language testing in Oman.‏ Sumerianz Journal of Education, Linguistics and Literature. 2(8), 51-61.
  7. Angen, M. J. (2000). Evaluating interpretive inquiry: Reviewing the validity debate and opening the dialogue. Qualitative Health Research, 10(3), 378-395.‏ https://doi.org/10.1177/104973230001000308
  8. Bachman, L. F. (1990). Fundamental consid-erations in language testing. Oxford: Ox-ford University Press.
  9. Bachman, L. F. (2000). Modern language testing at the turn of the century: Assur-ing that what we count counts. Lan-guage Testing, 17(1), 1-42. https://doi.org/10.1177/026553220001700101
  10. Bachman, L. F., & Palmer, A. S. (1996). Language testing in practice: Design-ing and developing useful language tests. Oxford: Oxford University Press.
  11. Bowen, G. A. (2009). Document analysis as a qualitative research method. Qualita-tive Research Journal, 9(2), 27- 40.
  12. Carrell, P. L., Pharis, B. G., & Liberto, J. C. (1989). Metacognitive strategy training for ESL reading. TESOL Quarterly, 23(4), 647-678. https://doi.org/10.2307/3587536
  13. Creswell, J. W. (2007). Qualitative inquiry & research design: Choosing among five approaches. Thousand Oaks, CA: Sage.
  14. Fulcher, G. (2010). Practical language testing. Uk, London: Routledge.‏
  15. Higher Education Admission Center in Oman. (2019). Number of general educa-tion diploma students who passed English language subject and got admitted into higher education in 2017/2018. Oman: Ministry of Higher Education.
  16. Hughes, A. (2003). Testing for Language Teachers. Cambridge: Cambridge Uni-versity Press.
  17. Khalifa, H. (2005). Are test taker character-istics accounted for in Main Suite Reading papers? Research Notes 21, 7-10.
  18. Khalifa, H. & Weir, C. J. (2009). Examining reading: Research and practice in as-sessing second language reading. Cambridge: Cambridge University Press.
  19. McNamara, T. (2000). Language Testing. Oxford: Oxford University Press.
  20. Ministry of Education. (2012). English lan-guage curriculum framework in Oman. Oman: Ministry of Education Publica-tion.
  21. Ministry of Education. (2015). Ministerial decree 588 regarding the regulations of managing general education diploma ex-ams and what is at its level. Oman: Minis-try of Education Publications. Re-trieved from https://home.moe.gov.om/file/kararw.pdf
  22. Ministry of Education. (2016). Student as-sessment handbook for English grades 11&12. Oman: Directorate general of educational evaluation.
  23. Ministry of Education. (2020). Exams li-brary. Oman: Ministry of Education. Retrieved from http://zawity.moe.gov.om/images/library/file/Book6117328009.pdf
  24. Ministry of Education, Oman & World Bank. (2012). Education in Oman: The drive for quality. Muscat, Sultanate of Oman: Ministry of Education. Re-trieved from http://documents.worldbank.org/curated/en/246211468291645003/pdf/757190ESW0v10W0port0Summary-English.pdf
  25. Mohammed, M. T. (2019). An exploration of why learning English for twelve years in Omani public schools is inad-equate preparation for Omani students entering Higher Education.‏ (Doctoral dissertation, The University of Liver-pool, UK). Retrieved from https://livrepository.liverpool.ac.uk/3065894/1/H00025378_Nov2019.pdf
  26. Plake, B. S., & Wise, L. L. (2014). What is the role and importance of the revised AE-RA, APA, NCME standards for educa-tional and psychological testing? Edu-cational Measurement: Issues and Practice, 33(4), 4–12. doi: 10.1111/emip.12045
  27. Rapley, T. (2007). Doing conversation, dis-course and document analysis. Lon-don: Sage.
  28. Runté, R. (1998). The impact of centralized examinations on teacher professional-ism. Canadian Journal of Education/Revue canadienne de l'education, 23(2), 166-181.‏ https://doi.org/10.2307/1585978
  29. Urquhart, A.H. and Weir, C.J. (1998). Read-ing in a second language: Process, product and practice. Harlow: Long-man.
  30. Weir, C. J. (1993). Understanding and develop-ing language tests. London: Prentice-Hall
  31. Weir, C. J. (2005). Language testing and vali-dation: An evidence-based approach. Hampshire: Palgrave McMillan. https://doi.org/10.1057/9780230514577