Vol. 29 No. 2 (2014)
Research Articles

Diagnosing L2 Learners' Language Skills Based on the Use of a Web-Based Assessment Tool Called DIALANG

HTML ePub PDF
  • Mahboubeh Taghizadeh,
  • Sayyed Mohammad Alavi,
  • Abbas Ali Rezaee
Mahboubeh Taghizadeh
University of Tehran
Sayyed Mohammad Alavi
University of Tehran
Abbas Ali Rezaee
University of Tehran

Published 2014-12-08

Keywords

  • Common European Framework,
  • DIALANG,
  • Self-assessment,
  • Listening,
  • Reading,
  • and Speaking skills
    • ...More
    Less

How to Cite

Taghizadeh, M., Alavi, S. M., & Rezaee, A. A. (2014). Diagnosing L2 Learners’ Language Skills Based on the Use of a Web-Based Assessment Tool Called DIALANG. International Journal of E-Learning & Distance Education Revue Internationale Du E-Learning Et La Formation à Distance, 29(2). Retrieved from https://ijede.ca/index.php/jde/article/view/889
Copyright Notice

Abstract

DIALANG is an online assessment system used for language learners who want to obtain diagnostic information about their language proficiency (Council of Europe, 2001). The purpose of this study was to examine skill-based self-assessment across different majors. This study was conducted with 68 Iranian students studying at the Alborz Institute of Higher Education. The participants' majors were Teaching English as a Foreign Language (TEFL; n = 23), English Language Literature (ELL; n = 22), and English Language Translation (ELT; n = 23). DIALANG self-assessment scales, consisting of 107 statements with Yes/No responses, were used in this study. Results indicated that ELL students had the highest overall ranking for listening skills, whereas TEFL students received the lowest overall ranking. ELL students had the highest reading skill scores while ELT students demonstrated the lowest scores. ELL students ranked their writing ability the highest, whereas TEFL students rated their writing skill the lowest. Kruskal-Wallis analysis revealed that there was no statistically significant difference in listening and reading skills across the three majors. One-way between-group ANOVA did demonstrate a statistically significant difference in the writing self-assessment statements for the three groups. Implications and directions for future research with DIALANG are provided based on results from the study.
HTML ePub PDF

References

  1. Abolfazli Khonbi, Z., & Sadeghi, K. (2012). The effect of assessment type (self vs. peer) on Iranian university EFL students' course achievement. Procedia - Social and Behavioral Sciences, 70, 1552-1564.
  2. Airasian, P. W. (1997). Classroom assessment (3rd ed.). New York: McGraw-Hill.
  3. Alderson, C. J. (2005). Diagnosing foreign language proficiency: The interface between learning and assessment. London: Continuum.
  4. Alderson, C. J., & McIntyre, D. (2006). Implementing and evaluating a self-assessment mechanism for the Web-based language and style course. Language and Literature, 15(3), 291-306.
  5. Al Fallay, I. (2004). The role of some selected psychological and personality traits of the rater in the accuracy of self- and peer- assessment. System, 32(3), 407-425.
  6. Alvarez, M., & Rice, J. (2006). Web-based tests in second/foreign language self-assessment. The 29th Annual Proceedings, 2, (pp.13-21). Dallas: The National Convention of the Association for Educational Communications and Technology.
  7. Andrade, H., Du,Y., & Mycek, K. (2010). Rubric-referenced self-assessment and middle school students’ writing. Assessment in Education, 17(2), 199-214.
  8. Bachman, L., & Palmer, A. (1989). The construct validation of self ratings of communicative language ability. Language Testing, 6, 14-29.
  9. Barbera, E. (2009). Mutual feedback in e-portfolio assessment: An approach to the net folio system. British Journal of Educational Technology, 40(2), 342-357.
  10. Benson, P. (2001). Teaching and researching autonomy in language learning. London: Longman.
  11. Black, P., & Wiliam, D. (1998.). Assessment and classroom learning. Assessment in Education, 5, 7-74.
  12. Blanche, P. (1988). Self-assessment of foreign language skills: Implications for teachers and researchers. RELC Journal, 19(1), 75-96.
  13. Blanche, P., & Merino, B. J. (1989). Self-assessment of foreign language skills. Language Learning, 39(3), 313–340.
  14. Blue, G. (1994). Self-assessment of foreign language skills: Does it work? CLE Working Papers, 3, 18–35.
  15. Boud, D. (1995). Enhancing learning through self assessment. London: Kogan Page.
  16. Brantmeier, C., & Vanderplank, R. (2008). Descriptive and criterion-referenced self-assessment with L2 readers. System, 36, 456-477.
  17. Brindley, G. (1989). Assessing achievement in the learner-centered curriculum. NCELTR: Sydney, NSW.
  18. Brown, H. (2004). Language assessment: Principles and classroom practices. New York, NY: Longman.
  19. Brown, J. D., & Hudson, T. (1998). The alternatives in language assessment. TESOL Quarterly, 32, 653-675.
  20. Brunfaut, T. (2014). A lifetime of language testing: An interview with J. Charles Alderson. Language Assessment Quarterly, 11(1), 103-119.
  21. Butler, Y. G., & Lee, J. (2010). The effects of self-assessment among young learners of English. Language Testing, 27(1), 5-31.
  22. Chapelle, C. A. (2006). Test review. Language Testing, 23(4), 544-550.
  23. Chen, J., Belkada, S., & Okamoto, T. (2004). How a Web-based course facilitates acquisition of English for academic purposes. Language Learning & Technology, 8(2), 33-49.
  24. Chen, Y. M. (2006). Peer and self-assessment for English oral performance: A study of reliability and learning benefits. English Teaching and Learning, 30(4), 1-22.
  25. Chen, Y. M. (2008). Learning to self-assess oral performance in English: A longitudinal case study. Language Teaching Research, 12(2), 235-262.
  26. Council of Europe. (2001). The common European framework of reference for languages: Learning, teaching, assessment. Cambridge: Cambridge University Press.
  27. Cram, B. (1995). Self-assessment: From theory to practice. In: G. Brindley (Ed.), Language assessment in action: Developing a workshop guide for teachers (pp.271–305). NCELTR: Sydney, NSW.
  28. Dann, R. (2002). Promoting assessment as learning: Improving the learning process. New York: Routledge.
  29. Davies, A. (2003). Three heresies of language testing research. Language Testing, 20(4), 355-368.
  30. Deakin-Crick et al. (2005). Research evidence of the impact on students of self-and peer-assessment. EPPI-Centre: London.
  31. Escribano, I. D., & McMahon, J. P. (2010). Self-assessment based on language learning outcomes: A study with first year Engineering students. Revista Alicantina de Estudios Ingleses, 23, 133-148.
  32. Esfandiari, R., & Myford, C. M. (2013). Severity differences among self-assessors, peer-assessors, and teacher assessors rating EFL essays. Assessing Writing, 18, 111-131.
  33. Falchikov, N. (1986). Product comparisons and process benefits of collaborative peer group and self assessments. Assessment and Evaluation in Higher Education, 11(2), 146-165.
  34. Haahr, J. H., & Hansen, M. E. (2006). Adult skills assessment in Europe: Feasibility study. Danish Technological Institute.
  35. Hamp-Lyons, L. (2007). Final report of the longitudinal study on the school-based assessment component of the 2007 HKCE English language examination. Report submitted to the Hong Kong Examinations and Assessment Authority, November.
  36. Hana Lim, H. (2007). A Study of self- and peer-assessment of learners’ oral proficiency. CamLing, 169-176.
  37. Hubbard, P., & Levy, M. (Eds.). (2006). The scope of CALL education. In P. Hubbard & M. Levy (Eds.), Teacher education in CALL (pp. 3-20). Amsterdam: John Benjamins Publishing Company.
  38. Kato, F. (2009). Student preferences: Goal-setting and self-assessment activities in a tertiary education environment. Language Teaching Research, 13(2), 177-199.
  39. Klimova, B. F., & Hubackova, S. (2013). Diagnosing students' language knowledge and skills. Procedia - Social and Behavioral Sciences, 82, 436-439.
  40. LeBlanc, R., & Painchaud, G. (1985). Self-assessment as a second language placement instrument. TESOL Quarterly, 19(4), 673-687.
  41. McDonald, B., & Boud, D. (2003). The impact of self-assessment on achievement: the effects of self-assessment training on performance in external examinations. Assessment in Education, 10(2), 209-220.
  42. Moritz, Ch. E.B. (1996). Student self-Assessment of language proficiency: Perceptions of self and others. A paper presented at AAAL Chicago Conference. Retrieved from Eric.
  43. Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2): 199–218.
  44. North, B. (2000). Defining a flexible common measurement scale: Descriptors for self and teacher assessment. In: G. Ekbatani & H. Pierson (Eds.), Learner-directed assessment in ESL (pp.13-48). Mahwah, NJ: Lawrence Erlbaum Associates.
  45. Orsmond, P., Merry, S., & Reiling, K. (2000). The use of student derived marking criteria in peer and self-assessment. Assessment and Evaluation in Higher Education, 25(1), 23-38.
  46. Orsmond, P., Merry, S., & Reiling, K. (2002). The use of exemplars and formative feedback when using student derived marking criteria in peer and self-assessment. Assessment and Evaluation in Higher Education, 27(4), 309–323.
  47. Oscarson M (1989). Self-assessment of language proficiency: Rationale and applications. Language Testing, 6(1), 1-13.
  48. Oscarson, M. (1997). Self-assessment of foreign and second language proficiency. In The encyclopedia of language and education,Vol. 7: Language testing and assessment(pp. 175–187). Dordrecht: Kluwer Academic.
  49. Paris, S. G., & Paris, A. H. (2001). Classroom applications of research on self-regulated learning. Educational Psychology, 36(2), 89-101.
  50. Peden, B. F., & Carroll, D. W. (2008). Ways of writing: Linguistic analysis of self-assessment and traditional assignments. Teaching of Psychology, 35(4), 313–318.
  51. Pierce, B. N. et al. (1993). Self-assessment, French immersion, and locus of control. Applied Linguistics, 14(1), 25-42.
  52. Ross, S. (1998). Self-assessment in second language testing: A meta-analysis and analysis of experimental factors. Language Testing, 15(1), 1–19.
  53. Sadler, P., & Good, E. (2006).The impact of self- and peer-grading on student learning. Educational Assessment, 11(1), 1-31.
  54. Sahragard, R., Baharloo, A., & Soozandehfar, S. (2011). A closer look at the relationship between academic achievement and language proficiency among Iranian EFL students. Theory and Practice in Language Studies, 1(12), 1740-48.
  55. Saito, H., & Fujita, T. (2004). Characteristics and user acceptance of peer rating in EFL writing classrooms. Language Teaching Research, 8(1), 31–54.
  56. Sally, A. (2005). How effective is self-Assessment in writing? In P. Davidson, C. Coombe, & W. Jones (Eds.), Assessment in the Arab world. (pp. 307-321). United Arab Emirates: TESOL Arabia.
  57. Segers, M., & Dochy, F. (2001). New assessment forms in problem-based learning: The value added of the students’ perspective. Studies in Higher Education, 26(3), 327–343.
  58. Shohamy, E. (2001). Democratic assessment as an alternative. Language Testing, 18(4), 373–391.
  59. Silye, M. F., & Wiwczaroski, T. B. (2002). A critical review of selected computer assisted language testing instruments. [online] University of Debrecen, Centre of Agricultural Sciences, Faculty of Agricultural Sciences, Centre of Technical Languages Instruction, Debrecen. Retrieved from http://www.date.hu/acta-agraria/2002-01i/fekete1.pdf
  60. Son, J.-B. (2008). Using Web-based language learning activities. International Journal of Pedagogies and Learning, 4(4), 34-43.
  61. Stanley, J. (1992). Coaching student writers to be effective peer evaluators. Journal of Second Language Writing, 1, 217–233.
  62. Stefani, L. (1998). Assessment in partnership with learners. Assessment and Evaluation in Higher Education, 23(4), 339–350.
  63. Stiggins, R. J. (2001). Student-involved classroom assessment (3rd ed.). Upper Saddle River, NJ: Merrill.
  64. Suzuki, M. (2009). The compatibility of L2 learners' assessment of self- and peer revisions of writing with teachers' assessment. TESOL Quarterly, 43(1), 137-148.
  65. Taras M (2001). The use of tutor feedback and student self-assessment in summative assessment tasks: Towards transparency for students and for tutors. Assessment and Evaluation in Higher Education, 26(6), 605–614.
  66. Taras, M. (2003) To feedback or not to feedback in student self-assessment. Assessment and Evaluation in Higher Education, 28(5), 549-565.
  67. Todd, R.W. (2002). Using self-assessment for evaluation. English Teaching Forum, 40(1), 16-19.
  68. Topping, K. J. (2003). Self-and peer-assessment in school and university: Reliability, validity and utility. In: M. Segers & E. Cascallar (Eds.), Optimizing new methods of assessment: In search of qualities and standards (pp. 55-87). Dordrecht, Netherlands: Kluwer Academic Publishers.
  69. Towler, L., & Broadfoot, P. (1992). Self‐assessment in the primary school. Educational Review, 44(2), 137-151.
  70. Wagner, L., & Lilly, D. H. (1999). Asking the experts: Engaging students in self-assessment and goal setting through the use of portfolios. Assessment for Effective Intervention, 25(1), 31-43.
  71. Warschauer, M., & Meskill, C. (2000). Technology and second language learning. In J. Rosenthal (Ed.), Handbook of undergraduate second language education (pp. 303-318). Mahwah, New Jersey: Lawrence Erlbaum.
  72. Wiggins, G. P. (1993). Assessing student performance: Exploring the purpose and limits of testing. San Francisco: Jossey Bass.