Automating Language Proficiency Evaluation in English Language Teaching: An NLP Framework

  • Punit Pathak*
  • , E. Pearlin
  • , K. S. Punithaasree
  • , K. Madhura
  • , A. Rajeswari
  • , Fredrick Ruban Alphonse
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Language proficiency assessment is a critical aspect of English Language Teaching (ELT), serving as a foundation for gauging learners' language skills and guiding instructional strategies. However, traditional assessment methods often face challenges such as subjectivity, inefficiency, and potential biases, hindering accurate and objective evaluation. In response to these limitations, this study introduces a pioneering Natural Language Processing (NLP) framework aimed at transforming language proficiency assessment in ELT. The primary objective of this research is to develop an automated, objective, and scalable approach to language proficiency evaluation that aligns with established proficiency frameworks such as the Common European Framework of Reference (CEFR) or the ACTFL Proficiency Guidelines. The novelty of the proposed framework lies in its innovative integration of advanced NLP techniques, particularly leveraging Generative Pre-trained Transformer (GPT) models, with Support Vector Machine (SVM) classification. The framework's architecture is designed to analyze linguistic data comprehensively, extracting relevant features and predicting proficiency levels accurately. Evaluation results showcase the framework's exceptional performance, achieving an accuracy of 98%, precision of 88%, recall of 82%, and F1-Score of 85%. These results underscore the framework's effectiveness in objectively assessing language proficiency levels across diverse educational settings. The contributions of this study extend beyond methodological advancements; they offer significant implications for practitioners and researchers in the field of ELT. The suggested framework has the potential to completely transform teaching and learning outcomes in ELT by offering a strong instrument for impartial and trustworthy language proficiency evaluation, promoting improved language acquisition and communication skills among students. This work represents a significant breakthrough in the field of language competency assessment, providing a game-changing approach to solve current issues and satisfy the changing requirements of language learners and educators in the digital era.

Original languageEnglish
Title of host publication3rd International Conference on Communication, Control, and Intelligent Systems, CCIS 2024
EditorsAasheesh Shukla, Manish Gupta, Manish Kumar, Shreesh Kumar Shrivastava
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798331528201
DOIs
Publication statusPublished - 2024
Event3rd International Conference on Communication, Control, and Intelligent Systems, CCIS 2024 - Mathura, India
Duration: 06-12-202407-12-2024

Publication series

Name3rd International Conference on Communication, Control, and Intelligent Systems, CCIS 2024

Conference

Conference3rd International Conference on Communication, Control, and Intelligent Systems, CCIS 2024
Country/TerritoryIndia
CityMathura
Period06-12-2407-12-24

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Signal Processing
  • Safety, Risk, Reliability and Quality
  • Logic
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Automating Language Proficiency Evaluation in English Language Teaching: An NLP Framework'. Together they form a unique fingerprint.

Cite this