TY - GEN
T1 - Automating Language Proficiency Evaluation in English Language Teaching
T2 - 3rd International Conference on Communication, Control, and Intelligent Systems, CCIS 2024
AU - Pathak, Punit
AU - Pearlin, E.
AU - Punithaasree, K. S.
AU - Madhura, K.
AU - Rajeswari, A.
AU - Ruban Alphonse, Fredrick
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - Language proficiency assessment is a critical aspect of English Language Teaching (ELT), serving as a foundation for gauging learners' language skills and guiding instructional strategies. However, traditional assessment methods often face challenges such as subjectivity, inefficiency, and potential biases, hindering accurate and objective evaluation. In response to these limitations, this study introduces a pioneering Natural Language Processing (NLP) framework aimed at transforming language proficiency assessment in ELT. The primary objective of this research is to develop an automated, objective, and scalable approach to language proficiency evaluation that aligns with established proficiency frameworks such as the Common European Framework of Reference (CEFR) or the ACTFL Proficiency Guidelines. The novelty of the proposed framework lies in its innovative integration of advanced NLP techniques, particularly leveraging Generative Pre-trained Transformer (GPT) models, with Support Vector Machine (SVM) classification. The framework's architecture is designed to analyze linguistic data comprehensively, extracting relevant features and predicting proficiency levels accurately. Evaluation results showcase the framework's exceptional performance, achieving an accuracy of 98%, precision of 88%, recall of 82%, and F1-Score of 85%. These results underscore the framework's effectiveness in objectively assessing language proficiency levels across diverse educational settings. The contributions of this study extend beyond methodological advancements; they offer significant implications for practitioners and researchers in the field of ELT. The suggested framework has the potential to completely transform teaching and learning outcomes in ELT by offering a strong instrument for impartial and trustworthy language proficiency evaluation, promoting improved language acquisition and communication skills among students. This work represents a significant breakthrough in the field of language competency assessment, providing a game-changing approach to solve current issues and satisfy the changing requirements of language learners and educators in the digital era.
AB - Language proficiency assessment is a critical aspect of English Language Teaching (ELT), serving as a foundation for gauging learners' language skills and guiding instructional strategies. However, traditional assessment methods often face challenges such as subjectivity, inefficiency, and potential biases, hindering accurate and objective evaluation. In response to these limitations, this study introduces a pioneering Natural Language Processing (NLP) framework aimed at transforming language proficiency assessment in ELT. The primary objective of this research is to develop an automated, objective, and scalable approach to language proficiency evaluation that aligns with established proficiency frameworks such as the Common European Framework of Reference (CEFR) or the ACTFL Proficiency Guidelines. The novelty of the proposed framework lies in its innovative integration of advanced NLP techniques, particularly leveraging Generative Pre-trained Transformer (GPT) models, with Support Vector Machine (SVM) classification. The framework's architecture is designed to analyze linguistic data comprehensively, extracting relevant features and predicting proficiency levels accurately. Evaluation results showcase the framework's exceptional performance, achieving an accuracy of 98%, precision of 88%, recall of 82%, and F1-Score of 85%. These results underscore the framework's effectiveness in objectively assessing language proficiency levels across diverse educational settings. The contributions of this study extend beyond methodological advancements; they offer significant implications for practitioners and researchers in the field of ELT. The suggested framework has the potential to completely transform teaching and learning outcomes in ELT by offering a strong instrument for impartial and trustworthy language proficiency evaluation, promoting improved language acquisition and communication skills among students. This work represents a significant breakthrough in the field of language competency assessment, providing a game-changing approach to solve current issues and satisfy the changing requirements of language learners and educators in the digital era.
UR - https://www.scopus.com/pages/publications/105002274579
UR - https://www.scopus.com/pages/publications/105002274579#tab=citedBy
U2 - 10.1109/CCIS63231.2024.10931983
DO - 10.1109/CCIS63231.2024.10931983
M3 - Conference contribution
AN - SCOPUS:105002274579
T3 - 3rd International Conference on Communication, Control, and Intelligent Systems, CCIS 2024
BT - 3rd International Conference on Communication, Control, and Intelligent Systems, CCIS 2024
A2 - Shukla, Aasheesh
A2 - Gupta, Manish
A2 - Kumar, Manish
A2 - Shrivastava, Shreesh Kumar
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 6 December 2024 through 7 December 2024
ER -