Skip to main navigation Skip to search Skip to main content

Sentiment Analysis Using Transformer Models (BERT, ALBERT, RoBERTa, and DeBERTa) on a SMILE Twitter Dataset

  • Naman Khurana
  • , Vibha Prabhu*
  • *Corresponding author for this work

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    Sentiment analysis is essential for comprehending how people feel about different issues on social media sites. In this work, the effectiveness of utilizing transformer models, specifically BERT, ALBERT, RoBERTa, and DeBERTa, for sentiment analysis on a Twitter dataset. These models perform remarkably well in tasks involving Natural Language Processing because they have been pre-trained on enormous volumes of text data. By fine-tuning these models on a SMILE Twitter dataset, we aim to analyze and classify sentiments expressed in tweets containing various emotions. Through our experiments and evaluations, we demonstrate the capabilities and limitations of each model in accurately capturing sentiment nuances related to various emotions conveyed through tweets on social media. Our findings provide insights into the efficacy of these advanced language models for sentiment analysis tasks, paving the way for improved sentiment analysis techniques in social media monitoring and opinion mining.

    Original languageEnglish
    Title of host publication2024 International Conference on Innovation and Novelty in Engineering and Technology, INNOVA 2024 - Proceedings
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9798331505134
    DOIs
    Publication statusPublished - 2024
    Event2024 IEEE International Conference on Innovation and Novelty in Engineering and Technology, INNOVA 2024 - Hybrid, Vijayapura, India
    Duration: 20-12-202421-12-2024

    Publication series

    Name2024 International Conference on Innovation and Novelty in Engineering and Technology, INNOVA 2024 - Proceedings

    Conference

    Conference2024 IEEE International Conference on Innovation and Novelty in Engineering and Technology, INNOVA 2024
    Country/TerritoryIndia
    CityHybrid, Vijayapura
    Period20-12-2421-12-24

    UN SDGs

    This output contributes to the following UN Sustainable Development Goals (SDGs)

    1. SDG 7 - Affordable and Clean Energy
      SDG 7 Affordable and Clean Energy

    All Science Journal Classification (ASJC) codes

    • Computer Vision and Pattern Recognition
    • Information Systems and Management
    • Renewable Energy, Sustainability and the Environment
    • Safety, Risk, Reliability and Quality
    • Health Informatics
    • Artificial Intelligence
    • Computer Science Applications

    Fingerprint

    Dive into the research topics of 'Sentiment Analysis Using Transformer Models (BERT, ALBERT, RoBERTa, and DeBERTa) on a SMILE Twitter Dataset'. Together they form a unique fingerprint.

    Cite this