Improving BERT Performance for Aspect-Based Sentiment Analysis

Aspect-Based Sentiment Analysis (ABSA) studies the consumer opinion on the market products. It involves examining the type of sentiments as well as sentiment targets expressed in product reviews. Analyzing the language used in a review is a difficult task that requires a deep understanding of the language. In recent years, deep language models, such as BERT \cite{devlin2019bert}, have shown great progress in this regard. In this work, we propose two simple modules called Parallel Aggregation and Hierarchical Aggregation to be utilized on top of BERT for two main ABSA tasks namely Aspect Extraction (AE) and Aspect Sentiment Classification (ASC) in order to improve the model's performance. We show that applying the proposed models eliminates the need for further training of the BERT model. The source code is available on the Web for further research and reproduction of the results.

• Publication year

  2020

• Venue

  International Conference on Natural Language and Speech Processing

• Publication date

  2020-10-22

• Fields of study

  Computer Science

• Identifiers
  arXiv 2010.11731
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Support Vector Machine

  2022cited by this paper
• Adversarial Training for Aspect-Based Sentiment Analysis with BERT

  2020cited by this paper
• A Novel Region of Interest Extraction Layer for Instance Segmentation

  2020cited by this paper
• Modeling Sentiment Dependencies with Graph Convolutional Networks for Aspect-level Sentiment Classification

  2019cited by this paper
• Transfer Learning in Biomedical Natural Language Processing: An Evaluation of BERT and ELMo on Ten Benchmarking Datasets

  2019cited by this paper
• Commonsense Knowledge Mining from Pretrained Models

  2019cited by this paper
• What Does BERT Learn about the Structure of Language?

  2019cited by this paper
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  2019cited by this paper
• Utilizing BERT for Aspect-Based Sentiment Analysis via Constructing Auxiliary Sentence

  2019cited by this paper
• Fine-tune BERT for Extractive Summarization

  2019cited by this paper
• Publicly Available Clinical BERT Embeddings

  2019cited by this paper
• BERT Post-Training for Review Reading Comprehension and Aspect-based Sentiment Analysis

  2019cited by this paper
• Data Augmentation for BERT Fine-Tuning in Open-Domain Question Answering

  2019cited by this paper
• How to Fine-Tune BERT for Text Classification?

  2019cited by this paper
• Learning to combine Grammatical Error Corrections

  2019cited by this paper
• Analyzing the Structure of Attention in a Transformer Language Model

  2019cited by this paper
• Aspect-Based Sentiment Analysis using BERT

  2019cited by this paper
• Exploiting BERT for End-to-End Aspect-based Sentiment Analysis

  2019cited by this paper
• Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction

  2018cited by this paper
• Attention is All you Need

  2017cited by this paper
• Attention-based LSTM for Aspect-level Sentiment Classification

  2016cited by this paper
• SemEval-2016 Task 5: Aspect Based Sentiment Analysis

  2016cited by this paper
• Feature Pyramid Networks for Object Detection

  2016cited by this paper
• Character-level Convolutional Networks for Text Classification

  2015cited by this paper
• Fine-grained Opinion Mining with Recurrent Neural Networks and Word Embeddings

  2015cited by this paper
• Conditional Random Fields as Recurrent Neural Networks

  2015cited by this paper
• SemEval-2014 Task 4: Aspect Based Sentiment Analysis

  2014cited by this paper
• Citius: A Naive-Bayes Strategy for Sentiment Analysis on English Tweets

  2014cited by this paper
• NRC-Canada-2014: Detecting Aspects and Sentiment in Customer Reviews

  2014cited by this paper
• Opinion Mining of Movie Review using Hybrid Method of Support Vector Machine and Particle Swarm Optimization

  2013cited by this paper
• Support vector machine

  2013cited by this paper
• Text Mining for Sentiment Analysis of Twitter Data

  2012cited by this paper
• The Naive Bayes Classifier in Opinion Mining: In Search of the Best Feature Set

  2012cited by this paper
• Induction of decision trees

  2004cited by this paper
• Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data

  2001cited by this paper
• Using Maximum Entropy for Text Classification

  1999cited by this paper
• Pattern classification and scene analysis

  1974cited by this paper
• Information Theory and Statistical Mechanics

  1957cited by this paper

• A Risk Prediction Model for Real Estate Corporations Using High-Target Semantic BERT and Improved GRU

  2025cites this paper
• Aspect-based Sentiment Analysis on Social Graph Data

  2025influential citation
• Aspect based multimodal sentiment analysis of product reviews using deep learning techniques

  2025cites this paper
• Revealing Hidden Sentiments: Implicit Aspectbased Sentiment Analysis Using Bert on Amazon Reviews

  2025cites this paper
• Instruction-tuned ABSA with auxiliary sentences and knowledge-enhanced graphs for implicit aspect detection

  2025cites this paper
• BERT applications in natural language processing: a review

  2025cites this paper
• Enhancing Aspect Based Sentiment Analysis with a Hybrid Model for Hindi Language

  2025cites this paper
• Korean Aspect-Based Sentiment Analysis via Implicit-Feature Alignment with Corpus Filtering

  2024influential citation
• Linguistic features for sentence difficulty prediction in ABSA

  2024cites this paper
• Federated Freeze BERT for text classification

  2024influential citation
• A Sparse Self-Attention Enhanced Model for Aspect-Level Sentiment Classification

  2024cites this paper
• Incorporating syntax and semantics with dual graph neural networks for aspect-level sentiment analysis

  2024cites this paper
• Supervised Gradual Machine Learning for Aspect Category Detection

  2024cites this paper
• Fusion of BERT embeddings and elongation-driven features

  2024cites this paper
• Opinion Mining Using Pre-Trained Large Language Models: Identifying the Type, Polarity, Intensity, Expression, and Source of Private States

  2024cites this paper
• SynPrompt: Syntax-aware Enhanced Prompt Engineering for Aspect-based Sentiment Analysis

  2024cites this paper
• Word- and Sentence-Level Representations for Implicit Aspect Extraction

  2024cites this paper
• Enhancing Aspect Based Sentiment Analysis Using BERT and Capsule Networks

  2024cites this paper
• Which words are important?: an empirical study of Assamese sentiment analysis

  2024cites this paper
• KPC-cF: Aspect-Based Sentiment Analysis via Implicit-Feature Alignment with Corpus Filtering

  2024influential citation
• Aspect-based Sentiment Analysis Techniques: A Comparative Study

  2024cites this paper
• Approaches based on language models for aspect extraction for sentiment analysis in the Portuguese language

  2024cites this paper
• Team_Zero at StanceEval2024: Frozen PLMs for Arabic Stance Detection

  2024cites this paper
• Dopamin: Transformer-based Comment Classifiers through Domain Post-Training and Multi-level Layer Aggregation

  2024cites this paper
• Instruct-DeBERTa: A Hybrid Approach for Aspect-based Sentiment Analysis on Textual Reviews

  2024cites this paper
• Optimizing Aspect Term Extraction and Sentiment Classification through Attention Mechanism and Sparse Attention Techniques

  2024cites this paper
• Rethinking of BERT sentence embedding for text classification

  2024influential citation
• Enhancing aspect-based sentiment analysis using data augmentation based on back-translation

  2024cites this paper
• Sentiment Analysis of Tweets Towards Vaccines via Bidirectional Encoder Representations from Transformers (BERT)

  2024cites this paper
• Sentiment Analysis Using Improved CT-BERT_CONVLayer Fusion Model for COVID-19 Vaccine Recommendation

  2024cites this paper
• LIT: Label-Informed Transformers on Token-Based Classification

  2024cites this paper
• Twitter sentiment analysis using ensemble of multi-channel model based on machine learning and deep learning techniques

  2024cites this paper
• An innovative word embedded and optimization based hybrid artificial intelligence approach for aspect-based sentiment analysis of app and cellphone reviews

  2024cites this paper
• Customer Feedback Analysis using Customer Sentiment from Reviews

  2024cites this paper
• OpinionConv: Conversational Product Search with Grounded Opinions

  2023cites this paper
• How a Deep Contextualized Representation and Attention Mechanism Justifies Explainable Cross-Lingual Sentiment Analysis

  2023cites this paper
• Enhanced local knowledge with proximity values and syntax-clusters for aspect-level sentiment analysis

  2023cites this paper
• Knowledge Acquisition from Student Lecture Reflection Data: Leveraging Large Language Models and Tacit Knowledge

  2023cites this paper
• Multimodal Sentiment Analysis: A Survey of Methods, Trends, and Challenges

  2023cites this paper
• Comparative Analysis on Aspect-based Sentiment using BERT

  2023cites this paper
• A critical empirical evaluation of deep learning models for solving aspect based sentiment analysis

  2023cites this paper
• BERT-PG: a two-branch associative feature gated filtering network for aspect sentiment classification

  2023cites this paper
• A Novel Counterfactual Data Augmentation Method for Aspect-Based Sentiment Analysis

  2023cites this paper
• Generative Methods for Social Media Analysis

  2023cites this paper
• Supervised Gradual Machine Learning for Aspect-Term Sentiment Analysis

  2023influential citation
• Indonesian Journal of Electrical Engineering and Computer Science

  2022cites this paper
• ViMRC - VLSP 2021: Improving Retrospective Reader for Vietnamese Machine Reading Comprehension

  2022cites this paper
• BERT-ASC: Auxiliary-Sentence Construction for Implicit Aspect Learning in Sentiment Analysis

  2022cites this paper
• A Generative Language Model for Few-shot Aspect-Based Sentiment Analysis

  2022cites this paper
• State of the art: a review of sentiment analysis based on sequential transfer learning

  2022influential citation
• CAISA@SMM4H’22: Robust Cross-Lingual Detection of Disease Mentions on Social Media with Adversarial Methods

  2022cites this paper
• Relationship of the language distance to English ability of a country

  2022cites this paper
• BERT-ASC: Implicit Aspect Representation Learning through Auxiliary-Sentence Construction for Sentiment Analysis

  2022influential citation
• Detecting Conspiracy Theory Against COVID-19 Vaccines

  2022cites this paper
• UniParma at SemEval-2021 Task 5: Toxic Spans Detection Using CharacterBERT and Bag-of-Words Model

  2021cites this paper
• Lifelong Machine Learning-Based Quality Analysis for Product Review

  2021cites this paper
• Survey of Generative Methods for Social Media Analysis

  2021cites this paper
• Transformer based Contextual Model for Sentiment Analysis of Customer Reviews: A Fine-tuned BERT

  2021cites this paper
• Human-in-the-Loop Disinformation Detection: Stance, Sentiment, or Something Else?

  2021cites this paper
• Aspect-based Sentiment Analysis using BERT with Disentangled Attention

  2021cites this paper
• Review on Aspect based Sentiment Analysis on Social Data

  2021influential citation
• DNN-driven Gradual Machine Learning for Aspect-term Sentiment Analysis

  2021influential citation
• Few-Shot Aspect Extraction using Prompt Training

  year unknowncites this paper
• KPC-C F: Korean Aspect-Based Sentiment Analysis via Pseudo-Classifier with Corpus Filtering for Low Resource Society

  year unknowncites this paper