ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis
Article
Basiri, Mohammad Ehsan, Nemati, Shahla, Abdar, Moloud, Cambria, Erik and Acharya, U. Rajendra. 2021. "ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis." Future Generation Computer Systems: the international journal of grid computing: theory, methods and applications. 115, pp. 279-294. https://doi.org/10.1016/j.future.2020.08.005
| Article Title | ABCDM: An Attention-based Bidirectional CNN-RNN Deep Model for sentiment analysis |
|---|---|
| ERA Journal ID | 17858 |
| Article Category | Article |
| Authors | Basiri, Mohammad Ehsan, Nemati, Shahla, Abdar, Moloud, Cambria, Erik and Acharya, U. Rajendra |
| Journal Title | Future Generation Computer Systems: the international journal of grid computing: theory, methods and applications |
| Journal Citation | 115, pp. 279-294 |
| Number of Pages | 16 |
| Year | 2021 |
| Publisher | Elsevier |
| ISSN | 0167-739X |
| 1872-7115 | |
| Digital Object Identifier (DOI) | https://doi.org/10.1016/j.future.2020.08.005 |
| Web Address (URL) | https://www.sciencedirect.com/science/article/pii/S0167739X20309195 |
| Abstract | Sentiment analysis has been a hot research topic in natural language processing and data mining fields in the last decade. Recently, deep neural network (DNN) models are being applied to sentiment analysis tasks to obtain promising results. Among various neural architectures applied for sentiment analysis, long short-term memory (LSTM) models and its variants such as gated recurrent unit (GRU) have attracted increasing attention. Although these models are capable of processing sequences of arbitrary length, using them in the feature extraction layer of a DNN makes the feature space high dimensional. Another drawback of such models is that they consider different features equally important. To address these problems, we propose an Attention-based Bidirectional CNN-RNN Deep Model (ABCDM). By utilizing two independent bidirectional LSTM and GRU layers, ABCDM will extract both past and future contexts by considering temporal information flow in both directions. Also, the attention mechanism is applied on the outputs of bidirectional layers of ABCDM to put more or less emphasis on different words. To reduce the dimensionality of features and extract position-invariant local features, ABCDM utilizes convolution and pooling mechanisms. The effectiveness of ABCDM is evaluated on sentiment polarity detection which is the most common and essential task of sentiment analysis. Experiments were conducted on five review and three Twitter datasets. The results of comparing ABCDM with six recently proposed DNNs for sentiment analysis show that ABCDM achieves state-of-the-art results on both long review and short tweet polarity classification. |
| Keywords | Attention mechanism; Sentiment analysis; Deep learning; Convolutional neural network; Long short-term memory |
| ANZSRC Field of Research 2020 | 400306. Computational physiology |
| Public Notes | Files associated with this item cannot be displayed due to copyright restrictions. |
| Byline Affiliations | Shahrekord University, Iran |
| Deakin University | |
| Nanyang Technological University, Singapore | |
| Ngee Ann Polytechnic, Singapore |
Permalink -
https://research.usq.edu.au/item/z1v6w/abcdm-an-attention-based-bidirectional-cnn-rnn-deep-model-for-sentiment-analysis
79
total views0
total downloads2
views this month0
downloads this month