Home / Current Issue / Paper 1713456
Transformer-Based Emotional State Classification in Poetic Texts
Subject area: Science,Engineering and Technology · Area of research: Natural Language Processing
DOI: https://doi.org/10.64388/IREV9I7-1713456
Abstract
While emotion recognition is a core task of NLP, its application to poetry is hindered by the heavy use of metaphors and irregular structures that bypass simple keyword-based detection. This paper details a deep learning approach using a fine-tuned BERT encoder to classify emotions in English poetry across nine categories, including Love, Joy, Courage, and Sadness. Our methodology utilizes deep contextual embeddings and standard regularization to ensure high performance and model stability. Empirical testing demonstrates the model?s effectiveness, reaching an accuracy of 89.75% and a weighted F1-score of 89.72%. The findings suggest that transformer models are exceptionally well-suited for decoding the complex affective signals found in literature. We conclude by addressing limitations regarding overlapping emotional states and proposing next steps for intensity-aware and cross-lingual emotion detection.
Keywords
Poetry Emotion Classification, BERT, Transformer Models, Semantic Embeddings, Deep Learning, Natural Language Processing, Affective Computing.
References
[1] B. Pang and L. Lee, “Opinion mining and sentiment analysis,” Foundations and Trends in Information Retrieval, vol. 2, no. 1–2, pp. 1–135, 2008.
[2] B. Liu, Sentiment Analysis and Opinion Mining.Morgan & Claypool, 2012.
[3] P. Ekman, “An argument for basic emotions,” Cognition & Emotion, vol. 6, no. 3–4, pp. 169–200, 1992.
[4] R. Plutchik, “The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice,” American Scientist, vol. 89, no. 4, pp. 344–350, 2001.
[5] J. Pennington, R. Socher, and C. Manning, “GloVe: Global vectors for word representation,” in Proc. EMNLP, 2014.
[6] M. E. Peters et al., “Deep contextualized word representations,” in Proc. NAACL-HLT, 2018.
[7] J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Proc. NAACL-HLT, 2019.
[8] A. Vaswani et al., “Attention is all you need,” in Advances in Neural Information Processing Systems (NeurIPS), 2017.
[9] T. Wolf et al., “Transformers: State-of-the-art natural language processing,” in Proc. EMNLP: System Demonstrations, 2020.
[10] S. Mohammad and P. Turney, “Crowdsourcing a word–emotion association lexicon,” Computational Intelligence, vol. 29, no. 3, pp. 436–465, 2013.
[11] Strapparava and R. Mihalcea, “Semeval-2007 task 14: Affective text,” in Proc. SemEval, 2007.
[12] A. M. Jacobs, “Towards a neurocognitive poetics model of literary reading,” in Towards a Cognitive NeuroScience of Natural Language, 2015.
[13] J. T. Kao and D. Jurafsky, “A computational analysis of poetic style: Imagery and sound in contemporary poetry,” in Proc. ACL, 2014.
[14] Demszky et al., “GoEmotions: A dataset of fine-grained emotions,” in Proc. ACL, 2020.
[15] Y. Liu et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv preprint arXiv:1907.11692, 2019.
[16] Z. Lan et al., “ALBERT: A lite BERT for self-supervised learning of language representations,” arXiv preprint arXiv:1909.11942, 2019.
[17] Loshchilov and F. Hutter, “Decoupled weight decay regularization,” in Proc. ICLR, 2019.
[18] A. Conneau et al., “Unsupervised cross-lingual representation learning at scale,” in Proc. ACL, 2020.
How to cite this paper
@article{1713456,
author = {Ayush S, Harshith Raj Gowda H S, Vinay M G},
title = {Transformer-Based Emotional State Classification in Poetic Texts},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {9},
number = {7},
pages = {438-444},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1713456.pdf},
abstract = {While emotion recognition is a core task of NLP, its application to poetry is hindered by the heavy use of metaphors and irregular structures that bypass simple keyword-based detection. This paper details a deep learning approach using a fine-tuned BERT encoder to classify emotions in English poetry across nine categories, including Love, Joy, Courage, and Sadness. Our methodology utilizes deep contextual embeddings and standard regularization to ensure high performance and model stability. Empirical testing demonstrates the model?s effectiveness, reaching an accuracy of 89.75% and a weighted F1-score of 89.72%. The findings suggest that transformer models are exceptionally well-suited for decoding the complex affective signals found in literature. We conclude by addressing limitations regarding overlapping emotional states and proposing next steps for intensity-aware and cross-lingual emotion detection.},
keywords = {Poetry Emotion Classification, BERT, Transformer Models, Semantic Embeddings, Deep Learning, Natural Language Processing, Affective Computing.},
month = {January},
doi = {https://doi.org/10.64388/IREV9I7-1713456}
}