International Peer-Reviewed JournalOpen AccessISSN 2456-8880
irejournals@gmail.com+91-7433024337

Home / Current Issue / Paper 1713456

1713456 Vol 9 · Issue 7 Download Paper

Transformer-Based Emotional State Classification in Poetic Texts

Ayush S Harshith Raj Gowda H S Vinay M G

Subject area: Science,Engineering and Technology  ·  Area of research: Natural Language Processing

DOI: https://doi.org/10.64388/IREV9I7-1713456

Abstract

While emotion recognition is a core task of NLP, its application to poetry is hindered by the heavy use of metaphors and irregular structures that bypass simple keyword-based detection. This paper details a deep learning approach using a fine-tuned BERT encoder to classify emotions in English poetry across nine categories, including Love, Joy, Courage, and Sadness. Our methodology utilizes deep contextual embeddings and standard regularization to ensure high performance and model stability. Empirical testing demonstrates the model?s effectiveness, reaching an accuracy of 89.75% and a weighted F1-score of 89.72%. The findings suggest that transformer models are exceptionally well-suited for decoding the complex affective signals found in literature. We conclude by addressing limitations regarding overlapping emotional states and proposing next steps for intensity-aware and cross-lingual emotion detection.

Keywords

Poetry Emotion Classification, BERT, Transformer Models, Semantic Embeddings, Deep Learning, Natural Language Processing, Affective Computing.

References

[1] B. Pang and L. Lee, “Opinion mining and sentiment analysis,” Foundations and Trends in Information Retrieval, vol. 2, no. 1–2, pp. 1–135, 2008.

[2] B. Liu, Sentiment Analysis and Opinion Mining.Morgan & Claypool, 2012.

[3] P. Ekman, “An argument for basic emotions,” Cognition & Emotion, vol. 6, no. 3–4, pp. 169–200, 1992.

[4] R. Plutchik, “The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice,” American Scientist, vol. 89, no. 4, pp. 344–350, 2001.

[5] J. Pennington, R. Socher, and C. Manning, “GloVe: Global vectors for word representation,” in Proc. EMNLP, 2014.

[6] M. E. Peters et al., “Deep contextualized word representations,” in Proc. NAACL-HLT, 2018.

[7] J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Proc. NAACL-HLT, 2019.

[8] A. Vaswani et al., “Attention is all you need,” in Advances in Neural Information Processing Systems (NeurIPS), 2017.

[9] T. Wolf et al., “Transformers: State-of-the-art natural language processing,” in Proc. EMNLP: System Demonstrations, 2020.

[10] S. Mohammad and P. Turney, “Crowdsourcing a word–emotion association lexicon,” Computational Intelligence, vol. 29, no. 3, pp. 436–465, 2013.

[11] Strapparava and R. Mihalcea, “Semeval-2007 task 14: Affective text,” in Proc. SemEval, 2007.

[12] A. M. Jacobs, “Towards a neurocognitive poetics model of literary reading,” in Towards a Cognitive NeuroScience of Natural Language, 2015.

[13] J. T. Kao and D. Jurafsky, “A computational analysis of poetic style: Imagery and sound in contemporary poetry,” in Proc. ACL, 2014.

[14] Demszky et al., “GoEmotions: A dataset of fine-grained emotions,” in Proc. ACL, 2020.

[15] Y. Liu et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv preprint arXiv:1907.11692, 2019.

[16] Z. Lan et al., “ALBERT: A lite BERT for self-supervised learning of language representations,” arXiv preprint arXiv:1909.11942, 2019.

[17] Loshchilov and F. Hutter, “Decoupled weight decay regularization,” in Proc. ICLR, 2019.

[18] A. Conneau et al., “Unsupervised cross-lingual representation learning at scale,” in Proc. ACL, 2020.

How to cite this paper

Ayush S, Harshith Raj Gowda H S, Vinay M G "Transformer-Based Emotional State Classification in Poetic Texts" Iconic Research And Engineering Journals Volume 9 Issue 7 2026 Page 438-444 https://doi.org/10.64388/IREV9I7-1713456
Ayush S, Harshith Raj Gowda H S, Vinay M G "Transformer-Based Emotional State Classification in Poetic Texts" Iconic Research And Engineering Journals, vol. 9, no. 7, Jan. 2026, doi: https://doi.org/10.64388/IREV9I7-1713456
Ayush S, Harshith Raj Gowda H S, Vinay M G (2026). Transformer-Based Emotional State Classification in Poetic Texts. Iconic Research And Engineering Journals, 9(7). doi: https://doi.org/10.64388/IREV9I7-1713456
Ayush S, Harshith Raj Gowda H S, Vinay M G "Transformer-Based Emotional State Classification in Poetic Texts" Iconic Research And Engineering Journals, vol. 9, no. 7, Jan. 2026. Crossref, https://doi.org/10.64388/IREV9I7-1713456
@article{1713456,
      author = {Ayush S, Harshith Raj Gowda H S, Vinay M G},
      title = {Transformer-Based Emotional State Classification in Poetic Texts},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {9},
      number = {7},
      pages = {438-444},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1713456.pdf},
      abstract = {While emotion recognition is a core task of NLP, its application to poetry is hindered by the heavy use of metaphors and irregular structures that bypass simple keyword-based detection. This paper details a deep learning approach using a fine-tuned BERT encoder to classify emotions in English poetry across nine categories, including Love, Joy, Courage, and Sadness. Our methodology utilizes deep contextual embeddings and standard regularization to ensure high performance and model stability. Empirical testing demonstrates the model?s effectiveness, reaching an accuracy of 89.75% and a weighted F1-score of 89.72%. The findings suggest that transformer models are exceptionally well-suited for decoding the complex affective signals found in literature. We conclude by addressing limitations regarding overlapping emotional states and proposing next steps for intensity-aware and cross-lingual emotion detection.},
      keywords = {Poetry Emotion Classification, BERT, Transformer Models, Semantic Embeddings, Deep Learning, Natural Language Processing, Affective Computing.},
      month = {January},
      doi = {https://doi.org/10.64388/IREV9I7-1713456}
  }