International Peer-Reviewed JournalOpen AccessISSN 2456-8880
irejournals@gmail.com+91-7433024337

Home / Current Issue / Paper 1703797

1703797 Vol 6 · Issue 3 Download Paper

Prompt Engineering in Supply Chain Enterprise Data

Venkat Sharma Gaddala

Subject area: Science,Engineering and Technology  ·  Area of research: Enterprise Data

Abstract

Deep generation models, including GPT-4, can generate more efficient knowledge extraction from the text than conventional models. They are semantically flexible and powerful, but such flexibility hampers generating accurate, task-specific results that should be needed for a particular task; this is why precise, prompt engineering is necessary. This work assesses different prompt engineering strategies for proficient knowledge pulling using GPT-4 and the relation extraction dataset (RED-FM). , A new framework based on Wikidata ontology has been proposed to address the evaluation issue. The outcomes shown here indicate that the LLMs can extract an immense variety of facts from text. Using at least one example related to the prompt boosts performance by two to three times; performance with highly related examples is much better than that of random or conventional examples. Yet if more than one example is given, this results in a lesser effect the more examples are used. Surprisingly, reasoning-based prompting methods fail to beat non-reasoning strategies, which means that KE does not necessarily correlate with reasoning tasks in LLMs. On the other hand, retrieval-augmented prompts' results are very good, and combined with the other methods, they help improve the information retrieval process. Knowledge extraction is, therefore, not a problem when it comes to LLMs, but framing the process as a reasoning-based endeavor may not be effective. Well-designed prompts, particularly those with examples, enable the LLM potential in knowledge acquisition.

Keywords

Prompt engineering, Generative Knowledge Extraction, Ontology based evaluation, GPT-4, Wikidata, Process Model Comprehension, Business Process Management, Large Language Models, Generative AI.

References

[1] M. von Rosing, S. White, F. Cummins, H. de Man, Business process model and notation - BPMN, in: M. von Rosing, H. von Scheel, A. Scheer (Eds.), The Complete Business Process Handbook: Body of Knowledge from Process Modeling to BPM, Volume I, Morgan Kaufmann/Elsevier, 2015, pp. 429–453. doi:10.1016/B978-0-12-799959-3.00021-5.

[2] M. zur Muehlen, J. Recker, How much language is enough? theoretical and practical use of the business process modeling notation, in: J. A. B. Jr., J. Krogstie, O. Pastor, B. Pernici, C. Rolland, A. Sølvberg (Eds.), Seminal Contributions to Information Systems Engineering, 25 Years of CAiSE, Springer, 2013, pp. 429–443. doi:10.1007/978-3-642-36926-1\_35.

[3] A. Polyvyanyy, Business process querying, in: S. Sakr, A. Y. Zomaya (Eds.), Encyclopedia of Big Data Technologies, Springer, 2019. doi:10.1007/ 978-3-319-63962-8\_108-1.

[4] D. Zeng, K. Liu, S. Lai, G. Zhou and J. Zhao, Relation Classification via Convolutional Deep Neural Network, in: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, J. Tsujii and J. Hajic, eds, Dublin City University and Association for Computational Linguistics, Dublin, Ireland, 2014, pp. 2335–2344. https://aclanthology.org/C14-1220.

[5] F. Petroni, T. Rocktäschel, S. Riedel, P. Lewis, A. Bakhtin, Y. Wu and A. Miller, Language Models as Knowledge Bases?, in: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), K. Inui, J. Jiang, V. Ng and X. Wan, eds, Association for Computational Linguistics, Hong Kong, China, 2019, pp. 2463–2473. doi:10.18653/v1/D19-1250. https://aclanthology.org/D19-1250.

[6] Polat, F., a, Tiddi, I., Groth, P., Intelligent Data Engineering Lab (INDElab), Informatics Institute, University of Amsterdam, The Netherlands, & Artificial Intelligence, Faculty of Science, Vrije Universiteit Amsterdam, The Netherlands. (n.d.). Testing Prompt Engineering Methods for Knowledge Extraction from Text [Journal-article]. https://www.semantic-web-journal.net/system/files/swj3606.pdf

[7] [Wu et al., 2022] Tongshuang Wu, Ellen Jiang, Aaron Donsbach, Jeff Gray, Alejandra Molina, Michael Terry, and Carrie J Cai. Promptchainer: Chaining large language model prompts through visual programming. In CHI Conference on Human Factors in Computing Systems Extended Abstracts, pages 1–10, 2022.

[8] [Wei et al., 2022] Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35:24824–24837, 2022.

[9] [Sun et al., 2022] Jiao Sun, Q Vera Liao, Michael Muller, Mayank Agarwal, Stephanie Houde, Kartik Talamadupula, and Justin D Weisz. Investigating explainability of generative ai for code through scenario-based design. In 27th International Conference on Intelligent User Interfaces, pages 212–228, 2022.

[10] Rahman, M.A., Butcher, C. & Chen, Z. Void evolution and coalescence in porous ductile materials in simple shear. Int J Fract 177, 129–139 (2012). https://doi.org/10.1007/s10704-012-9759-2

[11] Bhadani, U. A Detailed Survey of Radio Frequency Identification (RFID) Technology: Current Trends and Future Directions.

[12] Bhadani, U. (2022). Comprehensive Survey of Threats, Cyberattacks, and Enhanced Countermeasures in RFID Technology. International Journal of Innovative Research in Science, Engineering and Technology, 11(2).

[13] Bhadani, U. (2020). Hybrid Cloud: The New Generation of Indian Education Society.

[14] Rahman, M. A. (2012). Influence of simple shear and void clustering on void coalescence. University of New Brunswick, NB, Canada. https://unbscholar.lib.unb.ca/items/659cc6b8-bee6-4c20-a801-1d854e67ec48

[15] Nasr Esfahani, M. (2023). Breaking language barriers: How multilingualism can address gender disparities in US STEM fields. International Journal of All Research Education and Scientific Methods, 11(08), 2090-2100. https://doi.org/10.56025/IJARESM.2024.1108232090

How to cite this paper

Venkat Sharma Gaddala "Prompt Engineering in Supply Chain Enterprise Data" Iconic Research And Engineering Journals Volume 6 Issue 3 2022 Page 213-224
Venkat Sharma Gaddala "Prompt Engineering in Supply Chain Enterprise Data" Iconic Research And Engineering Journals, vol. 6, no. 3, Sep. 2022
Venkat Sharma Gaddala (2022). Prompt Engineering in Supply Chain Enterprise Data. Iconic Research And Engineering Journals, 6(3).
Venkat Sharma Gaddala "Prompt Engineering in Supply Chain Enterprise Data" Iconic Research And Engineering Journals, vol. 6, no. 3, Sep. 2022.
@article{1703797,
      author = {Venkat Sharma Gaddala},
      title = {Prompt Engineering in Supply Chain Enterprise Data},
      journal = {Iconic Research And Engineering Journals},
      year = {2022},
      volume = {6},
      number = {3},
      pages = {213-224},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/17037971.pdf},
      abstract = {Deep generation models, including GPT-4, can generate more efficient knowledge extraction from the text than conventional models. They are semantically flexible and powerful, but such flexibility hampers generating accurate, task-specific results that should be needed for a particular task; this is why precise, prompt engineering is necessary. This work assesses different prompt engineering strategies for proficient knowledge pulling using GPT-4 and the relation extraction dataset (RED-FM). , A new framework based on Wikidata ontology has been proposed to address the evaluation issue.
The outcomes shown here indicate that the LLMs can extract an immense variety of facts from text. Using at least one example related to the prompt boosts performance by two to three times; performance with highly related examples is much better than that of random or conventional examples. Yet if more than one example is given, this results in a lesser effect the more examples are used.
Surprisingly, reasoning-based prompting methods fail to beat non-reasoning strategies, which means that KE does not necessarily correlate with reasoning tasks in LLMs. On the other hand, retrieval-augmented prompts' results are very good, and combined with the other methods, they help improve the information retrieval process.
Knowledge extraction is, therefore, not a problem when it comes to LLMs, but framing the process as a reasoning-based endeavor may not be effective. Well-designed prompts, particularly those with examples, enable the LLM potential in knowledge acquisition.},
      keywords = {Prompt engineering, Generative Knowledge Extraction, Ontology based evaluation, GPT-4, Wikidata, Process Model Comprehension, Business Process Management, Large Language Models, Generative AI.},
      month = {September},
  }