Design and Implementation of a Multi-Modal, Agentic Code Companion System (ICC) using Fine-Tuned Code LLMs and Structured Visualization
Abstract
This paper proposes the architectural design and implementation strategy for the Intelligent Code Companion (ICC) system, a novel platform engineered to process multi- modal code queries (text and image) and generate comprehensive, structured outputs. The core innovation lies in a hybrid LLM Agent architecture that coordinates specialized tools, specifically Optical Character Recognition (OCR) for handling photographed code inputs and a Structured Output Generator for creating dynamic, animated flowcharts. The system deviates from using underpowered base models, advocating instead for the instruction fine- tuning of a high-performing yet resource- efficient model, such as the StarCoder2-3B model, utilizing Quantized Low-rank Adaptation (QLoRA).
Keywords
Large Language Models, Code Generation, Multi-Modality, Optical Character Recognition (OCR), Agentic Systems, Structured Output, QLoRA Fine-Tuning, Full- Stack Architecture, FastAPI, Perplexity UI.
Citations
IRE Journals:
Kunal Kumar Nath, Samridh Chauhan, Tanmay Jadhav, Pranit Virkar "Design and Implementation of a Multi-Modal, Agentic Code Companion System (ICC) using Fine-Tuned Code LLMs and Structured Visualization" Iconic Research And Engineering Journals Volume 9 Issue 5 2025 Page 659-669 https://doi.org/10.64388/IREV9I5-1711930
IEEE:
Kunal Kumar Nath, Samridh Chauhan, Tanmay Jadhav, Pranit Virkar
"Design and Implementation of a Multi-Modal, Agentic Code Companion System (ICC) using Fine-Tuned Code LLMs and Structured Visualization" Iconic Research And Engineering Journals, 9(5) https://doi.org/10.64388/IREV9I5-1711930
About IRE Journals
IRE Journals is an open access online journals established with an aim to publish high quality of research work in various diciplines. We have more than 6 years in publications. Over 2500+ papers already published.
Important Links
For Authors
Volume 8:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 7:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 6:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 5:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 4:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 3:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12