Current Volume 9
HackEval: An Intelligent Multi-Agent Framework for Automated, Bias- Mitigated Assessment in Competitive Hackathon Ecosystems
Abstract
Contemporary hackathon adjudication is burdened by four structural deficiencies inherent to human- centric evaluation: inconsistent rubric application, substantial inter-rater score variance, prohibitive assessment latency, and a near-total absence of granular, actionable post-event diagnostic feedback. This paper introduces HackEval, a production-grade multi-agent artificial intelligence framework designed to systematica ly resolve these limitations through real-time, bias-mitigated evaluation across heterogeneous project submission modalities. Six functionally specialized agents operate in parallel: (i) a Code Quality Agent performing deep multi- criterion static analysis on GitHub repositories; (ii) a Presentation Analyzer Agent realizing a four-stage pipeline integrating LLM semantic reasoning with contrastive vision-language embeddings; (iii) a UI/UX Evaluation Agent leveraging CLIP-based aesthetic regression [13]; (iv) an Innovation Agent quantifying originality via semantic embedding distance; (v) a Fea sibility Agent applying chain-of-thought LLM reasoning [12]; and (vi) a Plagiarism Detection Agent employing sentence- transformer cosine similarity with FAISS indexing [15]. Empirical evaluation across 27 authentic hackathon submissions yields a Pearson correlation of r = 0.93 between AI composite scores and consensus expert evaluations, a 92.8% reduction in per-team evaluation time, and a 77.4% improvement in cross-evaluator scoring consistency. The platform is delivered as a multi-tenant Software-as-a-Service system built on a MERN + FastAPI + LangChain stack, demonstrating concurrent scalability exceeding 500 simultaneous teams with sub-10-second feedback delivery.
Keywords
Automated Code Assessment, Bias Reduction Mechanisms; Competitive Hackathon Evaluation; Large Language Model Scoring; Multi-Agent AI Systems; Real-Time Feedback Systems; Saa S Architecture; Semantic Embeddings; Static Code Analysis; Vision-Language Models.
Citations
IRE Journals:
Rishabh Tripathi, Sanskrati Agrawal "HackEval: An Intelligent Multi-Agent Framework for Automated, Bias- Mitigated Assessment in Competitive Hackathon Ecosystems" Iconic Research And Engineering Journals Volume 9 Issue 11 2026 Page 3338-3346 https://doi.org/10.64388/IREV9I11-1718010
IEEE:
Rishabh Tripathi, Sanskrati Agrawal
"HackEval: An Intelligent Multi-Agent Framework for Automated, Bias- Mitigated Assessment in Competitive Hackathon Ecosystems" Iconic Research And Engineering Journals, 9(11) https://doi.org/10.64388/IREV9I11-1718010
About IRE Journals
IRE Journals is an open access online journals established with an aim to publish high quality of research work in various diciplines. We have more than 6 years in publications. Over 2500+ papers already published.
Important Links
For Authors
Volume 8:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 7:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 6:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 5:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 4:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 3:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12