Empirical Evaluation of Learning Curve Cross-Validation for Efficient Model Selection

• Author(s): Dr. M. Pompapathi; N. Siva Parvathi; V. Pavani; S. Varshini; V. Manikanta
• Paper ID: 1715172
• Page: 1243-1251
• Published Date: 17-03-2026
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 9 Issue 9 March-2026

Abstract

Model selection in machine learning is commonly performed using cross-validation, where candidate models are evaluated to estimate their generalization performance. Although reliable, this approach becomes computationally expensive when many models must be evaluated repeatedly on large datasets. Learning Curve Cross-Validation (LCCV) addresses this issue by evaluating models on progressively larger subsets of data and pruning weak candidates early. In this work, we implement the LCCV algorithm and evaluate it on several classification tasks. The implementation estimates performance at different training sizes using repeated cross-validation with confidence intervals. Models are pruned using optimistic learning curve extrapolation, while the Morgan–Mercer–Flodin (MMF) model is used to skip intermediate evaluation points. Experiments on real-world and synthetic datasets compare LCCV with traditional full cross-validation in terms of runtime, model selection agreement, and pruning behavior. Results show that LCCV can prune many candidate models and significantly reduce runtime on larger datasets, while introducing some overhead on smaller datasets.

Keywords

Learning Curve Cross-Validation, Model Selection, Learning Curves, Early Pruning, Cross-Validation

Citations

IRE Journals:
Dr. M. Pompapathi, N. Siva Parvathi, V. Pavani, S. Varshini, V. Manikanta "Empirical Evaluation of Learning Curve Cross-Validation for Efficient Model Selection" Iconic Research And Engineering Journals Volume 9 Issue 9 2026 Page 1243-1251 https://doi.org/10.64388/IREV9I9-1715172

IEEE:
Dr. M. Pompapathi, N. Siva Parvathi, V. Pavani, S. Varshini, V. Manikanta "Empirical Evaluation of Learning Curve Cross-Validation for Efficient Model Selection" Iconic Research And Engineering Journals, 9(9) https://doi.org/10.64388/IREV9I9-1715172