Identifying 'Candidates for University Projects' in Open Source Software

Read full text
Authors: Misan Paul Etchie
Cited by: 0

Abstract

This repository contains the complete code, data, and results for reproducing the experiments described in the paper "Identifying 'Candidates for University Projects' in Open Source Software". The work presents a machine learning approach to automatically identify GitHub issues suitable for university student projects. We compare Random Forest classifiers with Large Language Model (LLM) baselines for both binary classification (CUP vs. NOT CUP) and multi-label property prediction (implementation effort, testing effort, issue understanding effort, main focus, and size of project). The repository includes: - Complete Python codebase (29 scripts) for data processing, model training, and evaluation - Pre-processed datasets: 3,295 GitHub issues from JabRef (53 labeled as Candidates for University Projects) - Trained Random Forest models for property prediction - All experimental results matching the paper's tables (Tables 1-8) - Comprehensive documentation for reproducibility Key Results: - Random Forest achieved 45% recall (5/11) at K=20 for binary classification - Maintainer review confirmed 13/25 new candidate issues identified by the model - Property prediction achieved F1-scores ranging from 0.022 (Labels) to 0.395 (Size of project) using cosine similarity - LLM baseline showed limited effectiveness (recall: 0.091-0.182) compared to supervised learning All results are fully reproducible with the provided code and data.

Fields of Study & Subjects

Software Engineering Research Open Source Software Innovations Software Engineering Techniques and Practices

Publication details

Journal / source
Zenodo (CERN European Organization for Nuclear Research)
Publication date
7 February 2026