An Empirical Study of LLM-Assisted PHP Version Migration in WordPress

Project Overview This repository contains the pipeline, outputs, and analysis for the PHP 8.3 migration study. Use the sections below to navigate the code, prompts, tests, and results. Directory Map .├── PHP_Migration/│ ├── LLM_eval/│ ├── LLM_Migration/│ ├── UnitTest/│ ├── dataset/│ └── run_full_evaluation.ps1├── results_summary/│ ├── extra/│ ├── quadrant_results/│ ├── rectorPhpc/│ ├── runtime/│ └── validation_reports/├── prompts.py├── OriginalTestResults.txt└── README.md Key Entry Points Results summaries and tables: results_summary/ File-scoped contract tests, 100-file harness: PHP_Migration/UnitTest/wordPress/ Prompt templates: prompts.py File-scoped original baseline checklist: OriginalTestResults.txt Model-specific testdox outputs: results_summary/runtime/results/ File-Scoped Checklists OriginalTestResults.txt contains the original-file runtime results for the file-scoped contract checks. Each item represents one behavioral contract check executed against the original WordPress file. [x] indicates that the check passed. A blank or null entry indicates that the check failed. These original outcomes serve as the behavioral baseline for comparing LLM-migrated files. File-Scoped Contract Tests Test suite source: PHP_Migration/UnitTest/wordPress/tests Test files: PHP_Migration/UnitTest/wordPress/tests/files Model-specific testdox outputs: results_summary/runtime/results/ Aggregated per-file outcomes: results_summary/runtime/analysis/per_file.csv Overall runtime summary: results_summary/runtime/analysis/summary.csv Runtime Analysis Files Failure breakdown: results_summary/runtime/analysis/failure_breakdown.md Failure classification: results_summary/runtime/analysis/failure_classification.csv Aggregated per-file outcomes: results_summary/runtime/analysis/per_file.csv Overall runtime summary: results_summary/runtime/analysis/summary.csv Runtime summary report: results_summary/runtime/analysis/summary.md Individual test outcomes: results_summary/runtime/analysis/test_outcomes.csv Transition breakdown: results_summary/runtime/analysis/transition_breakdown.md Outputs by Layer Rector and PHPCompatibility static analysis: results_summary/rectorPhpc/ Runtime and contract outcomes: results_summary/runtime/ Structural and syntax preservation diagnostics: results_summary/validation_reports/