Supplementary material for evaluating CLower (RQ4, Table 5)

### Supplementary Instructions for SPEC CPU 2017 (RQ4, Table 5) Due to licensing restrictions, we are unable to distribute the SPEC CPU 2017 source code or binaries publicly. However, for the purpose of artifact evaluation, we provide a copy of the **SPEC CPU 2017 ISO** (version 1.0.5) to the reviewers. Please follow the steps below to set up and run the experiment inside your existing Docker container. #### Step 1: Copy Files into the Docker Container First, copy the SPEC CPU 2017 ISO and our configuration file into the container: ```bash # On your host machine docker cp :/resource/cpu2017.iso docker cp :/resource/gcc.cfg # Example: docker cp cpu2017.iso 2f019847ace2:/resource/cpu2017.iso docker cp gcc.cfg 2f019847ace2:/resource/gcc.cfg ``` Then access the container: ```bash docker exec -it /bin/bash ``` #### Step 2: Mount ISO and Install SPEC CPU 2017 Inside the container, extract the ISO and install SPEC: ```bash cd /resource mkdir -p /resource/cpu2017_iso mount -o loop /resource/cpu2017.iso /resource/cpu2017_iso cd /resource/cpu2017_iso ./install.sh -d /resource/spec2017 -f ``` The `-f` flag forces installation even if directories already exist. After installation, you can unmount the ISO: ```bash cd / umount /resource/cpu2017_iso ``` #### Step 3: Apply Our Configuration Copy our provided GCC configuration file into the SPEC config directory: ```bash cd /resource/spec2017/config cp /resource/gcc.cfg gcc.cfg ``` #### Step 4: Build the SPEC Benchmarks Navigate to the SPEC directory, source the environment, and build all benchmarks using our configuration: ```bash cd /resource/spec2017 source shrc runcpu --config=gcc.cfg --action=build all ``` This will compile all SPEC CPU 2017 benchmarks with the settings used in our study. The build process may take some time depending on your system. #### Step 5: Run the Analysis Script Once the benchmarks are built, you can run our script to reproduce the bug counts reported in **Table 5** (the “CPU2017” column): ```bash cd /root/artifact/rq4 python3 checkcpu2017.py /resource/spec2017/ ``` You should see output similar to: ``` 26 executables in all {: 3456, : 51, : 38} ``` #### Notes - The ISO is provided **solely for evaluation purposes** and must not be redistributed. - If you encounter any build issues, ensure that all required system dependencies (e.g., `gcc`, `g++`, `make`) are installed inside the container. - The script `checkcpu2017.py` scans the built binaries and reports the counts of detected bug types. Thank you for your time and effort in evaluating our artifact!