Quantitative Evaluations of the PPP RAG Tool

This dataset provides two quantitative evaluations of the European Peatland Policy Portal's RAG tool. First, 58 question-groundtruth pairs were created, spanning 4 question types (Targets/Numeric, Dates, Purpose/Definition, and Location) concerning peatland policy, then: In PeatRAG_RAGAS_Results.xlsx, the RAGAS (Retrieval Augmented Generation Assessment) framework was applied to evaluate the model's context precision (is the retrieved evidence relevant) and citation precision (is the generated information actually in the source provided). In ZeroShot_vs_RAG_Results.xlsx, the outputs of the RAG model were compared to those of a non-RAG LLM.