Conceptual Framework for Designing Domain-Specific LLM-Based Information Systems

Retrieval-augmented generation (RAG) based on large language models (LLMs) has established itself as a key technology for combining domain-specific information with generative language skills, thereby providing transparent, up-to-date information. Many firms are already piloting such LLM-based information systems, but report a high degree of complexity in planning and implementation. A generally accepted regulatory framework that consistently maps key decisions is not yet available to companies. This article therefore presents a multi-level system that organizes design decisions throughout the configuration process. This framework is intended to support users in the planning, realizing, evaluation, and further development of an LLM-based information system. To achieve this goal, a qualitative-empirical research design was chosen. First, publications from the period 2022 to 2025 were identified and selected using a systematic literature search in accordance with the PRISMA guideline. The selected publications were then evaluated using a qualitative content analysis. The result is a system that was reviewed, revised and finalized at an expert workshop.