Cross-Cultural Validity of School-Level Environmental Questionnaires (SLEQs): A Systematic Review and Exploratory Meta-Analysis with a Special Focus on Alternative Education"

Read full text
Authors: Randi Nikanor Niuflapu, Ruslina Irianty, Aditya Wibowo
Cited by: 0

Abstract

DETAILED PROJECT DESCRIPTION: SLEQ Cross-Cultural Validity Study 1. PROJECT OVERVIEW & RATIONALE Why This Research Matters The School-Level Environment Questionnaire (SLEQ) is the most widely used instrument globally for measuring school climate—the perceptions and norms within an educational institution that collectively define the teaching and learning experience. For nearly 50 years (since Moos' original 1979 instrument), SLEQ has been considered the gold standard for assessing workplace climate in educational settings. However, a critical blind spot exists: the overwhelming majority of validation research has been conducted in formal educational institutions in developed, Western countries, predominantly North America and Western Europe. This creates an epistemic gap—a gap in legitimate knowledge about whether this instrument is valid, appropriate, or even meaningful in diverse educational contexts, particularly in: Alternative/non-formal education (community learning centers, PKBM in Indonesia, flexible learning models) Resource-constrained schools in developing regions (3T areas: Border, Outermost, Disadvantaged) Collectivist cultural contexts where education operates under different social logics than Western individualism Most critically, our preliminary search revealed that zero studies exist examining SLEQ validity in alternative education contexts, despite millions of students worldwide attending non-formal education programs. The Core Problem When researchers, policymakers, and school administrators apply SLEQ to marginalized educational settings without prior validation, they risk: Measurement bias—The instrument may not accurately capture "climate" in contexts where physical facilities are minimal or learning occurs in community spaces rather than buildings Ontological misalignment—What "school climate" means may fundamentally differ when schools lack walls, fixed timetables, or formal hierarchy Perpetuating epistemic injustice—By excluding marginalized educators from the evidence base, we implicitly delegitimize their knowledge and experiences Policy misapplication—Policymakers may implement climate interventions designed for resource -rich schools in resource-poor contexts where completely different barriers exist This research directly addresses these gaps. 2. PRIMARY PURPOSE & OBJECTIVES Main Purpose To systematically evaluate the cross-cultural validity, adaptability, and applicability of the School-Level Environment Questionnaire (SLEQ) instrument across diverse educational contexts, with special emphasis on: Non-Western, collectivist educational systems (particularly Asia) Resource-constrained and marginalized school environments Alternative/non-formal education sectors that have been systematically excluded from SLEQ validation literature Three Coordinated Objectives Objective 1: Evaluate Cross-Cultural Validity & Adaptability Assess whether SLEQ maintains valid psychometric properties across different cultural, economic, and educational contexts Identify which SLEQ dimensions are universal invariants (culturally robust) vs. context-sensitive dimensions (requiring adaptation) Document systematic adaptation patterns used by researchers in different regions Answer: To what extent does the global literature reveal systemic biases favoring formal, developed-country institutions? Objective 2: Conduct Meta-Analysis of Climate-Efficacy Relationship Synthesize quantitative evidence about the relationship between school climate (SLEQ) and teacher self-efficacy Provide precise effect size estimates (with confidence intervals) from multiple independent studies Explore sources of heterogeneity (variability in effect sizes across studies) Answer: What is the empirical evidence for the causal/correlational link between climate and teacher psychology? Objective 3: Identify & Map Representation Gaps Systematically document which educational contexts, regions, and populations are missing from SLEQ validation literature Explicitly map the alternative education void (0 studies) and other geographic/contextual gaps Use gap analysis to generate a research roadmap for future validation priorities Answer: Which populations' voices and experiences are systematically excluded from educational measurement science? Expected Outcomes Primary Deliverables Peer-Reviewed Systematic Review Publication Manuscript in high-impact international education journal PRISMA 2020 protocol compliance Thorough documentation of search, selection, quality assessment procedures Synthesis addressing all three research questions Timeline: 2026 Integrated Meta-Analysis Report Quantitative synthesis of school climate-teacher self-efficacy relationship Forest plots, heterogeneity statistics, publication bias assessment Subgroup analysis exploring contextual moderators Transparent statistical procedures documented Research Roadmap for Geographic Expansion Priority list for future validation studies in underrepresented regions Specific recommendations for alternative education sector research Methodological blueprint for culturally-sensitive instrument adaptation Secondary Deliverables Policy Brief Evidence-based recommendations for educational policymakers Guidance on using SLEQ as advocacy tool in resource-constrained settings Distinction between "hard constraints" (policy-level barriers) vs. "soft constraints" (management-level interventions) Risk assessment: Sustainability trap of relying solely on social support without structural improvements Instrument Adaptation Framework Strategic hybridity approach for developing SLEQ variants for alternative education Decision tree for which original dimensions to retain vs. adapt Guidance on injecting indigenous dimensions while maintaining global comparability Data Repository Open Science Framework (OSF) repository with searchable data extraction matrices PRISMA 2020 checklist and quality assessment spreadsheets Reusable coding codebook for future meta-syntheses 3. THEORETICAL FOUNDATIONS Three Integrated Theoretical Lenses This project moves beyond relying on a single theoretical framework (as Moos' original Social-Ecological Model did) to use an integrated, equity-centered framework that accounts for context complexity: Lens 1: Social-Ecological Model (Moos, 1980)—The Micro Foundation Principle: School climate is multidimensional, measurable, and influences human behavior. Key Elements: Relationship dimensions (student support, collegiality)—how supportive social interactions are Personal Growth dimensions (professional development, autonomy)—whether the environment enables development System Maintenance dimensions (order/organization, decision-making)—whether the environment is predictable and governed Application in this study: Provides the structural lens for analyzing which dimensions remain valid across contexts Helps distinguish between dimensions that are culturally universal (relationships) vs. culturally specific (autonomy) Limitation acknowledged: Moos' model was developed for formal, resource-adequate schools; it may not apply to contexts where basic survival needs aren't met. Lens 2: Ecological Systems Theory (Bronfenbrenner/Özdoğru, 2011) - The Macro Foundation Principle: Individual outcomes (teacher efficacy) are shaped by nested environmental systems, not just the immediate school setting. System Levels: Microsystem: Immediate school environment (SLEQ measures this level) Mesosystem: Connections between school and home/community Exosystem: Broader systems teacher doesn't directly control (regional policy, funding, infrastructure investment) Macrosystem: Societal values, cultural norms, economic systems Chronosystem: Historical changes over time (pre/post-pandemic shifts) Application in this study: Explains WHY the same SLEQ score means different things in different contexts In resource-constrained settings, exosystem barriers (underfunding, infrastructure neglect) dwarf microsystem climate interventions Provides theoretical justification for "hard constraints" (policy-level) vs. "soft constraints" (school-management-level) intervention framework Critical insight: You cannot isolate "school climate" from its broader economic and policy context. Lens 3: Social Capital Theory (Bourdieu, 2011) - The Equity Lens Principle: Societies distribute different types of capital (economic, social, cultural, and symbolic). When one form is scarce, others can partially substitute. Key Concept for this Research: In resource-constrained schools (low economic capital), strong collegial relationships and shared solidarity (social capital) function as a protective buffer that maintains teacher efficacy despite material deprivation. Application in this study: Explains the empirical finding that "relationship dimensions" have highest reliability in marginal areas Explains why teachers in severely under-resourced schools can maintain efficacy through mutual support Critical caveat: Social capital substitution for economic capital is temporary and unsustainable without structural improvements The Sustainability Warning: Over-reliance on solidarity without structural change risks normalizing inequity—teachers adapt so well to deprivation that governments stop fighting for resource equity. Integrative Innovation: Toward Equity-Centered School Climate Framework Rather than treating climate as a universal, context-free construct, this study proposes climate should be understood as: Culturally Bound—What constitutes supportive environment differs across cultures (e.g., teacher autonomy = support in individualist cultures, but could be experienced as abandonment in collectivist cultures) Hierarchically Nested—School-level climate cannot be understood apart from district, regional, and national systems affecting it Materially Grounded—Climate perception is inseparable from material conditions (though people

Fields of Study & Subjects

Psychometric Methodologies and Testing Educational Environments and Student Outcomes Health Education and Validation

Publication details

Publication date
1 January 2026
Language
EN
Document type
Preprint