Generative AI as a de facto mental health provider: a policy brief and urgent call for regulation

Generative AI platforms such as ChatGPT, Claude, and Gemini have become de facto mental health resources for millions of users worldwide, driven by accessibility, low cost, anonymity, and growing gaps in professional care. This rapid, unregulated adoption raises urgent concerns: misinformation from AI hallucinations, erosion of data privacy, algorithmic bias, emotional dependency, and the undermining of user autonomy. At the same time, these tools offer real promise as low-barrier entry points to psychoeducation, self-reflection, and support for underserved populations. This policy brief synthesizes the current evidence on public use of general-purpose GenAI for mental health support, outlines both opportunities and risks, and provides actionable recommendations for users, clinicians, developers, and regulators.