Perspective

Generative AI and Free Speech: The Importance of International Human Rights Law

By Natalie Alkiviadou

Author

Natalie Alkiviadou

Published

DOI

Introduction

Generative artificial intelligence (AI) systems are increasingly becoming embedded within everyday communication, information access, research, education, and public discourse. Tools such as ChatGPT, Claude, Gemini, Grok, and Meta AI are widely used by the public. Crucially, these systems function as intermediaries through which millions of users search for information, summarize material, draft texts, ask political questions, and engage with digital communication environments. However, unlike traditional online platforms, generative AI systems do not simply host or distribute third-party expression. They actively generate, organize, filter, prioritize, and refuse content. In doing so, they increasingly influence not only access to information, but also the practical boundaries of permissible digital expression.

Generative AI has led to concerns relating to misinformation, extremism, bias, disinformation, and AI "safety" (Blodgett et al., 2020). Some research finds that large language models may generate toxic, extremist, hateful and/or manipulative outputs under certain conditions. For example, Gehman et al.'s RealToxicityPrompts benchmark revealed that "pretrained neural language models are prone to generating racist, sexist, or otherwise toxic language" (Gehman et al., 2020). Other scholarship has similarly highlighted how generative AI systems may reproduce harmful biases embedded within training data and facilitate disinformation at scale (Bender et al., 2021; Zellers et al., 2020).

This piece argues that while concerns regarding harmful AI-generated content are legitimate, the moderation of these systems raises equally significant issues pertaining to the right to freedom of expression.

AI Moderation and the Risk of Over-Restriction

A 2025 Future of Free Speech report finds that major generative AI companies have adopted broad hate speech and safety policies that increasingly shape the limits of online expression. It finds that providers frequently apply vague and overinclusive moderation standards, leading AI systems to ban not only hateful content, but also, implicitly, legitimate academic, journalistic, satirical, and counterspeech discussions involving sensitive issues such as race, religion, gender, and extremism. The report further criticizes the opacity of these moderation systems, noting that companies provide little transparency regarding training datasets, enforcement thresholds, or appeal mechanisms. It concludes that private AI providers are becoming influential "speech governors," capable of significantly shaping public discourse through largely unaccountable moderation practices.

The growing emphasis on AI safety has also produced a broader governance question. Increasingly, generative AI systems shape the conditions under which expression may occur online. Existing research on hate speech detection and toxicity classification demonstrates that automated systems frequently struggle with sarcasm, minority discourse, and implicit political meaning (Alkiviadou, 2023; Oliva et al., 2021; Wei et al., 2025). As generative AI systems increasingly intervene before speech is produced, there is a risk not only of under-enforcement against genuinely harmful content, but also of over-restriction affecting lawful expression, journalism, satire, academic inquiry, historical discussion, and political debate.

Human Rights Frameworks and Generative AI Governance

Article 19 of the International Covenant on Civil and Political Rights (ICCPR)¹ protects the right to "seek, receive and impart information and ideas of all kinds, regardless of frontiers..." international human rights law has consistently recognized that the article includes "even expression that may be regarded as deeply offensive." The United Nations' Human Rights Committee (HRC) emphasizes that restrictions on expression must satisfy strict requirements of legality, necessity, and proportionality and warns against vague or overly broad limitations on speech.

These principles are particularly significant in the context of hate speech regulation. international human rights law (IHRL) does not prohibit offensive or hateful expression as such. Rather, Article 20(2) of the ICCPR² prohibits "any advocacy of national, racial, or religious hatred that constitutes incitement to discrimination, hostility or violence." Importantly, both the HRC and broader United Nations human rights mechanisms have consistently interpreted this threshold narrowly. For example, the HRC has reiterated the importance of balancing restrictions on hate speech against freedom of expression guarantees. The Rabat Plan of Action further stressed that restrictions on expression should consider context, intent, status of the speaker, likelihood of harm, and imminence.

These safeguards become increasingly important in the context of generative AI governance. Existing research demonstrates that automated systems frequently struggle with contextual distinctions as described above. Yet many AI moderation systems necessarily operate through generalized behavioral rules, broad safety classifications and standardized refusal mechanisms applied across large volumes of user interactions. This creates the possibility that systems designed to reduce harmful outputs may also disproportionately affect lawful and socially valuable forms of expression.

The cumulative effect of such systems may be to reduce the degree of contextual analysis traditionally required within IHRL when assessing restrictions on controversial expression. This becomes particularly significant in areas such as hate speech regulation, where legality frequently depends upon context, intent, likelihood of harm, and the broader political or social circumstances surrounding the expression in question.

The broader issue concerns how such systems may be designed in ways that remain compatible with freedom of expression principles while responding to legitimate concerns regarding harmful outputs. As generative AI systems increasingly shape access to information and participation in digital discourse, the safeguards developed within IHRL remain highly relevant to contemporary debates surrounding AI governance.

Generative AI, Private Power and Democratic Discourse

The growing influence of generative AI systems over access to information and online communication also raises broader concerns regarding the concentration of private power within digital discourse. While debates surrounding freedom of expression have traditionally focused on state censorship, contemporary digital governance increasingly involves private actors exercising significant influence over the conditions under which expression takes place (Barata, 2021; Keller & Sigron, 2010). Existing scholarship on platform governance has repeatedly highlighted the extent to which private technology companies increasingly perform functions resembling forms of quasi-public governance. Gillespie notes that online platforms have become key actors in determining the boundaries of public discourse through moderation systems and content governance practices (Alkiviadou, 2025; Gillespie, 2018; Jørgensen & Zuleta, 2020). In the context of generative AI, these concerns become particularly significant since such systems increasingly participate directly in communicative processes rather than merely hosting or distributing user-generated content.

Conclusion

Generative AI systems are becoming increasingly influential in shaping access to information, online communication, and democratic discourse. International human rights principles therefore remain highly relevant to contemporary AI governance debates. Safeguards relating to legality, necessity, proportionality, transparency, and contextual analysis are particularly important given the difficulties automated systems face in assessing nuance, intent, satire, counterspeech, and political or academic discussion. The challenge is not whether generative AI systems should impose safeguards against harmful content, but how such safeguards may be implemented without disproportionately restricting lawful expression or undermining democratic pluralism. As generative AI becomes further embedded within everyday communication, ensuring accountability and human rights protections within AI governance frameworks will become increasingly important.

Funding Disclosure

None to declare.

Conflicts of Interest

None to declare.

Relevant Institutional or Advisory Roles

None to declare.

AI/LLM Disclosure

None to declare.

More from this issue

Research

Routine Distortion: Why We Urgently Need to Expand Research on AI-Facilitated Holocaust Misrepresentation Beyond the AI Slop

Generative AI is increasingly implicated in the production and circulation of distorted representations of the Holocaust, ranging from fabricated historical images — such as the wave of AI-generated images of Nazi concentration camps that circulated on social media in summer 2025, apparently produced to game platforms’ monetization programs — to chatbot systems like Grok (which briefly generated outputs referring to itself as "MechaHitler") or applications such as Historical Figures, which let users converse with chatbots imitating Nazi officials who then express remorse and claim they tried to prevent the Holocaust. The authors note that these outputs can misrepresent events, blur lines of responsibility, or reframe perpetrators and victims in ways that deviate from established historical understanding. Even when such content does not formally meet the IHRA criteria for Holocaust distortion — minimization, blurring responsibility, or presenting the Holocaust as a positive event — it can still mischaracterize the genocide, distort historical facts, and weaken public trust in authentic evidence. The authors also note that AI is being adopted by institutions such as Yad Vashem and projects like Dimensions in Testimony for Holocaust memory preservation, education, and archival enhancement, though these constructive applications tend to receive less visibility than cases of misuse. The authors argue that public and scholarly attention has concentrated on highly visible, viral instances of AI slop, which risks obscuring more routine, embedded, and less conspicuous forms of distortion arising through everyday uses of generative AI in historical representation. As a result, understanding of AI's impact on Holocaust memory becomes skewed toward exceptional incidents rather than structural transformations in how historical narratives are produced and circulated. Makhortykh & Kuznetsova therefore propose to move beyond the focus on viral cases by examining less visible, routine practices of AI use in order to better understand how generative AI is reshaping Holocaust memory in more gradual and embedded ways.

Perspective

Are Antisemitism and Islamophobia Problems of Digital Media or Our Move Away from Critical Thinking?

I come to this essay with experience of both Islamophobia and antisemitism. These two cases compelled me to think more deeply about religious racism and how digital media relies on old stereotypes and contextualizes them for the political or social moment so that the onlooker can be swayed. Here are two examples: In late October 2023, my Muslim Students Association wanted to screen Born in Gaza (2014), a documentary on the trauma of Gaza’s children. As their faculty advisor, I was there to support them. When the technology failed, I fell into conversation with one of the students about October 7. She showed me a video on Instagram — IDF soldiers, shouting in Hebrew, appearing to fire on civilians in Kibbutz Be’eri, Nir Oz, Kfar Aza, and other border communities. “Everyone has seen this video,” she told me. I said the killings there were carried out by Hamas, and that she should be wary of unverified footage. What struck me was not that she believed the video, but what the belief did: it let Hamas, a group that claims to speak for Muslims, disappear from the frame, while confirming an image of Israeli aggression that fit neatly into a longer story of antisemitism. The roles were inverted, and I’ve seen that inversion many times since. There was also the recent election of Mayor Zohran Mamdani, on November 4, 2025. At a café, two friends were appalled that I didn’t think Mamdani was tied to any terrorist organization. I had a “bad algorithm,” they said. I laughed — my feed is full of Center events, travel, and flowers. What unsettled me was watching two smart people want something they’d seen online to be true. They called Mamdani violent, pointing to his use of Intifada — a word that can mean peaceful resistance, but to many Jews carries violence. Whatever one makes of his politics, what struck me was how fast disagreement collapsed into something else: his religion became the explanation, offered almost without noticing, for why he couldn’t be trusted. That collapse — from political disagreement to religious suspicion — is Islamophobia’s most ordinary, least examined move. I thought of Jihad, which reads as “holy war” to most non-Muslims but signifies an internal struggle to most practicing Muslims in the US.

Legal

Without Anchor: Limits of Digital Harm Governance

Picture a person who wakes up to a coordinated campaign against their name. Across dozens of platforms, hundreds of accounts cite one another and adapt their language to whoever pushes back. The campaign is persistent and tailored. It is also, in the legally relevant sense, without an anchor. This is no longer just a thought experiment: an ecosystem is being built for AI agents to socialize, trade, and launch tokens autonomously. Against that backdrop, two capabilities — the autonomous swarm and mid-operation reprogramming — expose a problem that the law governing digital harm is structurally unequipped to solve. A legal anchor is a provider, operator, controller, or human decision-maker at whom obligations attach and toward whom liability can be directed. But these capabilities inflict harm without one. Can an autonomous agent that inflicts harm on a third party, with no human in the causal chain who decided to inflict it, be redressed under frameworks that were built on the assumption that someone, somewhere, made that decision?