The Death of Authenticity Online: Faux-Fluencers and the Rise of Identity-Based Disinformation

Introduction

One of the most significant recent developments in the use of AI on social media is the emergence of fully realized synthetic identities capable of convincingly simulating human presence, often taking the form of hyper-realistic, vlogger-style online personalities sustained through persistent social media presences — including influencers, doctors, financial commentators, journalists, and soldiers. Unlike earlier forms of disinformation, these "faux-fluencers" are not merely vehicles for disseminating messages but consistent social identities with which audiences can foster familiarity, emotional attachment, and ultimately trust. Advances in generative AI have dramatically reduced the cost, expertise, and time required to produce persuasive identity-driven content at scale, transforming what were once niche, resource-intensive marketing experiments into widely accessible instruments of online influence; as these systems become cheaper, easier to produce, and increasingly effective at shaping perception and behavior, they also become increasingly attractive to financial, ideological, and political actors seeking scalable methods of persuasion with minimal accountability.

By embedding persuasive narratives within realistic ideologically driven personalities, this shift from message-based to identity-based persuasion substantially enhances the durability, reach, and psychological effectiveness of online manipulation in an environment in which malicious actors seek to generate illicit financial gain, disseminate identity-based hatred, and shape public perception through propaganda via emotionally resonant and precisely targeted forms of influence. Unlike traditional advertising or propaganda, which rely on audiences consciously engaging with commercial or ideological messaging, identity-driven persuasion operates through the social dynamics of perceived interpersonal interaction. Because individuals are generally more receptive to familiar and seemingly trustworthy personalities than to overt attempts at persuasion, these systems allow manipulation to function indirectly through parasocial trust rather than explicit advertising, hateful rhetoric, or political messaging. In this model, influence becomes increasingly embedded not simply in the message itself, but in the perceived authenticity, emotional familiarity, and social credibility of the identity delivering it.

Engineering Trust in Synthetic Identities

The commercialization of synthetic identities helped normalize AI-driven personas long before their broader ideological and political deployment. Early AI-generated influencers such as Lil Miquela — a fully computer-generated fashion influencer created in 2016 who amassed millions of followers and collaborated with major brands — required substantial technical and financial investment, limiting such projects largely to well-resourced commercial actors. Recent advances in generative AI, however, have dramatically lowered the barriers to creating convincing synthetic identities at scale. This shift has enabled the rapid proliferation of fabricated personas across both commercial and ideological domains, including scam influencers such as Emily Hart, who monetized a carefully constructed political identity through merchandise and subscription-based content. Together, these developments illustrate the emergence of a scalable model in which synthetic identities can be systematically deployed to exploit trust, cultivate engagement, and generate profit at minimal cost. As a result of the combined effectiveness, affordability, and accessibility of this technology, techniques once used primarily for commercial influence are increasingly being deployed in higher-stakes domains where manipulation can lead to financial exploitation, public health risks, social polarization, political instability, and broader real-world harm. For instance, recent investigations have identified networks of fake AI doctors promoting unverified medical treatments, often through the impersonation of credible healthcare professionals, thereby exploiting public trust in medical authority while blurring the boundary between legitimate advice and commercial deception. Parallel dynamics are visible in the financial sphere, where AI-generated influencers present themselves as credible analysts while disseminating misleading or manipulative investment narratives at scale. Cybersecurity analyst Ryan McBeth, for example, documented networks of AI-generated "vlogger-style" financial personalities spreading narratives about imminent monetary collapse and dramatic silver-price surges as part of an apparent market manipulation campaign, simultaneously demonstrating how cheaply and quickly such content can now be produced. Crucially, McBeth's analysis highlighted not merely the existence and growing prevalence of these campaigns, but the remarkably low technical and financial barriers required to generate convincing synthetic personas capable of reaching large audiences.

AI-Driven Evolution of Digital Hate

The same identity-driven systems are increasingly being used to disseminate race-, sexuality-, and religion-based hatred. By embedding adversarial narratives within seemingly credible identities, these technologies amplify pre-existing prejudices in ways that intensify social polarization and expose marginalized communities to heightened risks of harassment and violence. Over the past year, for example, there has been a noticeable rise in racially targeted content propagated through digitally constructed personas. In one case, a TikTok account featured recurring Black characters portrayed in ways that reinforced longstanding harmful stereotypes, depicting themes such as drug use, disrespect toward elders, hypersexualization of women, infidelity, "hoodlum"-style rap content, and antagonistic framing toward white individuals. While the account did not operate as a traditional faux-fluencer centered around a single consistent identity, it relied on a rotating cast of recurring personas. Many of the videos adopted "vlog" and "day-in-the-life" formats, enhancing their perceived realism and relatability. This stylistic choice is significant because, by closely mimicking organic user-generated content, such accounts blur the boundary between genuine self-expression and orchestrated narrative construction. Our research also identified a parallel trend of internally consistent female personas characterized by stylized aesthetics and exaggerated visual features. These portrayals frequently leaned into the sexualization of Black women, reinforcing reductive and historically rooted tropes. Individually, each of these elements raises concern; taken together, however, they point to a more sophisticated mechanism of narrative reinforcement. The convergence of vlog-style realism, emotionally familiar formats, and visually repeatable personas enables harmful stereotypes to be repackaged, amplified, and reabsorbed into mainstream discourse under the guise of mediated authenticity. In effect, these systems create feedback loops in which distorted portrayals become increasingly normalized through repeated exposure within seemingly organic digital environments.

A similar dynamic emerges in anti-LGBTQ+ content, where AI-generated media is used to normalize hostility through emotionally charged identity-driven narratives. A report by Forbidden Colours, The Impact of AI on LGBTIQ+ People: From Discrimination to Disinformation, highlights how AI systems facilitate narratives portraying LGBTQ+ individuals as corrupting children, promoting immorality or "degeneracy," and representing a cultural threat imposed by Western influence. In one particularly disturbing example of normalization of violence, an AI-generated video depicts a patriotic-looking cowboy driving toward an LGBTQ+ parade before abruptly accelerating into a crowd of screaming people, some holding rainbow flags. Like the racialized content described above, these narratives rely on emotionally charged framing presented through formats designed to mimic organic online expression. The realism and emotional framing of such content allow it to simulate violence in ways that normalize and desensitize viewers to harm against marginalized groups.

This trend is particularly visible in the recent proliferation of AI-generated antisemitic personas. Since early 2026, networks of fabricated "rabbis" and wealthy Jewish characters have circulated content reproducing longstanding antisemitic tropes, including narratives of hidden Jewish control over finance, media, and political systems, as well as broader conspiracy frameworks portraying Jews as orchestrators of global events. In one instance, a fabricated TikTok persona (@rabbi.eisenberg) disseminated a video suggesting that Jewish individuals manipulate real estate markets to exploit tenants, echoing enduring stereotypes of Jewish economic dominance. These narratives draw on historical antisemitic myths falsely linking Jews to financial control — myths historically used to justify persecution, expulsions, and mass violence, including the ideological foundations of the Holocaust.

The widespread circulation of content such as the @rabbi.eisenberg example suggests that these narratives are again becoming normalized, now amplified through sophisticated online accounts that blend automation with human-like behavior. This illusion of legitimacy is further reinforced through coordinated amplification: a Cyabra analysis found that approximately 47% of the accounts engaging with the post were inauthentic, significantly boosting its visibility to over 320,000 views. Collectively, these examples demonstrate how generative AI has transformed the dissemination of hate by embedding it within socially believable identities, enabling it to spread more persuasively, more rapidly, and at far greater scale than previously possible.

AI Personas as Weapons of War

Beyond commercial scams and identity-based hatred, synthetic personas are increasingly being weaponized in geopolitical conflict. Generative AI enables governments and aligned actors to simulate widespread grassroots sentiment and produce highly convincing identity-based content capable of distorting how events are perceived by foreign audiences, turning perception itself into a strategic domain with tangible geopolitical consequences.

During the 2026 Middle Eastern conflict, Iran leveraged AI-generated media as a core element of its information warfare strategy, flooding digital platforms with synthetic narratives that evolved in near real time alongside unfolding events. Thousands of coordinated AI-generated personas spread content portraying the United States and Israel as faltering while presenting Iran as resilient and dominant, while also deploying idealized female personas to humanize the regime, cultivate emotional affinity, and increase audience engagement through influencer-style content and performative intimacy. Rather than relying exclusively on traditional propaganda techniques, these campaigns embedded political messaging within emotionally familiar social media formats designed to appear spontaneous, personal, and authentic.

A Cyabra investigation identified several recurring tactics. One of the most prominent involved fabricated American soldiers appearing in emotionally charged vlog-style videos describing the deaths or severe injuries of their comrades while expressing a desire to abandon the battlefield. These campaigns were effective not because of technical perfection, but because they reproduced recognizable emotional and cultural formats already native to social media. The apparent objective was not merely to deceive viewers about individual events, but to construct a broader narrative of collapsing morale within the U.S. military and increasing public disillusionment with the war effort.

The campaign also incorporated pre-existing conspiracy narratives, particularly claims that the war had been initiated by Donald Trump to divert attention from the Epstein files. By embedding such narratives within emotional testimonies from fabricated soldiers, the campaign exploited existing cultural sensitivities within the United States while undermining the perceived legitimacy of the war effort.

Other iterations adopted the format of traditional journalism. In one widely circulated example, an AI-generated Al Jazeera-style news anchor appeared to break from her script mid-broadcast, refusing "to be a tool for misleading people." Another video featured a fabricated reporter broadcasting from Dubai before reacting to an incoming missile strike impacting a nearby skyscraper.

The campaign also made extensive use of AI-generated women depicted in Iranian military attire while expressing enthusiastic support for Iran, strategically blending visual appeal, emotional engagement, and political messaging to cultivate sympathy toward Iran among targeted audiences. In one vlog-style video, three conventionally American blonde women, clad in Iranian military uniforms, enthusiastically voice support for Iran. In another, an Iranian woman — her hair uncovered yet similarly dressed in military attire — forms a heart with her hands and tells the viewer, "I love you." These personas capitalize on idealized feminine aesthetics, influencer-style intimacy, and emotionally familiar online behaviors to embed propaganda within entertainment-oriented social media spaces, leveraging parasocial attraction and aspirational femininity to increase audience receptivity and emotional identification with pro-Iranian messaging.

Taken together, these examples demonstrate how AI-generated persona networks function as strategic amplifiers in modern information warfare, enabling states to manufacture emotionally compelling and highly targeted narratives at unprecedented scale while simultaneously projecting influence across multiple audiences and platforms.

What Comes Next

The proliferation of AI-generated faux-fluencers reflects not merely a technological shift but a structural transformation in how trust, persuasion, and influence operate online. Across domains ranging from financial scams and identity-based hatred to state-sponsored propaganda, the movement from anonymous content to persistent identity-driven narratives has fundamentally amplified the reach and durability of manipulation. These personas do not need to be flawless to be effective; they need only appear sufficiently authentic within fast-moving digital environments in which emotional resonance consistently outpaces verification. Platform architectures compound this dynamic, as algorithmic systems reward the same qualities that make AI-generated personas effective, regardless of their authenticity.

At the platform level, the current reliance on voluntary measures is no longer adequate. Platforms must be required to detect, label, and, where appropriate, remove AI-generated identities that operate deceptively, not as a matter of policy preference but as a condition of operating at scale. This means mandatory disclosure of synthetic content at the point of publication, not after harm has occurred, and consistent enforcement that applies equally across content types and political contexts. Platforms that algorithmically amplify inauthentic engagement while avoiding accountability for its consequences must face meaningful regulatory pressure to change that calculus.

Existing legal frameworks were not designed for identity-based manipulation at scale, and the gap is significant. Consumer protection and election integrity laws offer partial coverage but leave unresolved the core liability questions: who is responsible when a synthetic persona network spreads health misinformation, incites hatred, or shapes an election? Legislators need to treat persistent synthetic personas as a distinct legal category, with clear standards for disclosure, traceability, and liability, including for the platforms that host and amplify them, not only the actors who create them.

Investment in detection infrastructure and independent research must accelerate substantially. Organizations at the intersection of digital forensics, platform governance, and hate studies are positioned to inform both regulatory design and public understanding, but only if adequately resourced and structurally independent from the platforms they monitor. The faux-fluencer is not an endpoint. It is an early iteration of a model that will only become more capable, more scalable, and harder to distinguish from authentic human presence. The window for establishing effective governance is narrowing.

Funding Disclosure

None to declare.

Conflicts of Interest

None to declare.

Relevant Institutional or Advisory Roles

None to declare.

AI/LLM Disclosure

AI tools, including Cyabra's proprietary AI technology, were used to assist with research and content development.