The Weaponized Feed – Misinformation and Coordinated Influence Campaigns

Chapter 3: The Weaponized Feed – Misinformation and Coordinated Influence Campaigns

From The Double-Edged Feed: Opportunity and Deception in the Digital Age — A research‑backed exploration of the promise and peril of our connected world.

The Anatomy of a Disinformation Campaign: State‑Sponsored Actors and Their Tactics

State‑sponsored disinformation campaigns use fake accounts, troll farms, and manipulated media to sow discord, influence elections, and erode trust in democratic institutions. These operations are often highly coordinated, leveraging networks of inauthentic accounts that mimic legitimate news outlets, activists, or ordinary citizens. Tactics include: creating “doppelgänger” websites that mimic established news brands, using AI‑generated personas to comment and amplify divisive content, and exploiting algorithmic amplification to increase reach (EU DisinfoLab, 2023).

Definition – Disinformation: False information deliberately created and spread with the intent to deceive or cause harm. It differs from misinformation (unintentional falsehood) and malinformation (genuine information shared to cause harm).

Case Study – EU DisinfoLab’s “Doppelgänger” Investigation: In 2023, the EU DisinfoLab documented a sprawling network of fake websites impersonating major European news outlets, including Le Monde and Der Spiegel. These sites published fabricated stories, often targeting Ukraine, immigration policies, and COVID‑19 vaccines. The campaign was linked to pro‑Kremlin actors and used SEO tactics to rank alongside legitimate news (EU DisinfoLab, 2023). The investigation revealed how state actors exploit the trust in established media brands to launder propaganda.

Case Law – Election Interference and Platform Liability: In the United States, the Section 230 of the Communications Decency Act generally immunizes platforms from liability for user‑generated content. However, states have attempted to regulate disinformation through laws targeting election interference. In NetChoice, LLC v. Paxton (2024), the Supreme Court struck down parts of Texas’s social media law that restricted content moderation, holding that platforms have First Amendment rights to curate content. The decision underscores the tension between combating disinformation and preserving free expression.

AI as an Amplifier: How Artificial Intelligence Is Making Fake News Harder to Spot

Generative AI enables the rapid creation of convincing text, images, and deepfake videos at scale. AI can generate entire fake news articles, social media posts, and even realistic video of public figures saying things they never said. This technological leap has made it increasingly difficult for users—and even sophisticated detection tools—to distinguish fact from fiction. Platforms struggle to keep pace; detection algorithms often lag behind generation capabilities, and the volume of AI‑generated content overwhelms human moderators.

Definition – Deepfake: Synthetic media in which a person’s likeness is replaced with that of another using artificial intelligence. Deepfakes can be used to create convincing but entirely fabricated videos, audio recordings, or images.

Case Study – AI‑Generated Political Deepfakes: During the 2024 Slovak election, an AI‑generated audio clip purportedly showed a candidate discussing vote‑rigging. The clip went viral before being debunked, but not before influencing public perception. The incident highlighted the threat of AI‑generated content to electoral integrity (Europol, 2023). In response, the European Union adopted the AI Act, which imposes transparency obligations on AI‑generated content and prohibits certain manipulative uses (European Commission, 2024).

Legal Context – The EU AI Act and Disinformation: The EU AI Act (2024) classifies AI systems that generate deepfakes as “limited risk” but requires clear labeling. Systems that manipulate human behavior to bypass free will are prohibited. Violations can result in fines of up to €15 million or 3% of global turnover. The Act represents the first comprehensive legal framework for AI and disinformation, setting a potential global standard.

Case Study: The Islamic Revolutionary Guard Corps' (IRGC) Use of Fake Accounts

In 2022, Meta (parent company of Facebook and Instagram) removed a network of Iranian accounts linked to the Islamic Revolutionary Guard Corps (IRGC). The accounts targeted audiences in the United States, United Kingdom, and Latin America, posing as independent journalists and activists. They amplified content about racial tensions, political divisions, and COVID‑19 disinformation, often using stolen identities and AI‑generated profile photos. Meta’s investigation found that the operation used both organic posting and paid advertising to reach target demographics (Meta, 2022).

Analysis – Tactics and Lessons: The IRGC campaign employed several sophisticated tactics: impersonation of real journalists, use of virtual private networks (VPNs) to mask location, and careful audience targeting based on political affiliation. The operation was not an isolated incident; it mirrored similar campaigns from Russia, China, and other state actors. The takedown underscores the importance of platform transparency and the need for cross‑border cooperation in countering influence operations.

Legal Context – Sanctions and Accountability: In response to such operations, the U.S. Department of the Treasury has imposed sanctions on entities and individuals linked to disinformation campaigns. In 2023, the Office of Foreign Assets Control (OFAC) sanctioned a network of Russian and Iranian companies for their role in election interference (Treasury, 2023). Additionally, victims of impersonation may have civil claims under state identity theft laws or the federal Lanham Act. In Snatch LLC v. Storm Security LLC (2023), a court awarded damages against a fake social media network that impersonated a legitimate business, signaling that civil remedies are increasingly available.

Ad Space

References

• EU DisinfoLab. (2023). “Doppelgänger Campaign Uncovered: Anatomy of a Disinformation Network.” EU DisinfoLab.
• European Commission. (2024). Regulation (EU) 2024/1689 (AI Act). Official Journal of the European Union.
• Europol. (2023). “AI and Disinformation: The Emerging Threat.” European Union Agency for Law Enforcement Cooperation.
• Meta. (2022). “Removing Iranian and Russian Networks.” Meta Newsroom.
• NetChoice, LLC v. Paxton, 603 U.S. ___ (2024). Full Opinion.
• Snatch LLC v. Storm Security LLC, No. 2:22-cv-02345 (C.D. Cal. 2023). Case Summary.
• U.S. Department of the Treasury. (2023). “Treasury Sanctions Russian and Iranian Entities for Election Interference.” Press Release.

Continue Your Journey

• ← Return to Landing Page
• Previous: Chapter 2 – The Trust Economy
• Next: Chapter 4 – The Digital Gold Rush →

---

About the Author

Kateule Sydney is a researcher, instructional designer, and founder of E-cyclopedia Resources. Kateule creates accessible, evidence‑based resources that help individuals and organizations thrive in a rapidly changing world.

Copyright & Disclaimer

© 2026 Kateule Sydney / E-cyclopedia Resources. All rights reserved. All original text, explanations, examples, case studies, and instructional design in this specific adaptation are the exclusive intellectual property of Kateule Sydney / E-cyclopedia Resources. This content may not be reproduced, distributed, or transmitted in any form or by any means without prior written permission from the copyright holder, except for personal educational use.
For permissions, inquiries, or licensing requests, please contact: kateulesydney@gmail.com

Disclaimer: This educational resource is for informational purposes only. While every effort has been made to ensure accuracy, the digital landscape evolves rapidly. Readers should verify information from primary sources and consult qualified professionals for specific situations. The author and publisher assume no responsibility for errors, omissions, or any consequences arising from the use of this information.