The Good Tech Companies - Instagram Is Overrun With AI-Generated Fetish Content, and Meta Doesn’t Seem to Care

Episode Date: March 24, 2025

This story was originally published on HackerNoon at: https://hackernoon.com/instagram-is-overrun-with-ai-generated-fetish-content-and-meta-doesnt-seem-to-care. A network of AI-generated influencers depicted with Down Syndrome are being monetized through adult content on platforms like Fanvue. Check more stories related to machine-learning at: https://hackernoon.com/c/machine-learning. You can also check exclusive content about #large-language-models, #meta, #content-moderation, #how-to-opt-out-of-meta-ai, #ai-assisted-comments-meta, #purge-meta-account, #wipe-facebook-history, #good-company, and more. This story was written by: @redact. Learn more about this writer by checking @redact's about page, and for more stories, please visit hackernoon.com. Meta has made changes to their content moderation policies and started to test community notes and AI-driven comments. Meanwhile, AI-generated influencers with Down Syndrome find a home on Instagram.

This audio is presented by Hacker Noon, where anyone can learn anything about any technology. Instagram is overrun with i-generated fetish content, and Meta doesn't seem to care. By redact.dev. In January this year, Meta announced their intentions to encourage more speech, fewer mistakes, on their platforms. This involved them axing their fact checkers, implementing community notes and encouraging more political content. Now just months later, Meta is starting to test community notes across platforms, while Instagram is plagued by i-generated adult content creators aphetizing Down syndrome, and users are being encouraged to use AI to help them write comments.

The state of AI on Instagram, Meta has begun rolling out i-assisted comments, adding to its long listlist off endorsements for AI features and usage. While the feature is designed to enhance Ouzer experience, there's a clear relationship between on-platform engagement and Meta's ad revenue. If more users are engaging with content, the session duration on Meta is likely to increase, meaning Meta can sell more ad space. McKink comments' more frequent and predictable also gives Meta the option to encourage advertisers to buy ads based on the promise of engagement, which has been the case for years. On the user side of AI usage on Instagram, 404 media recently reported on a network of eye-generated influencers depicted with Down syndrome. These accounts are being monetized through the sale of eye-generated

adult content on the platform Fanview. Ultimately, this fetishizes Down syndrome and relies on AI models being trained to understand the typical appearance of a person with the condition, training data that almost definitely didn't involve any informed consent. At the time of writing, Instagram and Fanview have taken no action against these accounts, Community Notes feature. With its head in the sand, Meta continues to barrel forwards with efforts to replace third-party fact-checking with Community Notes. To their credit, they are a-rolling this out gradually, and will only publish notes when

contributors with diverse viewpoints agree on the note. They believe this will create a, biased and more scalable moderation solution. To translate this, Meta will make more money by using community nodes. They don't need to pay fact checkers, and users that contribute to community nodes will probably spend more time on platform, generating more ad revenue for Meta. Meta will also build up a database of uniform content moderation data using community notes submissions. This lays the foundation for them to replace the community-driven approach with an AI solution

down the line. Conclusion Zuckerberg continues to shift his platforms closer to Elon-esque philosophies, and users are rightly concerned with their data privacy and Meta's content moderation. The Intercept released leaked training documents from Meta in January, defining, permissible speech on their platforms. Some delightful examples of comments that will be allowed on Meta platforms include, immigrants are grubby, filthy pieces of shit.

Gays are freaks, look at that tranny. Beneath photo of 17-year-old girl, Meta appears to be rapidly shaping their platforms into yet another breeding ground for hate speech and bigotry, while guzzling up every byte of data they jawn to keep users in their network for as long as possible, generating a revenue and training their AI models. What can you do, to combat your data being used to train AI models, the first thing you should dois opt out of generative AI data use in meta. We also recommend an immediate purge of meta platforms to further safeguard your content. Our app, redact.dev gives you tools to wipe your entire Facebook history, which helps

reduce the likelihood of your content being used to train AI. We're also working on building out support for Instagram and threads, stay tuned via our Twitter page or Discord server. Finally, find a new platform to call home and try to bring your community with you. Thank you for listening to this Hacker Noon story, read by Artificial Intelligence. Visit hackernoon.com to read, write, learn and publish.