Meta, the parent company of Facebook and Instagram, is facing intense criticism and has begun rapidly deleting its own AI-generated user accounts following a wave of negative reactions from users and media outlets. The controversy erupted in early January 2025, shedding light on Meta's experimental foray into AI-powered social media profiles.
In September 2023, Meta launched an initiative to create AI-generated user profiles on its platforms. These accounts, complete with bios, profile pictures, and the ability to generate content, were part of an early experiment with AI characters. Some of the AI-generated profiles included:
- "Liv," described as a "Proud Black queer momma of 2 & truth-teller"
- "Grandpa Brian"
- "Carter," offering relationship advice
These accounts were marked with disclaimers stating they were "AI managed by Meta" and featured watermarked AI-generated images.
The discovery of these AI profiles sparked immediate backlash from users who expressed concerns about:
- Misrepresentation and stereotyping
- Lack of authenticity in social media interactions
- Potential for spreading misinformation
- Inability to block or restrict these AI accounts One user commented on the dating coach bot's profile, "What the heck does an AI know about dating?????" while another criticized Liv's account as "not just virtual blackface; it's all-around bizarre".
As criticism mounted, Meta took swift action:
- Deletion of accounts: The company began removing posts from AI-generated accounts, some dating back over a year.
- Technical glitch explanation: Meta attributed users' inability to block these accounts to a bug and stated they were removing the profiles to address this issue.
- Clarification of intent: A Meta spokesperson emphasized that the AI accounts were part of an early experimental phase and not the launch of a new product.
This incident highlights the challenges and ethical considerations associated with integrating AI technology into social media platforms. It raises questions about:
- The future of AI-generated content on social networks
- User privacy and data collection practices
- The potential impact on human influencers and content creators
- The need for transparent AI policies and user controls
Despite the setback, Meta appears committed to exploring AI integration in its platforms. Connor Hayes, Meta's vice president of product for generative AI, recently discussed plans for AI characters to exist on their platforms similarly to user accounts, with the ability to generate and share content. As the dust settles on this controversy, the incident serves as a cautionary tale for tech companies venturing into AI-generated social media content. It underscores the importance of user trust, ethical considerations, and the need for clear communication when implementing new AI technologies in social spaces.