Instagram is finally taking steps to address the rise of fake AI-influencer accounts that have become increasingly difficult to distinguish from real humans. The platform is renaming its existing “AI creator” label to “AI-generated profile” in an effort to make it unmistakably clear when an account features a synthetic person rather than a real human being.
In a blog post, Instagram acknowledged a growing user complaint: people are tired of discovering that a profile they thought was human is actually an AI-generated creation. “We’ve heard that people don’t like seeing a profile that seems human, only to find out later that the person featured is AI-generated,” the company said. “They want to know when a profile features an AI-generated person.”
This announcement marks a notable shift in how Instagram handles the booming ecosystem of virtual influencers—digital characters built using artificial intelligence, often designed to promote brands, sell products, or simply accumulate followers. Some of these accounts have amassed millions of followers and appear in advertising campaigns for major fashion labels, beauty products, and lifestyle brands. As the technology behind AI-generated imagery and video improves, the line between real and synthetic creators has blurred, raising new questions about transparency, authenticity, and consumer trust.
What Instagram is changing
Under the new policy, Instagram will actively hunt down accounts that feature AI-generated people but fail to label themselves. When such accounts are identified, Instagram will penalize them by limiting their reach. That means their posts will no longer be recommended to non-followers in Reels and Explore, cutting off the primary discovery mechanisms that help accounts grow. Profile owners will have the ability to appeal the decision if they believe their account was incorrectly flagged.
The move is a direct response to the rise of AI-generated profiles like Aitana Lopez, a virtual influencer created by a Spanish AI agency. Aitana, who has a distinct pink-haired appearance and a highly curated Instagram feed, was one of the first AI creators to gain widespread attention. The account has been used to promote products and has appeared in advertisements, all while making it easy for casual visitors to mistake her for a real person. Under Instagram’s revised labeling system, accounts like Aitana’s will be expected to display a clear “AI-generated profile” label so that users understand they are not interacting with a human being.
Instagram says that people who use AI tools to generate content—such as AI-assisted photo editing or text generation—do not need to add the label to their own profiles. The label is specifically for profiles whose primary subject is an AI-generated person. This distinction means that today’s action will not allow users to filter out all AI-generated content on the platform, but it does represent a meaningful first step toward reducing deception.
Why this matters for social media transparency
The problem of fake AI influencers is not just a curiosity; it has real implications for users and brands. When people follow an account, like a post, or buy a product recommended by an influencer, they often do so based on trust in the person behind the profile. If that person turns out to be a fictional AI creation, that trust is broken. For brands, working with an AI influencer can be a cost-effective way to reach audiences, but it also carries risks if the disclosure is not clear.
Regulators and consumer advocacy groups have been pushing for clearer rules around AI-generated content, especially in advertising and social media. In the United States, the Federal Trade Commission has expressed concerns about influencer marketing and misleading endorsements, though it has not yet issued specific rules targeting AI influencers. In other jurisdictions, such as the European Union, the AI Act includes provisions for transparency and disclosure of AI-generated content. Instagram’s labeling requirement is likely to be welcomed by those who believe that users have a right to know when they are interacting with a machine.
Instagram boss Adam Mosseri has hinted at the challenge of balancing innovation with user safety. The platform has experimented with various ways to identify AI-generated content, including watermarking systems and metadata tags. Mosseri has acknowledged that no single approach is perfect, but this latest change suggests a willingness to take on the problem directly.
How Instagram will enforce the label
Instagram’s enforcement strategy relies on both self-identification and automated detection. Account owners are expected to voluntarily label their AI-generated profiles, but Instagram says it will also proactively identify accounts that do not comply. The exact details of the detection system have not been fully disclosed, but it likely involves a combination of image analysis, pattern recognition, and user reports. Once an account is flagged, its reach will be limited, meaning its content will appear less frequently in discovery surfaces such as Reels and the Explore feed. Followers will still see posts from these accounts in their main feed, but the account will lose the algorithmic boost that can bring new followers and engagement.
If an account owner believes their account has been wrongly flagged, they can submit an appeal. Instagram has not yet explained how the appeal process will work in practice, but it will likely require the account owner to provide evidence that the person featured in the profile is a real human or that the account does not meet the definition of an AI-generated profile.
The announcement also clarifies that the label does not apply to accounts that merely use AI tools as part of their creative process. For example, a human photographer who uses AI to enhance images or a writer who uses AI to brainstorm ideas will not be required to label their accounts. This distinction is important because it prevents the policy from being overly broad and avoids penalizing creators who use AI in legitimate ways.
The rise of AI influencers
The emergence of AI influencers can be traced back to several early experiments in computer-generated characters. In 2016, a virtual model named Shudu Gram was introduced on Instagram and quickly gained attention for her stunning realism. Shudu, created by a British photographer, was described as a digital fashion model and attracted hundreds of thousands of followers. Since then, the field has exploded, with AI influencers such as Lil Miquela, Noonoouri, and Bermuda gaining significant followings. These virtual beings have landed contracts with luxury brands, appeared in music videos, and even launched their own product lines.
Aitana Lopez is another prominent example. Created by The Clueless agency in Barcelona, Aitana was designed to be a fictional Instagram model with a distinctive aesthetic. Her account features high-quality photos, lifestyle content, and promotional posts, all generated with AI. Aitana has been used to advertise products ranging from beauty items to video games, and her creators have said that she generates significant revenue. For many observers, Aitana represents both the promise and the peril of AI influencers: she brings creativity and commercial opportunity, but her presence also raises questions about authenticity and the potential for deception.
Critics argue that AI influencers can be especially problematic because they are often indistinguishable from real people. A user scrolling through Instagram may not realize that a person they are following does not exist. This can lead to confusion, false expectations, and even emotional distress when followers form parasocial relationships with fictional characters. By requiring clear labeling, Instagram is acknowledging these concerns and taking steps to protect users.
Potential impact and limitations
Instagram’s new policy is likely to have a significant impact on the AI influencer industry. Accounts that do not self-label will see their growth stunted, which could lead to a decline in their commercial value. Brands that partner with AI influencers will also need to be more careful about disclosure, as the new label may affect how consumers perceive their campaigns. Some AI creators may choose to embrace the label and continue posting, while others may try to circumvent the rules by claiming that their content is not truly AI-generated.
However, the policy has clear limitations. It does not address AI-generated content that appears on other platforms, and it does not address deepfakes or manipulated media that uses the likeness of real people. Additionally, the policy only applies to profiles that feature AI-generated people as their main subject. AI-generated product images, landscapes, or animals are not covered. The label also does nothing to reduce the overall volume of low-quality AI content on the platform, a problem that critics have dubbed “AI slop.”
Meta, Instagram’s parent company, has been investing heavily in AI technology, including large language models and content generation tools. The company has also been developing messaging standards and metadata systems that could help identify AI-generated content across its platforms. Instagram’s labeling move is consistent with these efforts, but it is unlikely to be the final word on how social media platforms handle synthetic media.
A step in the right direction
Despite its limitations, Instagram’s decision to take action against unlabeled AI accounts is being greeted as a positive step by digital rights advocates and media watchdogs. The label “AI-generated profile” is clearer and more direct than the previous “AI creator” label, which was easy to overlook or misinterpret. By limiting the reach of non-compliant accounts, Instagram is also creating an economic incentive for AI creators to be transparent.
The move also signals that Instagram is listening to its user base, many of whom have expressed frustration with the growing number of fake accounts. In the coming months, it will be interesting to see how the policy is enforced and whether it leads to a visible reduction in deceptive AI content. For now, the company appears to be taking the issue seriously, and that alone is a meaningful change from the early days of the AI influencer boom.
As AI technology continues to evolve, so too will the tactics used by people who seek to deceive others online. Instagram’s latest policy is a reminder that platforms have a responsibility to help users understand what they are looking at, and that transparency should remain a cornerstone of social media. Whether this specific policy will be enough to curb the rise of fake AI accounts remains to be seen, but it is an important first step in the ongoing effort to maintain trust in the digital public square.
Source: The Verge News