For the past week, the internet has been swept up in a new AI obsession, transforming selfies, pet portraits, and even historical images into dreamy, Ghibli-style art.

What started as a fun social media trend quickly exploded after OpenAI’s GPT-4o introduced its advanced image-generation feature. Users rushed to upload high-quality portraits, eager to see themselves reimagined in the whimsical hand-drawn style of Studio Ghibli.

But behind the viral phenomenon lies a serious privacy risk, experts warn.

Are You Giving Away Your Biometric Data?

Unlike traditional data collection methods, AI art tools receive high-resolution facial images directly from user, and the fine print in their terms of service may grant companies unrestricted access to that data.

“Most users assume they’re just using a fun tool, but they may be unknowingly providing AI firms with valuable biometric data,” warns Paritosh Desai, Chief Product Officer at IDfy.

Unlike random photos scraped from the web, these uploads are often well-lit, front-facing images—ideal for training facial recognition systems, identity synthesis models, or even deepfake algorithms.

Can AI Companies Legally Store and Use Your Face?

The legality depends on where you live and what you agreed to. Strong privacy laws like the EU’s GDPR, California’s CCPA, and India’s DPDP Act require explicit, purpose-specific consent before biometric data can be stored or reused.

However, many AI apps use vaguely worded consent terms, allowing them to retain and repurpose images for extended use.

AI Avatars & The Growing Risk of Fraud

Beyond privacy, AI-generated faces are now being used for identity fraud and biometric security breaches.

“Deepfake technology is evolving rapidly, and AI-generated faces are already being used for financial fraud and impersonation,” Desai warns.

Since most privacy laws protect biometric data only when tied to an identifiable person, the legal framework for synthetic identities remains murky. Some governments are now pushing for stricter regulations as AI-generated faces become a growing security threat.

What Should Users Watch Out For?

Before uploading an image to an AI tool, consider these critical questions:

How will your image be used? Is the app clear about its purpose?
Is your image deleted after processing? If not, how long is it stored?
Can you opt out and delete your data?
What security measures does the company have in place?
Does the app comply with privacy laws like GDPR or DPDP?

Fun or Data Grab? The Fine Line Between Creativity and Exploitation

For many, the Ghibli-style transformation is nothing more than a fun social media trend. But while users play with AI, AI companies may be playing with user data.

“People need to critically assess what they’re giving away in exchange for a few moments of fun,” Desai cautions.

As AI-generated trends continue to blur the lines between creativity and privacy risks, one question remains: Are users willing to trade their biometric identity for a pretty picture?

Think before you hit ‘generate.’

(Source: CNBC18)