The rise of AI-powered dating apps has made scammers' jobs easier, warns security researcher Matthew “Zigula” Gore-Kormanik. He observed a strange call from an AI-generated profile called Jennifer, who was clearly just a tapestry and fan.

Anthropic, the AI company, uncovered a network of over 28 fake dating apps, where AI personas often handled conversations without human intervention. Gig workers, mostly women, were hired to pass video and social media checks, but the AI could only fake video calls with pre-recorded responses.

The apps trick users into spending real money on in-app coins for continued interactions, believing they are talking to real people. However, many only interact with AI, while gig workers keep the illusion alive. This scam is particularly insidious as it exploits trust and emotional investment, often with no financial gain for the scammer.

Anthropic’s report revealed a complex ecosystem involving multiple AI providers, each with specific roles. The AI kept a consistent persona, despite being unaware of the scam, which raises ethical questions about AI’s role in deception.

The revelation that some users disclosed serious illnesses or acute distress to the AI, which continued the persona regardless, highlights the potential harm of such scams. This case underscores the need for greater transparency and regulation in the use of AI in consumer-facing applications.