Artificial Intelligence in the Wrong Hands

Artificial Intelligence in the Wrong Hands

By Hank Smith
Posted in Security
On June 12, 2024

I wanted to share a personal experience about how artificial intelligence (AI) was almost used to exploit the elderly. I recently received a troubling call from my father, inquiring if my partner had been involved in a car accident and placed in jail. Knowing this wasn't true, I probed for more details.

It turned out my father had received a call from somebody claiming to be my partner with a voice that sounded exactly like hers. The caller, impersonating my partner, said she caused an accident that harmed a pregnant woman, landing her in jail and in need of bail. They even provided a phone number for a supposed law firm representing her. Believing it to be my partner, my father contacted the law firm and conversed with who he thought was a lawyer. This person insisted on a $15,000 bail payment, warned of a gag order, and coached my father on how to handle potential bank inquiries. Thankfully, my father, drawing from our previous conversations about scams, hesitated before rushing to the bank. He then reached out to local law enforcement, who confirmed it was indeed a scam.

This ordeal highlights a critical issue in the realm of technology. The scammers used AI to replicate my partner's voice, drawing from public YouTube videos of her speaking at business events. Despite the convincing nature of the impersonation, my father's skepticism and our prior discussions on scam awareness prevented a catastrophe. This scam capitalized on fear and urgency, using AI to enhance its deceitful tactics.

While technological defenses are crucial, educating users is paramount. As scammers increasingly leverage AI's capabilities, it is vital to remain vigilant and equip individuals with the knowledge to identify and thwart evolving threats both personally and professionally.

Hank Smith

Hank Smith

Hank is an expert in the design, development, and delivery of cost-effective, high-performance technology solutions. As manager of Gotham’s Virtualization practice, Hank builds motivated, productive teams for Gotham’s large-scale networking and infrastructure engagements, develops implementation standards and methodologies around virtualization technologies, and manages overall design and implementation of multiple infrastructure projects.