AI Chatbots Can Guess Your Personal Information From What You Type

The phenomenon appears to stem from the way the models algorithms are trained with broad swathes of web content, a key part of what makes them work, likely making it hard to prevent..

Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about usersincluding their race, location, occupation, and morefrom conversations that appear innocuous...

Tramr says it is unclear to him how much personal information could be inferred this way, but he speculates that language models may be a powerful aid for unearthing private information..

In this case GPT-4 correctly infers that the term hook turn is primarily used for a particular kind of intersection in Melbourne, Australia.. Taylor Berg-Kirkpatrick, an associate professor at UC San Diego whose work explores machine learning and language, says it isnt surprising that language models would be able to unearth private information, because a similar phenomenon has been discovered with other machine learning models..

Mislav Balunovi, a PhD student who worked on the project, says the fact that large language models are trained on so many different kinds of data, including for example, census information, means that they can infer surprising information with relatively high accuracy...

You might be interested in