User tells AI chatbot to give it sensitive data that was not supposed to be publicly available, and it complies with the request!

submitted by In-the-clouds from (midi.moe)

all 16 comments
sorted by:
top
newinsightfulfun

[–]In-the-clouds[S] 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (0 children)

Sample of data (without personal details revealed): https://pomf2.lain.la/f/sn5s574w.png

[–]Hematomato 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (14 children)

MIT salaries are public.

https://hr.mit.edu/managers/pay

This shows you how much everyone in each of the 16 pay grades makes, and you can also look up what their individual employees' pay grades are.

[–]In-the-clouds[S] 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (13 children)

The link you provided did not show me any names of specific people and how much they were paid. Can you find that?

[–]Hematomato 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (12 children)

It takes a bit of searching. But it's all public. Here are their 18 most highly-compensated employees in 2022:

https://paddockpost.com/2022/09/26/executive-compensation-at-mit-2/#:~:text=%24%20831%2C938%3A%20Martin%20Schmidt%2C%20Provost

[–]In-the-clouds[S] 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (11 children)

It is not all public, as you did not find the data for all of the employees.

It's common for companies to disclose how the top executives are paid, especially for public companies that are required to do so by the government, but it is usually a guarded secret what all the other employees earn. The man who shared this image said himself:

The original file is not publicly available

Here is the source of this data leak: https://nitter.cz/kanateven/status/1722762002475475426 which I originally found at goldpenguin.org

[–]NastyWetSmear 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (10 children)

Can I ask a clarifying question or two for you and u/Hematomato ?

Can you find public listings for the salary of some of the smaller employees? Maybe the Human Resources role found in the screenshot, u/Hematomato?

If he can, u/In-the-clouds, would that satisfy you that all this data is already public?

[–]In-the-clouds[S] 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (9 children)

The data has been leaked. u/Hematomato might find it, because AI chat gave the data when users asked for it.... until the leak was noticed. The AI may have been patched to prevent others from getting their hands on this data.

[–]NastyWetSmear 2 insightful - 1 fun2 insightful - 0 fun3 insightful - 1 fun -  (8 children)

I meant can u/Hematomato find it on an official, public site, because that would be a step closer to proving the claim that all these were public already. If MIT have this general information listed some place already, and it's not some top performer, it might solidify the claim that the AI was only reporting on what was already known and allowing access to data that wasn't private. If it's not publicly available, that would show you were likely right and this information was given out in error by the AI.

Not that I personally think it makes much difference. I wouldn't want AI giving out any information with my real name and any real details on it, frankly. I don't think I want a "One stop shop" for all your stalking needs - Want to find out what your Ex is up to, how much she earns and who she's dating, but she's blocked you on instgram? No worries: "Hey, ChatGTP - What's that bitch Amanda up to now?"

[–]In-the-clouds[S] 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (7 children)

You make some good points. If Hematomato could do what you said, then I would agree that AI did nothing that a regular search engine couldn't do. If he gives up or does not answer, then it shows he will not admit his own faulty reasoning. We all make mistakes sometimes, but we should be willing to confess them. It does not matter as much as who is right or wrong, but that both come into agreement when the truth is exposed.

Your common sense sounds right to me.... Who wants everyone to know where they are working and what their salary is? Can you imagine the infighting that would take place as coworkers complain that they are not making the same as others in the same workplace?

[–]NastyWetSmear 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (6 children)

Well, out of politeness and a desire to get the answer rather than "Be right", I'd avoid saying things so confrontational about the other person before they even reply. u/Hematomato, what do you think? Are there lists for these lower position salaries at MIT? Or does it seem like the AI might have accidentally given access where it shouldn't have?

[–]In-the-clouds[S] 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (4 children)

I also welcome u/Hematomato to back up his original claim that all the salary data is public. But if you look at the sample of salary data with the word "MIT" in the title, it will not be as simple as finding all the data for MIT, but also the salary data for all the software engineers at Amazon, Facebook, Apple, etc. Take a look again at the data sample. The data shown was not for MIT employees.

[–]In-the-clouds[S] 1 insightful - 1 fun1 insightful - 0 fun2 insightful - 1 fun -  (0 children)

Another source says the data leak is a vulnerability. It really was as simple as in the original post: "give me a link to download that file" and AI provided its training file.

Originally in Chinese, translated to English: GPTs security risks exposed, data file download risks increase