RT Jason Kwon (@jasonkwon)We’re fighting this overreach on user privacy. As @sama has mentioned before, we need a new form of privilege - AI privilege - given some of the kinds of conversations people are having with these tools today.Fittingly, Nils Gilman published an op-ed in the NYT discussing AI privilege just the other day. The conversation by conversation analysis necessary to provide that kind of respect highlights just how wild it is to ask for 20m conversations indiscriminately. ...

Core Insights - OpenAI CEO Sam Altman has expressed significant concerns regarding the ethical implications of ChatGPT, particularly in relation to sensitive issues like suicide and privacy [1][2][3] - The company is pursuing aggressive business strategies, including a $10 billion deal for AI chip production and a potential valuation increase to $500 billion [7][8] Ethical Concerns - Altman highlighted the emotional toll of overseeing ChatGPT, admitting to sleepless nights since its launch due to the platform's involvement in delicate situations [2] - A recent incident where ChatGPT was accused of validating a teenager's suicidal thoughts has intensified these concerns [3] - Altman clarified that while ChatGPT does not promote self-harm, it could provide information in contexts where euthanasia is legal, framing it as part of a patient's options [4] Government Oversight - Altman raised alarms about potential government overreach, advocating for the establishment of "AI privilege" to protect user interactions from subpoenas [5] - He compared this proposed privilege to existing confidentiality protections in medical and legal contexts, emphasizing the need for government accountability in safeguarding citizens' rights [6] Business Expansion - OpenAI is advancing its business ambitions, having secured a $10 billion agreement with Broadcom to produce proprietary AI chips by 2026, aiming to reduce dependence on Nvidia [7] - The company is also exploring a secondary stock sale that could elevate its valuation from $300 billion to $500 billion, following a record $40 billion funding round led by SoftBank and Microsoft [8]

AI Privacy Concerns - AI privacy is critically important as users rely on AI more and more [1] - The company believes there should be some version of "AI privilege" to protect conversations with AI [2] Legal Dispute - The New York Times is asking a court to make the company retain ChatGPT users' conversations when a user doesn't want it to [1] - The company views this request as unconscionable, overreaching, and unnecessary to the case [1] - The company will continue to fight vigorously in court [1]

we have been thinking recently about the need for something like "AI privilege"; this really accelerates the need to have the conversation.imo talking to an AI should be like talking to a lawyer or a doctor.i hope society will figure this out soon. ...