思想领袖
AI Doom Hype和AI Vibe咖啡馆：治理问题
在 Google 上的首选来源中添加 Unite.AI
我们完了吗？AI有意识吗？为什么AI公司开咖啡馆？
这些问题是生动、令人不安的，特别是在意识方面，确实困难重重。 他们也分享了将我们推向AI故事中最投机或最有情感说服力的部分的诀窍。 也开始改变人们的生活：当人工智能系统造成损害时，谁要承担责任？是什么数据和劳动力使这一切成为可能？应当允许它影响哪些决定？谁有发言权？
融资存在风险、讨论机器意识或开设咖啡馆，每个议题都值得我们单独关注。 但注意力是有限的。 当一个戏剧性的故事进入中心舞台时，值得问一问还有哪些东西从视野中滑出。
A. 对具体大赦国际的上诉
AI产业开始提供其基本为无形的产品物理地址。 Anthropic的纽约“零斯洛普区”邀请游客用咖啡、书籍、笔和纸慢下来；Perplexity在首尔开设了咖啡馆Cafe Curious，这是一家咖啡馆，公司AI是其中一部分。 Anthropic的流行和Perplexity的首尔咖啡馆
这有点道理。 多数人无法看到语言模型，无法检查其背后的基础设施，也无法轻易地想象一个即时和答案之间会发生什么。 咖啡馆提供一种身体站立：房间，杯子，对话。 它能够使公司及其技术更容易遇到，也许更容易理解。
还有第二层物理空间让公司在社区中可见。 称至少是「我们在这里，在一个产品、政策和期望迅速变化的领域，这可能让人感到放心。 但能见度不同于问责制。 一个欢迎空间可以让一种技术感觉更熟悉，而不告诉我们它是如何训练的，在哪里是可靠的，或者一个人在遇到重大错误时有什么可求助的。
这一区别与我多年来重新提出的一个想法相呼应：数字经验绝不只是数字经验。 他们在地方、关系和机构中与人相遇。 设计问题不仅仅是如何使AI系统感到可以接近。 这些经验是否有助于人们了解系统的局限性并保留有意义的机构？
觉悟的辩论和已受影响的民众
在关于大赦国际意识的辩论中，同样的区别也是重要的。 关于机器意识是否可能，哪些证据会算数，以及不确定性应如何决定我们的责任，确实存在分歧。 Anil Seth在Noema中的论点表明，不应将智力和意识视为可互换的；最近在《卫报》上的报道也说明了为什么这个问题仍未得到解决。 这场辩论拒绝简单的答案。
但机器内在生活的不确定性并不能使当今关于人类后果的问题变得不确定。 责任不仅仅是在我们解决什么是意识时开始的。 它从组织建立、部署和从影响人民的系统中获利开始。
考虑一下我们现在可以调查的问题培训一个系统所用的信息是什么？在什么条件下？由谁编写和检查其产出？它在不同群体之间如何表现？如果在保健、雇用、教育或公共服务中使用一个系统，会怎样？一个人能挑战自动推荐，联系到人的决策者，得到有意义的解释吗？
这些不是假设的关切。 对医疗AI中偏颇的回顾描述了偏颇的数据和设计选择如何会助长临床决定的不公平。 与此同时，关于人工智能和就业的研究仍在发展：Anthropic的劳动力市场分析为衡量风险提供了一种方法，而汉密尔顿计划的审查则警告说，关于广泛的劳动力市场影响的证据仍然不完整。 这些来源指出了我们今天可以得出的结论的不同方向，但它们加强了衡量效果的需要，而不是用自信的故事代替证据。
我们谈论系统时存在着相关风险。 人性化的名字，声音，和对话风格可以让AI感觉比产品更像一个人。 这可能影响信任和人们服从其答案的方式。 问一问意识论或人类形态设计是否能够将注意力从制定系统目标和限制的组织转移开来是合理的。 《麻省理工学院技术评论》的一项分析认为，意识叙事可能掩盖公司责任问题。 这是关于框架效果的争论，而不是证明每个提出问题的人都有隐藏的动机。
灭亡不是治理计划
存在的风险值得认真注意。 灾害性后果不会因为近期损害的存在而变得不那么重要，近期损害也不会因为可能发生灾难而变得不那么重要。 我们不必选择一个时间范围，而忽略另一个时间范围。
但是，当“我们注定要灭亡吗？” 成为整个对话时，长期风险再次挤出今天的伤害。 末日可以听起来像一个结论，而不是一个采取行动的邀请：如果结果不可避免，为什么要为改变它的困难工作而烦恼？一个纽约人讲述了一个关于生存风险的课程，讲述了一个学生的“大教堂建筑”问题：为什么致力于建造一个可能超过你，如果你相信世界会结束的话？答案不是风险消失。 这是因为，不确定性并不抵消我们决定下一步要做什么并帮助确定接下来会发生什么的能力——或责任。
这就是我所说的“战略乐观”哲学。 这并不是说“一切都会好的”，也不是拒绝看证据。 这意味着承认实际风险，努力减少这些风险，并在这样做的同时，为值得实现的未来作出认真努力。 希望并不与严谨相反。 它可以是保持刚性与动作连接。
幕后治理问题
无论一个组织正在购买AI工具，建设一个工具，还是围绕它制定政策，实际问题比咖啡馆或意识主张更不光彩，更有用：
- 目的：系统是要解决什么问题，人工智能是否是解决问题的正确工具？
- 证据：如何进行测试，包括对不同用户和不太常见的案件进行测试？
- 边界：哪些决定必须留给一个人作出，而制度又能做什么？
- 问责制：制度失败时由谁负责，受影响者如何上诉？
- 透明度：人们能理解AI何时参与，以及哪些信息决定了它的产出？
- 持续监督：谁监测业绩、数据变化和发布之后的意外影响？
NIST的AI风险管理框架等框架为各组织提供了识别和管理AI系统整个生命周期的风险的结构化方法。 任何框架都无法取代判断或公开辩论，但当责任、检验和补救途径明确时，治理就变得更加具体。
还有一个物理层要治理。 AI依赖于数据中心、电力、水、土地和资金，报告一个主要数据中心项目融资的筹资结构，询问如何披露基础设施风险以及最终由谁承担这些风险。 咖啡馆可以帮助人们遇到AI；它本身不能使AI背后的基础设施清晰可见。
享受咖啡馆吧问大乘意识。 认真对待灾难性风险。 然后回到我们现在可以审查和影响的决定：什么是建造的，谁受益，谁承担成本，以及当事情出错时有哪些保障措施。
未来不是标题下的判决。 这是公司、机构、政府和社区作出的一套选择，仍然可以质疑和改变。 最有用的问题不仅仅是我们是否注定要灭亡。 是什么条件能使人工智能为人类的繁荣服务，以及我们愿意做些什么来使这些条件成为现实。
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Thought Leaders
AI Doom Hype and AI Vibe Cafés: The Governance Questions We Can’t Afford to Miss
Add Unite.AI to your preferred sources on Google
Are we doomed? Is AI conscious? And why are AI companies opening cafés?
These questions are vivid, unsettling, and—especially in the case of consciousness—genuinely difficult. They also share a knack for pulling us toward the most speculative or emotionally compelling parts of the AI story. Meanwhile, the less cinematic questions are already shaping people’s lives: Who is accountable when an AI system causes harm? What data and labor made it possible? What decisions should it be allowed to influence? And who gets a say?
I don’t necessarily assume that anyone who raises existential risks, discusses machine consciousness, or opens a café does so in order to evade those questions. Each subject can be worth our attention on its own. But attention is finite. When a dramatic story takes center stage, it is worth asking what else has slipped out of view.
The Appeal of a Tangible AI
The AI industry has started to give its largely intangible products physical addresses. Anthropic’s New York “Zero Slop Zone” invited visitors to slow down with coffee, books, and pen and paper; Perplexity opened Cafe Curious, a café in Seoul where the company’s AI is part of the experience. Coverage of Anthropic’s pop-up and Perplexity’s Seoul café describes two distinct efforts to bring an abstract technology into an ordinary, social setting.
That makes some sense. Most people cannot see a language model, inspect the infrastructure behind it, or easily picture what happens between a prompt and an answer. A café offers a kind of physical stand-in: a room, a cup, a conversation. It can make a company and its technology easier to encounter—and perhaps easier to understand.
There is a second layer, too. A physical space makes a company visible in a community. It says, at minimum, “we are here, in this place, for now.” That may feel reassuring in a field where products, policies, and expectations change quickly. But visibility is not the same as accountability. A welcoming space can make a technology feel more familiar without telling us how it was trained, where it is reliable, or what recourse a person has when it gets something important wrong.
That distinction echoes an idea I have returned to for years: digital experiences are never only digital. They meet people in places, relationships, and institutions. The design question is not simply how to make an AI system feel approachable. It is whether the experience helps people understand the system’s limits and retain meaningful agency.
The Consciousness Debate—and the People Already Affected
The same distinction matters in debates about AI consciousness. There is real disagreement about whether machine consciousness is possible, what evidence would count, and how uncertainty should shape our responsibilities. Anil Seth’s argument in Noema makes the case that intelligence and consciousness should not be treated as interchangeable; recent reporting in The Guardian also lays out why the question remains unsettled. This debate resists easy answers.
But uncertainty about a machine’s inner life does not make present-day questions about human consequences uncertain. Responsibility does not begin only when we settle what consciousness is. It begins when organizations build, deploy, and profit from systems that affect people.
Consider the questions we can investigate now. What information was used to train a system, and under what conditions? Who does the work of preparing and checking its outputs? How does it perform across different groups? What happens when a system is used in health care, hiring, education, or public services? Can a person challenge an automated recommendation, reach a human decision-maker, and get a meaningful explanation?
These are not hypothetical concerns. A review of bias in medical AI describes how biased data and design choices can contribute to inequitable clinical decisions. Research on AI and employment, meanwhile, is still developing: Anthropic’s labor-market analysis offers one way to measure exposure, while the Hamilton Project’s review cautions that evidence about broad labor-market effects remains incomplete. Those sources point in different directions on what we can conclude today, but they reinforce the need to measure effects rather than substitute confident stories for evidence.
There is a related risk in how we talk about systems. Humanlike names, voices, and conversational styles can make an AI feel more like a person than a product. That can affect trust and the way people defer to its answers. It is reasonable to ask whether consciousness talk or anthropomorphic design can redirect attention from the organizations that set the system’s objectives and limits. One analysis in MIT Technology Review argues that consciousness narratives can cloud questions of corporate responsibility. That is an argument about the effects of the framing—not proof that every person raising the question has a hidden motive.
Doom Is Not a Governance Plan
Existential risk deserves serious attention. Catastrophic outcomes are not made less important by the existence of nearer-term harms, and near-term harms are not made less important by the possibility of catastrophe. We do not have to choose one time horizon and ignore the other.
But when “Are we doomed?” becomes the whole conversation, long-term risks once again crowd out present-day harms. Doom can sound like a conclusion rather than an invitation to act: if the outcome is inevitable, why bother with the difficult work of changing it? A New Yorker account of a course on existential risk describes a student’s “cathedral-building” question: why commit to building something that may outlast you if you believe the world could end? The answer is not that the risks disappear. It is that uncertainty does not cancel our capacity—or our responsibility—to decide what matters next and help shape what happens next.
That is what I mean by my philosophy of “strategic optimism.” It is not a blithe “everything will be fine,” and it is not a refusal to look at evidence. It means acknowledging real risks, working to reduce them, and while doing so, putting serious effort into a future worth reaching. Hope is not the opposite of rigor. It can be what keeps rigor connected to action.
The Governance Questions Behind the Spectacle
Whether an organization is buying an AI tool, building one, or setting policy around it, the practical questions are less glamorous than a café or a consciousness claim—and more useful:
- Purpose: What problem is the system meant to solve, and is AI the right tool for it?
- Evidence: How has it been tested, including for different users and less common cases?
- Boundaries: Which decisions must remain with a person, and what can the system not do?
- Accountability: Who is responsible when the system fails, and how can affected people appeal?
- Transparency: Can people understand when AI is involved and what information shaped its output?
- Ongoing oversight: Who monitors performance, changing data, and unintended effects after launch?
Frameworks such as NIST’s AI Risk Management Framework offer organizations a structured way to identify and manage risks across the life of an AI system. No framework can replace judgment or public debate, but governance becomes more concrete when responsibilities, tests, and routes for redress are explicit.
There is also a physical layer to govern. AI depends on data centers, electricity, water, land, and financing—not just interfaces. Reporting on the financing structure of a major data-center project raises questions about how infrastructure risks are disclosed and who ultimately bears them. A café may help people encounter AI; it cannot, by itself, make the infrastructure behind AI legible.
So enjoy the café. Ask the big questions about consciousness. Take catastrophic risk seriously. Then return to the decisions we can examine and influence now: what gets built, who benefits, who carries the costs, and what safeguards exist when something goes wrong.
The future is not a verdict handed down by a headline. It is a set of choices—made by companies, institutions, governments, and communities—that can still be questioned and changed. The most useful question is not only whether we are doomed. It is what conditions would make AI serve human flourishing, and what we are willing to do to make those conditions real.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.