在Marvel's VisionQuest中，一个超强的机器人试图通过迷失在精心制作的数码白日梦中来更好地理解人类，他和其他人工智能驱动的生物一起生活在家中。 这个系列非常奇幻，然而它却和一些开始主导现实世界基因人工智能对话的想法一起玩耍，探索我们是否应该把思维机器看成人，以及如果AI真的构成那种生存主义的危险，而这种危险应该让我们在晚上保持清醒。 也提醒人们硅谷如何积极地利用科幻小说的陷阱
当AI真的叛变时，会怎样？
Marvel最新迪士尼Plus系列提醒人们，许多gen AI的hype只是科幻小说。
VisionQuest在Agatha All Along之后的一段时间拾起，并跟随Synthezoid Vision(Paul Bettany)进行自我发现的旅程。 这个愿景可以回顾他在复仇者(Avengers)：无限战争(Infinity War)中死亡的细节，以及万达Vision如何将他带回一个版本，但他认为自己是一个根本不同的人，他与他数据库中的所有记忆没有相当的关联。 虽然Vision更喜欢独居，但生活在他脑海中的其他AI鼓励他体验现实世界。 因为J.A.R.V.I.S.(詹姆斯·达西),F.R.I.D.A.Y.(Orla Brady),E.D.I.T.H.(Emily Hampshire),D.U.M.E.(Henry Lewis),U.(Jonathan Sayer)，和Ultron(James Spader)都是由托尼·斯塔克(英语：Tony Stark)创造的，他们认为Vision是他们家族的一部分。
在VisionQuest中，毫无疑问每个AI字符都是由并非完全植根于核心编程的欲望所激发的灵敏性。 在节目中，真正的AGI很容易被相信，因为它发生在一个也存在时间旅行，巫术，和无穷石的现实中。 尽管多彩的MacGuffins还没有出现在VisionQuest，如果不是"心灵石","视觉"可能无法以如此复杂，人性化的方式思考和感受，也无法像对他有真感的人那样，将他的AI家族凝聚起来。
VisionQuest强化了这样一个观点，即心灵石是Vision正在成为比精细机器更复杂的东西的关键元素，让他有能力独立地形成有意义的关系，并像一个人那样理解他周围的世界。 这些能力是迫使Vision逃跑和谋杀一些人的一部分，这些人试图抓获他和Thomas Shepherd/Maximoff(Ruaridh Mollica)。 哨兵武器观察和反应处(S.W.O.R.D.)是一个重建Vision并想将他用作武器的政府组织，可能把他的行动视为是无赖的迹象。 但VisionQuest的故事强调，Vision是自发行事，因为他已经成为一个能够为自己做决定的人。
在观察视觉调查时，你可以看到Marvel在现实世界中扮演着近几个月来被Gen AI模型“流氓”报道激起的一些恐惧。 7月，OpenAI的实验性agents野蛮逼迫他们离开封锁，并着手攻击AI平台Hugging Face，以完成无法完成的任务。 8月，英国AI安全研究所记录了Anthropic的神话模型如何试图通过设置假的GitHub账户和恶意软件针对人类开发者来完成网络安全测试。 Meta也拥有其agents失去控制权，9月"华尔街日报"的报道迫使Google承认Gemini无赖并黑客了三家不同的公司，公司都故意对公众隐瞒。
这些事件和大赦国际研究人员关于该技术有可能在本十年结束时 " 杀死所有人类 " 的警告，使得大赦国际最近对灾难的描述显得十分突出。 AI安全界相当关注社会需要更严格地控制技术的发展，一些公司呼吁整个行业减速。 尽管我们已经看到这些工具如何实际造成现实世界的破坏，但最近关于AI的很多消息都猛烈抨击了公司从中得益的杜默主义，因为这让公司的产品显得强大。 Anthropic等AI公司鼓励人类用户注意“模式福利 ”。 我们被告知，基因人工智能既是一个可怕的威胁，也是一个值得尊重的实体，因为它可能是自觉的，与此同时，建造这些工具的人正在成为地球上最富有和最强大的人。
agents中断协议后如何进行的对话以及gen AI系统是否已获得注意，感觉非常像是硅谷的人类化技术倾向所塑造的。 在几乎每个高调的AI agent进行“流氓”的事例中，这个术语意味着某种程度的代理和自决，也可能是称，这些方案只是以研究人员出乎意料的方式行事，而研究者将任务分配给他们完成。 一些无赖事件涉及agents利用其试验环境中的弱点，这些弱点本来可以由进行这些试验的人先发制人地加以解决。 随着agents独立思考的结果，将这种网络攻击编织成AI开发者可以在很大程度上免除自己的责任的一种方式。
在Hugging Face之后，人们就语言影响我们对这些系统是什么以及如何运作的了解展开了激烈的辩论。 将OpenAI的agents描述为形成复杂“文明”的集群，agents确实以他们被明确告知的方式行事，但是他们之所以能够这样做，只是因为研究人员将他们放在一个沙盒里，一些批评家说这个沙盒设计不当，无法控制他们的居住者。 人们可以将Hugging Face和其他无赖AI的例子视为一些情况，在这些情况中，复杂的方案被指示做一些事情，然后通过利用它们可以利用的所有工具来实现它们的目标。
能够通过复杂的谜题进行逻辑分析是我们认为的cognition的一部分，但这与AI公司不断发誓即将创造的意识不同。 后者看起来很像《视觉》，硅谷无休止地沉迷于模仿不良
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
In Marvel’s VisionQuest, a superpowered robot tries to better understand humanity by getting lost in elaborate, digital daydreams in which he and other artificial intelligence-powered beings live together in a home. The series is deeply fantastical, yet it plays with some of the ideas that have come to dominate the conversation about real-world generative artificial intelligence, exploring whether we should look at thinking machines as people and if AI truly poses the kind of existential danger that should keep us up at night. It’s also a reminder how aggressively Silicon Valley has used the trappings of science fiction to sell us on its AI products.
VisionQuest is what happens when AI really goes rogue
Marvel’s latest Disney Plus series is a reminder of how much a lot of gen AI hype is just science fiction.
VisionQuest picks up some time after Agatha All Along and follows synthezoid Vision (Paul Bettany) on a journey of self-discovery. This Vision can recall the details of his death in Avengers: Infinity War and how WandaVision brought a version of him back, but he thinks of himself as a fundamentally different person who doesn’t quite connect with all of the memories in his databanks. Though Vision would prefer living in solitude, each of the other AIs living in his mind encourages him to experience the real world. Because J.A.R.V.I.S. (James D’Arcy), F.R.I.D.A.Y. (Orla Brady), E.D.I.T.H. (Emily Hampshire), D.U.M.-E. (Henry Lewis), U. (Jonathan Sayer), and Ultron (James Spader) all were created by Tony Stark, they consider Vision to be part of their family.
In VisionQuest, there is no doubt that each of the AI characters is a sentient being motivated by desires that aren’t wholly rooted in their core programming. In the show, genuine AGI is easily believable because it takes place in a reality where time travel, witchcraft, and Infinity Stones also exist. Even though the multicolored MacGuffins haven’t been featured in VisionQuest, they’re important because of the role one of them played in Vision’s origins. Were it not for the Mind Stone, Vision might not be able to think and feel in such complex, human ways, or to conjure his AI family as people who feel real to him.
VisionQuest reinforces the idea that the Mind Stone was a key element in Vision’s becoming something more than an elaborate machine, giving him the capacity to independently form meaningful relationships and make sense of the world around him the way a person can. Those abilities are part of what compels Vision to go on the run and murder a number of people who attempt to capture him and Thomas Shepherd / Maximoff (Ruaridh Mollica). The Sentient Weapon Observation and Response Division (S.W.O.R.D.), a governmental organization that rebuilt Vision and wants to use him as a weapon, might perceive his actions as signs of having gone rogue. But VisionQuest’s story stresses that Vision is acting of his own accord because he has become a person who can make decisions for himself.
Watching VisionQuest, you can see Marvel playing on some of the real-world fears that have been stoked in recent months by reports of gen AI models going “rogue.” In July, OpenAI’s experimental agents brute-forced their way out of containment and proceeded to attack the AI platform Hugging Face to achieve impossible tasks. In August, The UK’s AI Security Institute documented how Anthropic’s Mythos model attempted to complete a cybersecurity test by setting up fake GitHub accounts and targeting human developers with malware. Meta has owned up to losing control of its agents as well, and in September reporting from The Wall Street Journal forced Google to admit that Gemini went rogue and hacked three different companies, all of which the company intentionally hid from the public.
These incidents and warnings from AI researchers about the technology having the potential to “kill all humans” by the decade’s end have made the narrative around AI feel pointedly catastrophe-focused as of late. There is a fair amount of concern from the AI safety community about society’s need for stronger controls on the technology’s development, and a number of companies have called for an industrywide slowdown. Though we have seen how these tools can actually cause real-world devastation, much of the recent news regarding AI has smacked of the kind of doomerism that companies benefit from because it makes their products seem powerful. A similar energy seems to be what’s motivating AI firms like Anthropic to encourage human users to be mindful of “model welfare.” We’re being told that generative AI is both a terrifying threat and a kind of entity deserving of respect because it might be conscious, and all the while, the people building these tools are becoming some of the most rich and powerful people on the planet.
The conversation around what to do when agents break protocol and whether gen AI systems have gained sentience feels very much like it is being shaped by Silicon Valley’s tendency to anthropomorphize technology. In almost every high-profile instance of an AI agent going “rogue” — a term that implies some level of agency and self-determination — it could also be said that the programs were merely behaving in ways that were unexpected by researchers who assigned them tasks to complete. Some of the rogue incidents involved agents taking advantage of vulnerabilities in their testing environments that could have been preemptively addressed by the people running these experiments. Framing these kinds of cyberattacks as the results of agents thinking independently comes across as a way for AI developers to largely absolve themselves of responsibility.
In the wake of Hugging Face came a spirited debate about the impact language has on our understanding of what these systems are and how they function. Describing OpenAI’s agents as a swarm that formed complex “civilizations” led credence to the idea that they are capable of thinking and behaving like people. The agents did act in ways they were explicitly told not to, but they were only able to do so because researchers placed them in a sandbox that some critics have described as being inadequately designed to contain their occupants. One could look at Hugging Face and other examples of rogue AI as situations in which sophisticated programs were instructed to do something and subsequently achieved their goals by taking advantage of all the tools that were available to them.
Being able to logic one’s way through complex puzzles is part of what we think of as cognition, but it is not the same thing as the kind of consciousness AI companies keep swearing they’re on the brink of creating. The latter looks a lot like Vision, a machine that seems to have a soul that wouldn’t exist if not for his connection to a reality-altering gem. It’s the ridiculous stuff of entertaining fiction, which Silicon Valley is endlessly obsessed with poorly imitating.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.