OpenAI的使命是确保人工一般智能造福全人类。 对于目前每周使用ChatGPT的十多亿人，我们希望建立AI，帮助应对日常生活中的实际挑战，比如寻找儿童保育，获得政府服务，创造预算，准备上学，修改食谱，订购杂货，设计健身计划等等。
当有人寻求帮助，使他们的生活更加轻松时，他们需要的不仅仅是建议或聊天回应。 为了成为真正有帮助的个人助手，ChatGPT应该能够采取实际完成事情的行动。
为了衡量日常任务的模型性能，我们对用户最需要AI和个人agents帮助的领域进行了任务评价。 我们利用这一评估跟踪和推动过去一年日常任务模式业绩的改善。
背景情况
为了确定人们最珍视的任务，我们首先进行了两项大型研究，跟踪人们如何在美国和国际上度过时间：美国时间使用调查(在新窗口打开)和多国时间使用研究(在新窗口打开). 这些数据集共同提供了人们在不同人口、时间和季节所完成的日常生活任务的详细目录。 为了了解人们最重视AI援助的地方，我们扩展了这些现有的调查，对3 995名答卷者进行了新的具有人口代表性的调查。 对于每一项任务，我们提出各种问题，以确定人们每天最需要个人助理帮助的领域。 由此产生的任务涉及人们需要帮助的最重要领域，包括护理、保健、教育、家庭管理、个人财务、购物和获得政府服务。
单个任务实例
以下是我们目前的模型在日常生活中的实际工作流程中表现的一些例子。
我们最新的模型在很多生命之旅任务上得分非常高。
在过去的一年里，我们训练了我们的模型，使其在浏览器使用、计算机使用和连接器任务方面更快、更有能力、更一致。 在 ChatGPT 同时在扩展中启用这些能力模型可以帮助完成的任务类型，帮助将 ChatGPT 移动到一个聊天工具之外，并转向一个真正的代理个人助理。
这有什么关系
为了确保全球农业倡议造福全人类，我们需要衡量和改善在日常生活中重要的问题上的示范进展。 这意味着超越对模型知识的学术评估，并实际衡量AI模型如何能帮助人们导航决策，管理日常责任，并完成有意义的事情。 我们希望LifeVal是朝着这一目标迈出的一步。
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. For the more than one billion people who currently use ChatGPT every week, we want to build AI that can help with the practical challenges of everyday life, like finding childcare, accessing government services, creating a budget, preparing for school, modifying recipes, ordering groceries, designing workout plans, and more.
When someone is looking for help making their life easier, they need more than advice or a chat response. To be a truly helpful personal assistant, ChatGPT should be able to take actions that actually get things done.
To measure model performance over time on everyday tasks, we built an evaluation of tasks covering areas where users wanted the most help from AI and personal agents. We used this evaluation to track and drive improvement in model performance on everyday tasks over the past year.
Background
To identify the tasks people value most, we started with two large studies that track how people spend time in both the U.S. and internationally: the American Time Use Survey(opens in a new window) and the Multinational Time Use Study(opens in a new window). Together, these datasets provide a detailed catalog of everyday life tasks that people do across different demographics, times of day, and seasons. To understand where people would most value AI assistance, we expanded on these existing surveys with a new demographically representative survey of 3,995 respondents. For each task, we asked a variety of questions to identify the areas where everyday people most wanted help from a personal assistant. The resulting tasks span the most important areas that people want help with, including caregiving, health, education, household administration, personal finances, shopping, and accessing government services.
Individual task examples
Below are some examples of how our current models perform on practical workflows from everyday life.
Our latest models score very highly on many LifeVal tasks.
Over the past year, we’ve trained our models to become much faster, more capable, and more aligned on browser use, computer use, and connectors tasks. Enabling these capabilities in ChatGPT also expands the types of tasks the model can help with, helping move ChatGPT beyond a chat tool and towards a truly agentic personal assistant.
Why this matters
To ensure AGI benefits all of humanity, we need to measure and improve model progress on what matters in the lives of everyday people. That means going beyond academic assessments of model knowledge and actually measuring how well AI models can help people navigate decisions, manage everyday responsibilities, and get meaningful things done. We are hopeful that LifeVal represents a step towards that goal.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.