{"id":14969,"date":"2026-11-19T18:44:29","date_gmt":"2026-11-19T13:14:29","guid":{"rendered":"https:\/\/www.salesforce.com\/?p=14969"},"modified":"2026-11-19T18:44:38","modified_gmt":"2026-11-19T13:14:38","slug":"visual-ai-assistants-ivg-lessons","status":"publish","type":"post","link":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/","title":{"rendered":"For AI Advice to Be Any Good, It Has to Actually Change the Outcome"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\">A technician kneels beside a commercial water heater, phone propped against a pipe, an <a href=\"https:\/\/www.salesforce.com\/in\/agentforce\/ai-assistant\/\" target=\"_blank\" rel=\"noreferrer noopener\">AI assistant<\/a> watching through the camera. She reaches for the wrong valve and the assistant says, \u201cStop, that\u2019s the supply line.\u201d Whether that counts as useful guidance depends entirely on what happens next. Did the warning arrive in time to prevent an incorrect action? Did she trust it? Did it confuse her about the next step?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Those questions are about to matter much more. AI assistants are leaving the chat window and becoming real-time guides for physical work, watching live video and instructing people through multistep tasks.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The frontier moved quickly this year. In May, <a href=\"https:\/\/thinkingmachines.ai\/blog\/interaction-models\/\" target=\"_blank\" rel=\"noreferrer noopener\">Thinking Machines<\/a> previewed interaction models that continuously take in audio, video, and text and respond in real time, rather than waiting for a user to finish a turn. In June, <a href=\"https:\/\/arxiv.org\/abs\/2606.04970\" target=\"_blank\" rel=\"noreferrer noopener\">Meta<\/a> researchers released a wearable video dataset for proactive procedural assistance, annotated for moments when users go off plan and how to recover. <a href=\"https:\/\/arxiv.org\/abs\/2604.27393\"><\/a>In September, <a href=\"https:\/\/blog.google\/innovation-and-ai\/models-and-research\/gemini-models\/gemini-3-8-live-gemini-3-8-live-extended-thinking\/\" target=\"_blank\" rel=\"noreferrer noopener\">Google introduced Gemini 3.8 Live<\/a>, combining real-time visual understanding, spoken conversation, and the ability to work on tasks in the background.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But there\u2019s a catch: Most evaluations of visual assistants replay prerecorded video and grade responses against an answer key. That tells you whether a warning was correct. It can\u2019t tell you whether the warning worked, because a recording can\u2019t react.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">So <a href=\"https:\/\/www.salesforce.com\/ai-research\/\" target=\"_blank\" rel=\"noreferrer noopener\">Salesforce AI Research<\/a> built <a href=\"https:\/\/interactive-visual-gym.salesforceairesearch.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">Interactive Visual Gym<\/a>, a simulated proving ground where AI assistants coach virtual workers that can react to instructions. That way, researchers can see whether the advice actually changes the outcome, develop benchmarks, and ultimately improve these visual assistants.<\/p>\n\n\n\n<h2 id=\"h-the-feedback-loop-of-a-live-trial-but-at-scale\" class=\"wp-block-heading\"><strong>The feedback loop of a live trial, but at scale<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">A leader deciding whether to give a visual AI assistant to frontline teams wants to know if those teams are more likely to finish the job, and finish it correctly, with the assistant than without it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The obvious approach is to test with real people, but that doesn\u2019t scale. Knowing whether an assistant reliably helps technicians would take thousands of training runs with people of different skill levels, making different mistakes at different moments. Recruiting that many participants for every device and procedure would be slow and prohibitively expensive. What\u2019s needed is the feedback loop of a live trial at the scale of a dataset.<br><br>That\u2019s what Interactive Visual Gym provides. IVG recreates everyday physical tasks like cooking or managing smartphone settings. It pairs each task with a simulated user performing the task while receiving guidance from the visual AI assistant. The simulated user\u2019s actions and the simulated environment change in response to this guidance.<br><br>In a kitchen environment, for example, a simulated cook works through a recipe like assembling a burger: one bun, then the patty, then the cheese. If it grabs the wrong ingredient, the AI assistant watching has to catch the mistake in time so the cook can react to whatever it says.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Three design choices make IVG practical. First, the AI assistants speak in natural language (\u201cgo to the pan with the meat\u201d), not in the joint velocities and degree coordinates of classical robotics simulators. Second, we can schedule out-of-plan moments at precise points in a task while keeping the user\u2019s dialogue consistent with its behavior. These include mistakes, mid-task plan changes, questions, and reminder requests. Third, simulated users vary along four axes: skill, trust in AI, preferred execution speed, and tolerance for interruption. A seasoned user who wants to be left alone and a novice who wants every step spelled out need very different help.<\/p>\n\n\n\n<figure class=\"wp-block-embed aligncenter is-type-video is-provider-vidyard wp-block-embed-vidyard\"><div class=\"wp-block-embed__wrapper\">\n<script type=\"text\/javascript\" async src=\"https:\/\/play.vidyard.com\/embed\/v4.js\"><\/script><img decoding=\"async\"  style=\"width: 100%; margin: auto; display: block;\"  class=\"vidyard-player-embed\"  src=\"https:\/\/play.vidyard.com\/Ztu6HDz8b7WwNNcpuqLJXz.jpg\"  data-uuid=\"Ztu6HDz8b7WwNNcpuqLJXz\"  data-v=\"4\"  data-type=\"inline\"  data-width=\"500\"  data-height=\"281\"\/>\n<\/div><\/figure>\n\n\n\n<aside class=\"more-from-block more-from-block--2 alignfull wp-block-newsroom-moreontopic\">\n\t<div class=\"more-from-block__content\">\n\t\t\t\t\t<h4 class=\"more-from-block__title\">Related<\/h4>\n\t\t\n\t\t<div class=\"more-from-block__cards more-from-block__cards--2\"\n\t\t\t\t>\n\t\t\t\n\n<article\t\t\tdata-card-id=\"14538\"\n\t\tclass=\"content-card content-card--large-inline is-entire-area-clickable content-card--is-boxed\"\n\t\t\tdata-clickable-area-link=\"https:\/\/www.salesforce.com\/in\/news\/linked-content\/salesforce-delivers-record-second-quarter-fiscal-2027-results\/\"\n\t>\n\t\t\t<div class=\"content-card__image-container\" itemprop=\"image\" itemscope itemtype=\"https:\/\/schema.org\/ImageObject\">\n\t\t\t<img width=\"1024\" height=\"576\" src=\"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=1024\" class=\"content-card__image\" alt=\"\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" loading=\"lazy\" decoding=\"async\" srcset=\"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg 1200w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=300&amp;h=169 300w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=768&amp;h=432 768w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=1024&amp;h=576 1024w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=264&amp;h=149 264w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=500&amp;h=281 500w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=150&amp;h=84 150w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=314&amp;h=177 314w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2024\/08\/FY25Q2-newsroom-tile-1200x675-1.jpg?w=343&amp;h=193 343w\" \/>\t\t\t\t\t<\/div>\n\t\n\t<div class=\"content-card__content-container content-card__content-container--style-\">\n\t\t\n\t\t\n\t\t\t\t\t<h3 itemprop=\"headline\" class=\"content-card__title\">\n\t\t\t\t\t\t\t\t\t<a\n\t\t\t\t\t\thref=\"https:\/\/www.salesforce.com\/in\/news\/linked-content\/salesforce-delivers-record-second-quarter-fiscal-2027-results\/\"\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\ttarget=\"_blank\"\n\t\t\t\t\t\t\t\t\t\t\t\tclass=\"content-card__title-link\"\n\t\t\t\t\t>\n\t\t\t\t\t\t\t\tSalesforce Delivers Record Second Quarter Fiscal 2027 Results\t\t\t\t<\/a>\t\t\t<\/h3>\n\t\t\n\t\t\t\t\n\t\t\n\t\t\n\t\t\t<\/div>\n\n<\/article>\n\n\n\n<article\t\t\tdata-card-id=\"13827\"\n\t\tclass=\"content-card content-card--large-inline is-entire-area-clickable content-card--is-boxed\"\n\t\t\tdata-clickable-area-link=\"https:\/\/www.salesforce.com\/in\/news\/press-releases\/2026\/05\/29\/chhattisgarh-infotech-promotion-society-deploy-mulesoft-digital-dwaar-api-platform\/\"\n\t>\n\t\t\t<div class=\"content-card__image-container\" itemprop=\"image\" itemscope itemtype=\"https:\/\/schema.org\/ImageObject\">\n\t\t\t<img width=\"1024\" height=\"576\" src=\"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=1024\" class=\"content-card__image\" alt=\"canva\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" loading=\"lazy\" decoding=\"async\" srcset=\"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png 1200w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=300&amp;h=169 300w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=768&amp;h=432 768w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=1024&amp;h=576 1024w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=264&amp;h=149 264w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=500&amp;h=281 500w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=150&amp;h=84 150w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=314&amp;h=177 314w, https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/05\/Copy-of-PRNewsroom-Misc-Tiles-1200x675-4.png?w=343&amp;h=193 343w\" \/>\t\t\t\t\t<\/div>\n\t\n\t<div class=\"content-card__content-container content-card__content-container--style-\">\n\t\t\n\t\t\n\t\t\t\t\t<h3 itemprop=\"headline\" class=\"content-card__title\">\n\t\t\t\t\t\t\t\t\t<a\n\t\t\t\t\t\thref=\"https:\/\/www.salesforce.com\/in\/news\/press-releases\/2026\/05\/29\/chhattisgarh-infotech-promotion-society-deploy-mulesoft-digital-dwaar-api-platform\/\"\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\ttarget=\"_blank\"\n\t\t\t\t\t\t\t\t\t\t\t\tclass=\"content-card__title-link\"\n\t\t\t\t\t>\n\t\t\t\t\t\t\t\tCHiPS Collaborates with Salesforce to Power Chhattisgarh&#8217;s Digital Dwaar, Transforming Connected, Citizen-Centric Digital Governance\t\t\t\t<\/a>\t\t\t<\/h3>\n\t\t\n\t\t\t\t\n\t\t\n\t\t\t\t\t<div itemprop=\"readTime\" class=\"content-card__read-time\">\n\t\t\t\t3 min read\t\t\t<\/div>\n\t\t\n\t\t\t<\/div>\n\n<\/article>\n\n\t\t<\/div>\n\t\t<noscript>\n<div class=\"pagination-fallback\">\n\n\t\t<a href=\"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/posts\/14969\/page\/2\/?bc=OTH#section-title\">\n\t\t\tOlder Posts\t\t<\/a>\n\t\t<\/div>\n<\/noscript>\n\t<\/div>\n<\/aside>\n\n\n\n<h2 id=\"h-what-today-s-assistants-get-wrong-and-how-ivg-can-help\" class=\"wp-block-heading\"><strong>What today\u2019s assistants get wrong, and how IVG can help<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Using IVG, we built IVG-Bench: 315 scenarios across three environments, used to evaluate 15 assistants each running on a different model. The strongest, running on Gemini 4 Argon, completed only 53.4% of tasks within the time limit, averaged across environments, and open-weight models generally trailed the leading frontier models. This is still a challenging benchmark to achieve.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Our dynamic evaluation exposes several problems with AI visual assistants. The first is that a model can help users finish more often but might actually give clumsier advice along the way, so we need two metrics to measure capability: task success and interaction quality. The second is that dynamic testing exposes failures that static tests miss. Latency turns correct advice into stale advice. Telling the user to approach the table after the user has already arrived there is pointless. Some assistants repeat instructions the user has already acknowledged. For some open-weight models, guidance degrades as the task goes on.&nbsp;<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To check that our simulation-based scores reflect real experience, we had people control the cook in the simulator, work with different assistants, and rank them. When people preferred one assistant over another, our automated interaction-quality score from the simulation corresponded to their preference 78.5% of the time. Real people and simulated users also behaved similarly, with one difference: Simulated users speak and reply far more often.<br><br>Our simulated environments can also actively improve the performance of visual assistants. In an early proof of concept, we used the simulator to train an open-source model, incentivizing it to prioritize task completion and error prevention. The model\u2019s success rate improved and the assistant became noticeably better at delivering the right advice at the right time, stepping in proactively before mistakes happened.<\/p>\n\n\n\n<h2 id=\"h-what-this-means-for-leaders\" class=\"wp-block-heading\"><strong>What this means for leaders<\/strong><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Ultimately, real-time visual assistants will be judged by outcomes. Before deploying one, ask three things: Does it measurably help people finish the task? Does its guidance arrive while it can still change the outcome? Does it hold up deep into a long job, or when the user goes off script? Answering those questions means testing the interaction itself, in environments where advice has consequences. That\u2019s what Interactive Visual Gym is built to do.<\/p>\n\n\n\n<h5 id=\"h-go-deeper\" class=\"wp-block-heading\">Go deeper:<\/h5>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Explore the project and <a href=\"https:\/\/interactive-visual-gym.salesforceairesearch.com\/\" target=\"_blank\" rel=\"noreferrer noopener\">interactive demonstrations<\/a><\/li>\n\n\n\n<li>Read more about the <a href=\"https:\/\/www.salesforce.com\/blog\/interactive-visual-gym\/\" target=\"_blank\" rel=\"noreferrer noopener\">Interactive Visual Gym<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Real-time AI video assistants need a new kind of test. Here\u2019s how we built the necessary proving ground.<\/p>\n","protected":false},"author":763,"featured_media":14970,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"sf_subhead":"","sf_i18n_disclaimer":true,"_jetpack_hide_featured_image":false,"_jetpack_featured_image_duplicate_dismissed":0,"_jetpack_memberships_contains_paid_content":false,"alternateThumbnailId":0,"sf_product_cta_id":0,"sf_show_toc":false,"footnotes":""},"categories":[2868],"tags":[],"sf_content_type":[1199],"sf_theme":[2819],"sf_topic":[2836,2802,2820],"sf_product":[],"sf_industry":[],"sf_role":[],"sf_multimedia_asset":[],"sf_location":[1189],"sf_collection":[1186],"sf_visibility":[],"coauthors":[2838],"class_list":["post-14969","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","sf_content_type-snapshot-opinion","sf_theme-agentic-ai","sf_topic-agentic-enterprise","sf_topic-agents","sf_topic-ai","sf_location-apac","sf_collection-research"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v28.2 (Yoast SEO v28.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Visual AI Assistants: How to Test If They Really Help - Salesforce<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"For AI Advice to Be Any Good, It Has to Actually Change the Outcome\" \/>\n<meta property=\"og:description\" content=\"Real-time AI video assistants need a new kind of test. Here\u2019s how we built the necessary proving ground.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/\" \/>\n<meta property=\"og:site_name\" content=\"Salesforce\" \/>\n<meta property=\"article:published_time\" content=\"2026-11-19T13:14:29+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-11-19T13:14:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/11\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1201\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Megan Castellucci\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Megan Castellucci\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/\"},\"author\":[{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/#\\\/schema\\\/person\\\/c6183ae5ada57df0dcbe7a9f23ea41e7\"}],\"headline\":\"For AI Advice to Be Any Good, It Has to Actually Change the Outcome\",\"datePublished\":\"2026-11-19T13:14:29+00:00\",\"dateModified\":\"2026-11-19T13:14:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/\"},\"wordCount\":1007,\"image\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/wp-content\\\/uploads\\\/sites\\\/20\\\/2026\\\/11\\\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg\",\"articleSection\":[\"Uncategorized\"],\"inLanguage\":\"en-IN\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/\",\"url\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/\",\"name\":\"Visual AI Assistants: How to Test If They Really Help - Salesforce\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/wp-content\\\/uploads\\\/sites\\\/20\\\/2026\\\/11\\\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg\",\"datePublished\":\"2026-11-19T13:14:29+00:00\",\"dateModified\":\"2026-11-19T13:14:38+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/#\\\/schema\\\/person\\\/c6183ae5ada57df0dcbe7a9f23ea41e7\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/#breadcrumb\"},\"inLanguage\":\"en-IN\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-IN\",\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/wp-content\\\/uploads\\\/sites\\\/20\\\/2026\\\/11\\\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg\",\"contentUrl\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/wp-content\\\/uploads\\\/sites\\\/20\\\/2026\\\/11\\\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg\",\"width\":1201,\"height\":675,\"caption\":\"Illustration of an AI chat window with the text \\\"How can I help you today?\\\"\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/visual-ai-assistants-ivg-lessons\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"For AI Advice to Be Any Good, It Has to Actually Change the Outcome\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/#website\",\"url\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/\",\"name\":\"Salesforce\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-IN\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/#\\\/schema\\\/person\\\/c6183ae5ada57df0dcbe7a9f23ea41e7\",\"name\":\"Megan Castellucci\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-IN\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3742724942006311e7323017c2b7cb63dd636b6658933b35adb18a2163222edd?s=96&d=mm&r=g0da4d047110d58ad6074751d9b90b048\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3742724942006311e7323017c2b7cb63dd636b6658933b35adb18a2163222edd?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3742724942006311e7323017c2b7cb63dd636b6658933b35adb18a2163222edd?s=96&d=mm&r=g\",\"caption\":\"Megan Castellucci\"},\"url\":\"https:\\\/\\\/www.salesforce.com\\\/in\\\/news\\\/stories\\\/author\\\/mcastelluccisalesforce-com\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Visual AI Assistants: How to Test If They Really Help - Salesforce","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/","og_type":"article","og_title":"For AI Advice to Be Any Good, It Has to Actually Change the Outcome","og_description":"Real-time AI video assistants need a new kind of test. Here\u2019s how we built the necessary proving ground.","og_url":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/","og_site_name":"Salesforce","article_published_time":"2026-11-19T13:14:29+00:00","article_modified_time":"2026-11-19T13:14:38+00:00","og_image":[{"width":1201,"height":675,"url":"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/11\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg","type":"image\/jpeg"}],"author":"Megan Castellucci","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Megan Castellucci","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/#article","isPartOf":{"@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/"},"author":[{"@id":"https:\/\/www.salesforce.com\/in\/news\/#\/schema\/person\/c6183ae5ada57df0dcbe7a9f23ea41e7"}],"headline":"For AI Advice to Be Any Good, It Has to Actually Change the Outcome","datePublished":"2026-11-19T13:14:29+00:00","dateModified":"2026-11-19T13:14:38+00:00","mainEntityOfPage":{"@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/"},"wordCount":1007,"image":{"@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/#primaryimage"},"thumbnailUrl":"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/11\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg","articleSection":["Uncategorized"],"inLanguage":"en-IN"},{"@type":"WebPage","@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/","url":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/","name":"Visual AI Assistants: How to Test If They Really Help - Salesforce","isPartOf":{"@id":"https:\/\/www.salesforce.com\/in\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/#primaryimage"},"image":{"@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/#primaryimage"},"thumbnailUrl":"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/11\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg","datePublished":"2026-11-19T13:14:29+00:00","dateModified":"2026-11-19T13:14:38+00:00","author":{"@id":"https:\/\/www.salesforce.com\/in\/news\/#\/schema\/person\/c6183ae5ada57df0dcbe7a9f23ea41e7"},"breadcrumb":{"@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/#breadcrumb"},"inLanguage":"en-IN","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/"]}]},{"@type":"ImageObject","inLanguage":"en-IN","@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/#primaryimage","url":"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/11\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg","contentUrl":"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/11\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg","width":1201,"height":675,"caption":"Illustration of an AI chat window with the text \"How can I help you today?\""},{"@type":"BreadcrumbList","@id":"https:\/\/www.salesforce.com\/in\/news\/stories\/visual-ai-assistants-ivg-lessons\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.salesforce.com\/in\/news\/"},{"@type":"ListItem","position":2,"name":"For AI Advice to Be Any Good, It Has to Actually Change the Outcome"}]},{"@type":"WebSite","@id":"https:\/\/www.salesforce.com\/in\/news\/#website","url":"https:\/\/www.salesforce.com\/in\/news\/","name":"Salesforce","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.salesforce.com\/in\/news\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-IN"},{"@type":"Person","@id":"https:\/\/www.salesforce.com\/in\/news\/#\/schema\/person\/c6183ae5ada57df0dcbe7a9f23ea41e7","name":"Megan Castellucci","image":{"@type":"ImageObject","inLanguage":"en-IN","@id":"https:\/\/secure.gravatar.com\/avatar\/3742724942006311e7323017c2b7cb63dd636b6658933b35adb18a2163222edd?s=96&d=mm&r=g0da4d047110d58ad6074751d9b90b048","url":"https:\/\/secure.gravatar.com\/avatar\/3742724942006311e7323017c2b7cb63dd636b6658933b35adb18a2163222edd?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3742724942006311e7323017c2b7cb63dd636b6658933b35adb18a2163222edd?s=96&d=mm&r=g","caption":"Megan Castellucci"},"url":"https:\/\/www.salesforce.com\/in\/news\/stories\/author\/mcastelluccisalesforce-com\/"}]}},"jetpack_sharing_enabled":true,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Salesforce","distributor_original_site_url":"https:\/\/www.salesforce.com\/in\/news","push-errors":false,"jetpack_featured_media_url":"https:\/\/www.salesforce.com\/in\/news\/wp-content\/uploads\/sites\/20\/2026\/11\/824_1126_T10_For-AI-Advice-to-Be-Any-Good-It-Has-to-Actually-Change-the-Outcome_d_v2_111126.jpg","_links":{"self":[{"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/posts\/14969","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/users\/763"}],"replies":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/comments?post=14969"}],"version-history":[{"count":5,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/posts\/14969\/revisions"}],"predecessor-version":[{"id":15003,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/posts\/14969\/revisions\/15003"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/media\/14970"}],"wp:attachment":[{"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/media?parent=14969"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/categories?post=14969"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/tags?post=14969"},{"taxonomy":"sf_content_type","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_content_type?post=14969"},{"taxonomy":"sf_theme","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_theme?post=14969"},{"taxonomy":"sf_topic","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_topic?post=14969"},{"taxonomy":"sf_product","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_product?post=14969"},{"taxonomy":"sf_industry","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_industry?post=14969"},{"taxonomy":"sf_role","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_role?post=14969"},{"taxonomy":"sf_multimedia_asset","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_multimedia_asset?post=14969"},{"taxonomy":"sf_location","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_location?post=14969"},{"taxonomy":"sf_collection","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_collection?post=14969"},{"taxonomy":"sf_visibility","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/sf_visibility?post=14969"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.salesforce.com\/in\/news\/wp-json\/wp\/v2\/coauthors?post=14969"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}