{"id":94279,"date":"2026-07-08T07:50:58","date_gmt":"2026-07-08T14:50:58","guid":{"rendered":"https:\/\/www.salesforce.com\/?p=94279"},"modified":"2026-07-08T07:51:29","modified_gmt":"2026-07-08T14:51:29","slug":"cutting-inference-spend-by-right-sizing-models","status":"publish","type":"post","link":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/","title":{"rendered":"How We Cut Inference Spend by Right-Sizing Our Models\u00a0"},"content":{"rendered":"\n

The headlines say enterprises can’t control their inference spend \u2014\u00a0the sometimes-surprising amount they pay frontier model companies to use their LLMs. Uber<\/a> burned through its entire AI budget in four months. GitHub’s <\/a>usage-based pricing drew an instant backlash when customers realized how much more they would have to spend.<\/p>\n\n\n\n

Now, companies are cutting inference costs by routing to cheaper rented models, and engineers are optimizing their existing models to reduce the bill. But cost is just the most visible symptom of a much larger problem. When a single rented model runs every job for your agent, from intent detection to safety to citation to policy, it\u2019s a chokepoint for your whole business, not just your invoices. The latency sits at the model provider’s mercy, the roadmap depends on their release schedule, and the safety logic lives in a black box. Obsessing over token spend is a local minimum. The real engineering problem is architectural agency.\u00a0<\/p>\n\n\n\n

We know that pressure firsthand. Eighteen months ago, Agentforce<\/a> also ran entirely on a single rented model, and our token bill grew linearly with traffic. We could have passed the rising bill on to our customers, but that would have bought us a year at most. The bill would keep rising as long as we were renting the whole engine. So instead of repricing, we opted to rebuild. Instead of handing everything to one model, we broke out different tasks and tuned specific open-source models to accomplish them.\u00a0<\/p>\n\n\n\n

Today, these precision models run a growing share of the stack, and they\u2019re already cutting costs, running more effectively, and giving us more control over our products and roadmap. And as more advanced open-source models are released, their performance should only improve. A frontier foundation model still handles the core muti-step reasoning, but now that reasoning is governed by the harness we\u2019ve built around it \u2014 and that means that we, and our customers, can swap the foundation models freely, instead of being dependent on any single vendor.<\/p>\n\n\n\n

What the harness showed us<\/h2>\n\n\n\n

When a single frontier model handled every request, it had to do every job at once: reading what the user wanted, checking the request was safe, deciding which tool to call, grounding the answer in real data, and judging whether the answer held up. A general-purpose reasoning model can do all of that. It just does each piece more slowly, more expensively, and less precisely than a model trained specifically to do each job.<\/p>\n\n\n\n

But none of this started with a list of jobs we knew we were optimizing for. It started with the harness. For nearly three decades we\u2019ve been the system of record for enterprise work \u2014 we know what a billing dispute sounds like, what trace a service escalation leaves, and what qualifying a lead actually involves. That\u2019s why we could build an agentic harness \u2014 grounded in real customer workflows, data, permissions, and business logic, and get it running across hundreds of thousands of use cases across service, sales, and commerce. The scale is crucial here, because every inference left a trace in our telemetry, and working backward from those traces lets us see the common patterns across agentic enterprise work.

The same seams kept appearing. Almost every job moved through the same handful of steps: screen the request for attacks, work out what the user intended, ground the answer in real data, check that the answer held up.\u00a0<\/p>\n\n\n\n

So we pulled each job out and tuned an open-source model to do it \u2014 targeted models, each handling the single job it was built for. We weren’t training from scratch. We were tuning on the patterns of millions of jobs the harness had already processed. Here’s a look at the models we run:<\/p>\n\n\n\n

The job the agent has to do<\/th>The model we run<\/th>What it does<\/th>Status<\/strong><\/th><\/tr><\/thead>
Read the request and route it<\/td>HyperClassifier <\/td>Runs on every request before anything else, so speed is everything \u2014 about 50ms vs. roughly a second for a general model.<\/td>GA Spring ’26<\/td><\/tr>
Check the request isn’t an attack<\/td>Prompt injection defense (PID)<\/td>Trained on the real prompt-injection attack surface instead of improvising a defense each time. <\/td>Rolling out \u2014 GA Summer ’26<\/td><\/tr>
Screen every output for harmful content<\/td>Toxicity model<\/td>Scores every LLM response for violent, sexually explicit, hateful, and physically harmful content before it reaches the end use<\/td>Generally available (GA)<\/td><\/tr>
Judge whether the answer holds up<\/td>TextEval<\/td>An independent evaluator checks grounding, citation, response quality, task resolution, and instruction adherence<\/td>Generally available (GA)<\/td><\/tr>
Rank what retrieval pulls back<\/td>TextRerank<\/td>Built for high-throughput reranking, the high-volume step a generalist makes slow and costly.<\/td>Generally available (GA)<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Agentforce Voice additionally uses Deepgram (speech-to-text) and ElevenLabs (text-to-speech), deployed within Hyperforce infrastructure so audio never leaves Salesforce’s trust boundary. Voice turn detection is handled by the HyperClassifier above.<\/em><\/p>\n\n\n\n

Now let\u2019s dive deep into the job to be done of each model, where we started, and how we\u2019re solving the problem today.<\/p>\n\n\n\n

1. Reading the request: Intent detection and routing\u00a0<\/h4>\n\n\n\n

The first thing an AI agent<\/a> has to do is understand what the user is actually asking and route it to the tool for the job. A service request about a billing dispute is inherently different from a request to update a contact record. The general model treated all of these as reasoning tasks \u2014 which means it used the same slow, expensive process to handle each of them.\u00a0<\/p>\n\n\n\n

We replaced it with the HyperClassifier<\/a>, a purpose-built classifier we fine-tuned on GPT-OSS-20B (OpenAI’s open-source Mixture-of-Experts architecture, quantized to run fast) and operate entirely within the Einstein Trust Layer. It reads the request, classifies the topic across up to 200 possible labels, and routes to the right subagent. It returns an answer in roughly 26 milliseconds \u2014 compared to around 1,446 milliseconds for a general frontier model. That’s not a rounding error: it’s roughly 55 times faster, and it runs on every single request, cutting user wait times substantially.<\/p>\n\n\n\n

The HyperClassifier isn\u2019t just faster than general-purpose modes, it’s more accurate and secure. Safety topic accuracy improved from 95% to 99%. Drift \u2014 the tendency to get pulled off-topic in a multi-turn conversation \u2014 dropped from approximately 20% to 10%. And because it only analyzes utterances and intent signals \u2014 and not the fully grounded prompt with CRM data \u2014 it can\u2019t accidentally act on or share the most sensitive business context.<\/p>\n\n\n\n

The HyperClassifier became generally available in Spring ’26 and is now the default intent detection and routing model for Agentforce Service<\/a> and Employee Agent templates. The same model also powers semantic endpointing in Agentforce Voice<\/a>: detecting, in real time, when a speaker has finished a thought rather than just pausing. That distinction \u2014 between a completed intent and a mid-sentence hesitation \u2014 is what makes a voice conversation feel like a natural exchange rather than a system waiting for silence.<\/p>\n\n\n\n

2. Defending the request: Prompt-injection screening<\/h4>\n\n\n\n

Before the agent acts on anything, it has to know the request is not an attack. An email body, a form field, a chat message \u2014 any of those can carry a crafted instruction designed to hijack the agent’s next action. <\/p>\n\n\n\n

We built a dedicated injection-detection model for this, trained specifically on the most likely attack surfaces \u2014 CRM field values, inbound email bodies, form inputs, and transcript content \u2014 rather than improvising a defense from first principles. The model is embedded directly in the reasoning engine as a second independent detection layer alongside heuristic defenses. It classifies six distinct attack vectors: role-play and persona manipulation, prompt leakage, privilege escalation, encoding attacks (Base64, hex), privacy attacks, and malicious code generation. Every prompt receives an injection score, which is logged in an audit trail, and we are actively developing blocking mode, which will halt any detected attacks before sending them on to the reasoner.<\/p>\n\n\n\n

3. Screening every output: protection for toxic or unsafe content<\/h4>\n\n\n\n

After an LLM returns a response, it reviews it to make sure it doesn\u2019t include any violent, sexually explicit, hateful, or physically harmful content. There\u2019s just one problem: like humans, LLMs can have a blind spot when it comes to judging their own work. They tend to give themselves the benefit of the doubt. So we launched a specialized model to screen every response, assign it a toxicity score, and log it to the Einstein Trust Layer Audit Trail.\u00a0<\/p>\n\n\n\n

4. Judging the answer: citation, task resolution, and instruction adherence<\/h4>\n\n\n\n

Once the agent has reasoned, the work still has to be checked \u2014 is the answer grounded in real data, does it cite a traceable source, did the agent follow its instructions, was the task actually resolved? A general model tends to grade its own work generously, the same blind spot we saw with toxicity screening. So we hand the judging to a separate model.<\/p>\n\n\n\n

TextEval does that job. It’s a 20-billion-parameter model fine-tuned from GPT-OSS-20B, and it evaluates the response across several dimensions at once: whether answers are grounded in the customer’s own data, identifying sources and generating citations to support the response, whether the agent adhered to its instructions, and whether the task was resolved. The check is built into the runtime and can’t be modified by admins \u2014 a system-level guarantee, not a configuration. The result is measurable: instruction adherence and task-resolution accuracy run consistently higher than when a general model judges its own output.<\/p>\n\n\n\n

5. Reranking search results: Owned reranker<\/h4>\n\n\n\n

When the agent retrieves knowledge to ground an answer, the order of results matters. A poorly-ranked list of articles sends the LLM toward the wrong answer, even when the right answer is somewhere lower in the results. We run our own text ranking model for high-throughput retrieval reranking \u2014 deciding which retrieved content rises to the top before anything reaches the reasoning engine. It migrated from third-party hosting to Amazon Bedrock with zero customer-facing downtime and latency parity, and now runs across regions including a multilingual reranker for global deployments.<\/p>\n\n\n\n

Intelligence was never the gap<\/h2>\n\n\n\n

Frontier models are extraordinary, and we’re not betting against them \u2014 today, a frontier model handles the core reasoning in our stack, and our architecture lets our customers plug in the frontier model of their choice. But raw intelligence was never the thing standing between an enterprise and a resolved case.

More intelligence doesn\u2019t close that gap, but knowing how enterprise companies actually work does. Those patterns took us decades to learn, and eighteen months to build into our agentic infrastructure, including our harness, models, and agentic apps. The result isn\u2019t a smaller stack, or a cheaper one. It\u2019s a precise one: the right intelligence for each job, and no more. Precision over power: that\u2019s the real frontier.
<\/p>\n","protected":false},"excerpt":{"rendered":"

Most enterprise work needs the right intelligence for each job \u2014 not the most intelligence for all of them.<\/p>\n","protected":false},"author":127,"featured_media":94281,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"sf_subhead":"","sf_i18n_disclaimer":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"alternateThumbnailId":0,"sf_product_cta_id":0,"sf_show_toc":false,"footnotes":"","jetpack_post_was_ever_published":false},"categories":[1],"tags":[],"sf_content_type":[21243],"sf_theme":[21184],"sf_topic":[21212,20528,21187],"sf_product":[19930],"sf_industry":[],"sf_role":[],"sf_multimedia_asset":[],"sf_location":[1798],"sf_collection":[],"sf_visibility":[],"coauthors":[14952],"class_list":["post-94279","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","sf_content_type-snapshot-opinion","sf_theme-agentic-ai","sf_topic-agentic-enterprise","sf_topic-agents","sf_topic-ai","sf_product-agentforce","sf_location-global"],"yoast_head":"\nHow We Cut Inference Spend by Right-Sizing Our Models\u00a0 - Salesforce<\/title>\n<meta name=\"description\" content=\"Most enterprise work needs the right intelligence for each job \u2014 not the most intelligence for all of them.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How We Cut Inference Spend by Right-Sizing Our Models\u00a0\" \/>\n<meta property=\"og:description\" content=\"Most enterprise work needs the right intelligence for each job \u2014 not the most intelligence for all of them.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/\" \/>\n<meta property=\"og:site_name\" content=\"Salesforce\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/salesforce\/\" \/>\n<meta property=\"article:published_time\" content=\"2026-07-08T14:50:58+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-07-08T14:51:29+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"675\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Jayesh Govindarajan\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@salesforcenews\" \/>\n<meta name=\"twitter:site\" content=\"@salesforcenews\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Jayesh Govindarajan\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"8 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"NewsArticle\",\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/\"},\"author\":[{\"@id\":\"https:\/\/www.salesforce.com\/news\/#\/schema\/person\/image\/724a5b04a303f3f116d5c718e1117e18\"}],\"headline\":\"How We Cut Inference Spend by Right-Sizing Our Models\u00a0\",\"datePublished\":\"2026-07-08T14:50:58+00:00\",\"dateModified\":\"2026-07-08T14:51:29+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/\"},\"wordCount\":1790,\"publisher\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/#organization\"},\"image\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png\",\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/\",\"url\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/\",\"name\":\"How We Cut Inference Spend by Right-Sizing Our Models\u00a0 - Salesforce\",\"isPartOf\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png\",\"datePublished\":\"2026-07-08T14:50:58+00:00\",\"dateModified\":\"2026-07-08T14:51:29+00:00\",\"description\":\"Most enterprise work needs the right intelligence for each job \u2014 not the most intelligence for all of them.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage\",\"url\":\"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png\",\"contentUrl\":\"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png\",\"width\":1200,\"height\":675,\"caption\":\"Inference Spend\"},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.salesforce.com\/news\/#website\",\"url\":\"https:\/\/www.salesforce.com\/news\/\",\"name\":\"Salesforce\",\"description\":\"Get the latest Salesforce press releases, announcements, stories, and media contacts. See today\u2019s CRM news.\",\"publisher\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.salesforce.com\/news\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.salesforce.com\/news\/#organization\",\"name\":\"Salesforce\",\"url\":\"https:\/\/www.salesforce.com\/news\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.salesforce.com\/news\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2020\/08\/default.jpg\",\"contentUrl\":\"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2020\/08\/default.jpg\",\"width\":1200,\"height\":630,\"caption\":\"Salesforce\"},\"image\":{\"@id\":\"https:\/\/www.salesforce.com\/news\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/salesforce\/\",\"https:\/\/x.com\/salesforcenews\",\"https:\/\/www.linkedin.com\/company\/salesforce\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.salesforce.com\/news\/#\/schema\/person\/image\/724a5b04a303f3f116d5c718e1117e18\",\"name\":\"Jayesh Govindarajan\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g23494c9101089ad44ae88ce9d2f56aac\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g\",\"caption\":\"Jayesh Govindarajan\"},\"url\":\"https:\/\/www.salesforce.com\/news\/stories\/author\/jayesh-govindarajan\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"How We Cut Inference Spend by Right-Sizing Our Models\u00a0 - Salesforce","description":"Most enterprise work needs the right intelligence for each job \u2014 not the most intelligence for all of them.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/","og_locale":"en_US","og_type":"article","og_title":"How We Cut Inference Spend by Right-Sizing Our Models\u00a0","og_description":"Most enterprise work needs the right intelligence for each job \u2014 not the most intelligence for all of them.","og_url":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/","og_site_name":"Salesforce","article_publisher":"https:\/\/www.facebook.com\/salesforce\/","article_published_time":"2026-07-08T14:50:58+00:00","article_modified_time":"2026-07-08T14:51:29+00:00","og_image":[{"width":1200,"height":675,"url":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png","type":"image\/png"}],"author":"Jayesh Govindarajan","twitter_card":"summary_large_image","twitter_creator":"@salesforcenews","twitter_site":"@salesforcenews","twitter_misc":{"Written by":"Jayesh Govindarajan","Est. reading time":"8 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"NewsArticle","@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#article","isPartOf":{"@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/"},"author":[{"@id":"https:\/\/www.salesforce.com\/news\/#\/schema\/person\/image\/724a5b04a303f3f116d5c718e1117e18"}],"headline":"How We Cut Inference Spend by Right-Sizing Our Models\u00a0","datePublished":"2026-07-08T14:50:58+00:00","dateModified":"2026-07-08T14:51:29+00:00","mainEntityOfPage":{"@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/"},"wordCount":1790,"publisher":{"@id":"https:\/\/www.salesforce.com\/news\/#organization"},"image":{"@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage"},"thumbnailUrl":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png","inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/","url":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/","name":"How We Cut Inference Spend by Right-Sizing Our Models\u00a0 - Salesforce","isPartOf":{"@id":"https:\/\/www.salesforce.com\/news\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage"},"image":{"@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage"},"thumbnailUrl":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png","datePublished":"2026-07-08T14:50:58+00:00","dateModified":"2026-07-08T14:51:29+00:00","description":"Most enterprise work needs the right intelligence for each job \u2014 not the most intelligence for all of them.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.salesforce.com\/news\/stories\/cutting-inference-spend-by-right-sizing-models\/#primaryimage","url":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png","contentUrl":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png","width":1200,"height":675,"caption":"Inference Spend"},{"@type":"WebSite","@id":"https:\/\/www.salesforce.com\/news\/#website","url":"https:\/\/www.salesforce.com\/news\/","name":"Salesforce","description":"Get the latest Salesforce press releases, announcements, stories, and media contacts. See today\u2019s CRM news.","publisher":{"@id":"https:\/\/www.salesforce.com\/news\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.salesforce.com\/news\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.salesforce.com\/news\/#organization","name":"Salesforce","url":"https:\/\/www.salesforce.com\/news\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.salesforce.com\/news\/#\/schema\/logo\/image\/","url":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2020\/08\/default.jpg","contentUrl":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2020\/08\/default.jpg","width":1200,"height":630,"caption":"Salesforce"},"image":{"@id":"https:\/\/www.salesforce.com\/news\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/salesforce\/","https:\/\/x.com\/salesforcenews","https:\/\/www.linkedin.com\/company\/salesforce\/"]},{"@type":"Person","@id":"https:\/\/www.salesforce.com\/news\/#\/schema\/person\/image\/724a5b04a303f3f116d5c718e1117e18","name":"Jayesh Govindarajan","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g23494c9101089ad44ae88ce9d2f56aac","url":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/?s=96&d=mm&r=g","caption":"Jayesh Govindarajan"},"url":"https:\/\/www.salesforce.com\/news\/stories\/author\/jayesh-govindarajan\/"}]}},"jetpack_featured_media_url":"https:\/\/www.salesforce.com\/news\/wp-content\/uploads\/sites\/3\/2026\/07\/781_0726_T03_What-Eighteen-Months-of-Building-Our-Own-Models-Taught-Us-About-AI-Costs_c_v2_070226.png","jetpack_sharing_enabled":true,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Salesforce","distributor_original_site_url":"https:\/\/www.salesforce.com\/news","push-errors":false,"_links":{"self":[{"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/posts\/94279","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/users\/127"}],"replies":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/comments?post=94279"}],"version-history":[{"count":1,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/posts\/94279\/revisions"}],"predecessor-version":[{"id":94282,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/posts\/94279\/revisions\/94282"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/media\/94281"}],"wp:attachment":[{"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/media?parent=94279"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/categories?post=94279"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/tags?post=94279"},{"taxonomy":"sf_content_type","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_content_type?post=94279"},{"taxonomy":"sf_theme","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_theme?post=94279"},{"taxonomy":"sf_topic","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_topic?post=94279"},{"taxonomy":"sf_product","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_product?post=94279"},{"taxonomy":"sf_industry","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_industry?post=94279"},{"taxonomy":"sf_role","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_role?post=94279"},{"taxonomy":"sf_multimedia_asset","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_multimedia_asset?post=94279"},{"taxonomy":"sf_location","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_location?post=94279"},{"taxonomy":"sf_collection","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_collection?post=94279"},{"taxonomy":"sf_visibility","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/sf_visibility?post=94279"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.salesforce.com\/news\/wp-json\/wp\/v2\/coauthors?post=94279"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}