Two tracks now define practical AI in customer experience: frontier models like GPT‑5 that aim for the highest quality and safety out of the box, and open‑weight (open-source style) models that can be hosted privately for tight control over data and cost. Most CCaaS platforms will blend the two.
What changed this week
GPT‑5 arrived as the new default brain for general conversational reasoning. It targets better multi‑turn reliability, fewer obvious mistakes, and more deliberate step‑by‑step behavior. You should expect CCaaS vendors to begin testing and gradually introducing GPT‑5 in places where it clearly improves outcomes without breaking cost or latency budgets.
Open‑weight models from OpenAI also landed. These “OSS” models represent a US-produced alternative to the many impressive open weight models recently coming out of China. A large model (gpt-oss-120b) as well as a smaller open weights model (gpt-oss-20b) can be downloaded and run in private environments—by a vendor, a partner, or your own IT team—so transcripts and prompts don’t have to leave your walls. They matter when privacy, predictable spend, or edge deployments are non‑negotiable. They generally aren’t as capable as GPT‑5 out of the box, but they’re flexible and increasingly good once tailored to a domain.
The upshot is simple: new frontier models raise the quality ceiling; open‑weights expand where and how AI can be used. Most CX stacks will mix them to balance quality, control, and cost.
Why open‑weight models still matter
Data boundaries are the obvious draw. If your legal or contractual reality forbids sending raw audio or transcripts to a public cloud, open‑weights let your provider keep inference local while still delivering modern GenAI features. The same is true for branch or edge sites where connectivity is unreliable: running locally avoids outages and long round‑trips.
Cost predictability is another reason. For very large, steady workload (think routine summarization, redaction, or knowledge lookups) the economics of self‑hosting can be attractive compared with paying per‑token forever. This doesn’t mean open‑weights are “free”; it means you’re trading usage fees for infrastructure and operations that your vendor (or partner) manages on your behalf.
Customization and control also improve. Open‑weights can be tuned for your terminology and tone, paired with your redaction rules, and tightly integrated with internal systems. The trade‑off is responsibility: your vendor needs to do extra evaluation, safety hardening, and ongoing maintenance to keep quality and behavior where they should be.
A note on tool‑calling and RAG (why this matters for “agentic” CX)
More CX work is shifting from pure Q&A to orchestrating steps: authenticate the caller, check entitlements, fetch policy details, calculate eligibility, then draft the resolution. That orchestration depends on tool‑calling, such as structured requests the model makes to your systems, and on retrieval‑augmented generation (RAG), which pulls facts from your knowledge base before the model answers.
GPT‑5 is positioned as stronger at multi‑step tool use and error recovery, which should translate into steadier automations inside agent desktops and customer‑facing flows. At the same time, the new open‑weight models support structured tool‑calling and local RAG, making it possible to build private, policy‑aware automations when data cannot leave your environment. In practice, many platforms will route routine or sensitive steps through a local open‑weight setup and reserve GPT‑5 for harder reasoning or ambiguous cases.
What GPT‑5 means inside the tools you already use
Expect quiet, practical upgrades rather than dramatic feature overhauls. Call summaries should read a bit cleaner, with tighter action items and more consistent speaker and entity handling. Knowledge‑grounded answers tend to stick closer to the source material when RAG is in the loop. Agent assist will feel more stepwise and policy‑aware, with fewer odd detours or overconfident guesses.
None of this is magic. Context still matters, and vendors will adopt GPT‑5 where it wins on their own test sets for accuracy, safety, latency, and cost. But the direction is clear: a higher quality ceiling from frontier models, and broader deployment options from open‑weights—working together to make CX more reliable, private, and affordable.
Categories: Articles
From Customer Service to Customer Operations
Zoho’s Quiet Bet on Business Intelligence at the Point of Action
Dashboards Are Easy, Doing Something Is Hard. Medallia Gets It.
What Genesys’s Large Action Models Mean for the CX Control Plane