Orange Business powers voice AI inference for enterprises on distributed infrastructure with NVIDIA - Orange Business

• Faster, more responsive voice AI experiences with lower latency
• Greater flexibility and resilience for enterprise voice AI deployments

Orange Business (NYSE: ORAN) and NVIDIA are collaborating on distributed voice AI inference to help enterprises deploy natural, real-time conversational agents with lower latency, greater resilience and more control over where AI services run.

The approach distributes AI models across central-cloud and regional Point of Presence (PoP) resources, enabling workloads to be distributed across different locations to improve responsiveness, capacity and data location. This enables a natural conversational flow by reducing latency, while optimizing GPU capacity and bandwidth use, and helps keep voice data local where required.

A proof of concept for real-world AI operations

At GTC 2026, Orange and NVIDIA are piloting Distributed AI Inference across multiple sites in Orange's network. Orange Business has deployed NVIDIA Blackwell at central cloud and NVIDIA Aerial RAN Computer at distributed locations for this pilot. The demonstration uses a wildfire emergency scenario, where AI helps in translating the conversation from a foreign language caller to operator's language and vice versa, ensuring a seamless real-time call experience with the required translation accuracy and total time to response. AI also helps in transcribing, preparing call summaries capturing key information to assist the emergency service operators take speedy action to address the emergency situation.

AI models are accessed through Live Intelligence, Orange's secure multi-LLM (Large Language Model) trusted AI platform, while the AI Distributed Inference platform manages workloads across central-cloud and regional PoP resources. Integrated routing balances traffic between sites and can redirect requests if a site is unavailable or overloaded.

To build this solution, Orange Business is integrating NVIDIA Nemotron models into Live Intelligence. These open weight models give customers access to advanced AI capabilities with the flexibility to audit, tailor and deploy them according to their operational and data-residency requirements. In addition, Orange Business brings together the network, cloud and regional infrastructure, model management and request routing required to operate distributed AI services end to end. This gives customers greater control over data processing, service operations and AI deployment locations, supporting data-residency and sovereignty requirements.

Expanding beyond conversational AI use cases

The service is designed to support other applications including emergency communications, live multilingual translation, enterprise contact centers, video analytics, drone detection, computer vision and industrial IoT.

In complementary work, Orange is assessing AI-RAN with Nokia and NVIDIA, initially focusing on potential gains in radio spectral efficiency, network capacity and site economics. The assessment also explores whether shared infrastructure could support both RAN functions and AI inference for future enterprise services, including sensing and drone detection, while maintaining radio network performance.

The distributed voice AI prototype is being tested with customers on real-world use cases. Their feedback will help Orange Business further refine the architecture, particularly its performance and resilience in a trusted environment.

"Distributed infrastructure is the next frontier of the AI factory buildout, as demand for inference and edge computing accelerates," said Ronnie Vasishta, Senior Vice President of Telecom at NVIDIA. "Telcos are uniquely positioned to become distributed infrastructure service providers. With NVIDIA, Orange is expanding from the central to distributed sites, powering a new class of real-time intelligence applications that need deterministic performance, reliability and scale, and can be delivered together with connectivity using the AI-RAN architecture."

“Distributed inference will be a critical part of the next phase of enterprise AI. It requires compute, connectivity and orchestration across multiple sites and regions,” commented Anne-Marie Thiollet, Chief Product and Marketing Officer, Orange Business. “Our extensive network and infrastructure footprint enable us to combine these capabilities together and help customers deploy AI services with greater performance, resilience and control.”