Palantir Technologies has announced a new sovereign AI operating system (OS) reference architecture developed in collaboration with NVIDIA. The joint solution aims to provide organizations with a complete, turnkey AI data center from hardware procurement to full-scale application deployment.
To begin with, the Palantir AI OS Reference Architecture (AIOS-RA) offers a fully integrated, production-ready AI infrastructure. Built on NVIDIA Enterprise Reference Architectures, the system has been tested and qualified to run Palantir’s entire software suite. This includes platforms such as AIP, Foundry, Apollo, Rubix, and AIP Hub. As a result, organizations can deploy advanced AI capabilities within a unified and scalable environment.
AI Authority Trend: Cognizant and Palantir Partner to Accelerate AI Modernization in Healthcare
At the core of the architecture lies NVIDIA’s advanced AI infrastructure. Specifically, the solution runs on NVIDIA Blackwell Ultra systems equipped with eight NVIDIA Blackwell Ultra GPUs. Additionally, it incorporates NVIDIA Spectrum-X Ethernet networking to support demanding AI training and inference workloads. Consequently, enterprises can achieve faster model training and more efficient inference processes.
In addition, Palantir contributes a robust compute infrastructure layer built on a hardened Kubernetes substrate. This layer supports key Foundry services such as Catalog, Build, and Multipass, enabling organizations to manage complex data and operational workflows efficiently. Furthermore, the architecture includes a unified management plane that integrates Rubix a zero-trust Kubernetes environment with Apollo, Palantir’s autonomous deployment and lifecycle management platform.
Another important component is the AIP platform, which connects large language models (LLMs) with organizational data and operational systems. Through this integration, enterprises can translate raw data into actionable intelligence across different business functions. Moreover, the system leverages NVIDIA’s full-stack software acceleration technologies, including NVIDIA AI Enterprise, CUDA-X libraries, Nemotron open models, and NVIDIA Magnum IO.
AI Authority Trend: Sovereign AI Partners with Accenture and Palantir to Scale Secure AI Data Centers in EMEA
The architecture is particularly valuable for organizations that already operate GPU-based infrastructure or require latency-sensitive workflows. Likewise, enterprises with strict data sovereignty requirements or geographically distributed operations can benefit significantly from this design. By enabling organizations to maintain control over their data, AI models, and applications, the sovereign AI framework ensures security while supporting high-performance computing.
“From our first deployment with the United States government and in every deployment since, our software has had to meet the moment in the most complex and sensitive environments where customers must maintain control,” says Akshay Krishnaswamy, Palantir’s Chief Architect. “Together with NVIDIA and building on many customers’ existing investments we are proud to deliver a fully integrated AI operating system that is optimized for NVIDIA accelerated compute infrastructure and enables customers to realize the promise of on-premise, edge, and sovereign cloud deployments.”
Meanwhile, NVIDIA emphasized how AI infrastructure is evolving to meet modern enterprise demands.
“AI is redefining the infrastructure stack demanding, latency-sensitive and data-sovereign environments require a full-stack architecture built from silicon to systems to software,” said Justin Boitano, vice president, Enterprise AI Platforms, NVIDIA. “By combining Palantir’s sovereign AI OS reference architecture with NVIDIA AI infrastructure, industries and nations can turn data into intelligence with speed, efficiency, and trust.”
AI Authority Trend: Accenture and Palantir Expand Global Partnership to Drive AI Reinvention
To share your insights, please write to us at info@intentamplify.com
