NVIDIA took its spotlight at Computex 2023, announcing the NVIDIA Avatar Cloud Engine (ACE) for Games.

This custom AI model foundry service is set to transform the gaming landscape by infusing non-playable characters (NPCs) with intelligence through AI-powered natural language interactions. ACE for Games empowers developers to create and deploy customized speech, conversation, and animation AI models, enhancing interactivity and immersion in gaming experiences.

Pioneering Generative AI in Games

NVIDIA’s ACE for Games builds upon the foundation of NVIDIA Omniverse, offering optimized AI models for speech, conversation, and character animation. This includes NVIDIA NeMo, a language model customization tool that enables developers to build and deploy large language models with lore, character backstories, and protective measures against unsafe conversations.

Additionally, NVIDIA Riva provides automatic speech recognition and text-to-speech capabilities, while Omniverse Audio2Face allows for real-time expressive facial animation that matches speech tracks. Developers can integrate the entire ACE for Games solution or choose specific components per their requirements.

‘Kairos’: Showcasing the Future of Games

NVIDIA has collaborated with Convai, an NVIDIA Inception startup focused on conversational AI for virtual game worlds, to demonstrate the potential of ACE for Games. Through Convai’s end-to-end real-time avatar platform, the demo called ‘Kairos’ showcases the interaction between players and Jin, the NPC owner of a ramen shop. Powered by generative AI, Jin responds realistically to natural language queries, aligning with the narrative backstory. This innovative collaboration highlights the possibilities that ACE for Games opens up for developers.

Deploying ACE for Gaming Models

NVIDIA ACE for Games allows developers to deploy their AI models locally or in the cloud. NVIDIA optimize its neural networks supporting ACE for various capabilities, balancing size, performance, and quality. Fine-tuning models for specific games and real-time inferencing can be achieved through the ACE foundry service. With this, it deploys via NVIDIA DGX Cloud, GeForce RTX PCs, or on-premises infrastructure. The emphasis on latency ensures responsive and immersive interactions in gaming experiences.

Generative AI Transforming the Gaming Experience

NVIDIA’s generative AI technologies have already gained traction among game developers and startups.

  • GSC Game World, a prominent European game developer, is incorporating Audio2Face into their highly anticipated game, S.T.A.L.K.E.R. 2: Heart of Chernobyl. Indie game developer
  • Fallen Leaf is utilizing Audio2Face for character facial animation in their third-person sci-fi thriller, Fort Solis, set on Mars.
  • Charisma.ai, an AI-driven virtual character company, leverages Audio2Face to power animation within its conversation engine.

These examples demonstrate the far-reaching impact of generative AI in shaping the future of gaming.

Learn more about NVIDIA ACE for Games here.


Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.