By Bobby Carlton
Rapidly Generate 3D Assets for Virtual Worlds Using Generative AI and Omniverse
The latest version of Omniverse simulation tools from Nvidia allows developers to use Unity’s game engine and generative AI. The company released the latest version of its Omniverse tools last month and it includes new connectors and performance improvements.
According to the company, some of the new customers that are using Omniverse include: Mercedes Benz, and prominent architect and designer Zaha Hadid. In Germany, Mercedes Benz is planning on creating a digital twin of its car factory, which will be used to create a real-world model of the facility.
Through Omniverse, anyone can create simulations that can help enterprises and game developers evaluate the various features of their products before they are released in the real world. For instance, if a company wants to develop a self-driving car, they can use the platform to test its features in virtual worlds.
“One of the most exciting things that we have is Nvidia Omniverse coming to RTX laptops,” said Richard Kerris, vice president of the Omniverse platform, in a press briefing. “We’re going to now start seeing Nvidia’s Omniverse Launcher, which is the starting point for using Omniverse, preinstalled on these new Nvidia Studio laptops. That means we’re going to have Omniverse available to millions of creators on the planet. And with a simple click of a button, we’ll be able to install Omniverse and take advantage of some of the capabilities that the platform has further existing workflows.”
While the company is primarily focused on selling its GPU chips, it also uses the software to help companies create 3D models and exchange them with other companies. This open-source standard, which was developed by Pixar, enables companies to run their assets on various hardware. In addition, the company has launched Omniverse Cloud, which allows users to access the platform from over a hundred countries.
Through its platform, Omniverse, which is used by developers and engineers to create simulations, users can now collaborate and interact with each other in real-time. The company also introduced a number of third-party tools that are designed to help users create 3D models. During the press briefing, Richard Kerris, the vice president of the company’s Omniverse division, showed a demo of six artists working together in a 3D environment.
One of the most popular applications of Omniverse is the creation of digital twins, which are used by companies such as Mercedes Benz to improve the design of their factories. Through the platform, they can easily create a virtual simulation that is designed to replicate the exact design of their real-world factory. According to Richard Kerris, the company can then collect and feed data from the sensors in the simulation. This allows them to further improve the efficiency of their manufacturing process.
Enterprise
The latest version of the company’s software, known as Omniverse Enterprise, is now available. It features new capabilities that allow users to create and operate large-scale 3D models. These include a streamlined workflow that enables them to build connected pipelines and create virtual environments that are physically accurate.
The new capabilities of Omniverse Enterprise can be used by designers, engineers, and artists to break down 3D data silos and create synthetic 3D models. They can also build custom pipelines and manage their data efficiently.
The latest version of Omniverse Enterprise also features support for the latest innovations introduced by the company, such as the new Ada Lovelace architecture including third-generation RTX technology and DLSS 3. These innovations, which are powered by the company’s latest GPU technology, deliver up to three times faster performance gains when powered by the latest GPU technology, such as Nvidia RTX 6000 Ada Generation, Nvidia L40 and OVX systems.
The new version of Omniverse Enterprise also comes with a variety of new features and capabilities. These include a streamlined workflow that enables users to build connected pipelines and create virtual environments that are physically accurate.
Enhancing 3D Creation
The company’s ecosystem is also growing, with new tools and capabilities that allow users to improve their 3D workflows and create more realistic simulations.
The latest additions include:
- New Connectors: Omniverse Connectors enable more seamless connected workflows between disparate 3D applications. New Adobe Substance 3D Painter, Autodesk Alias, PTC Creo, Kitware’s Paraview Omniverse Connectors are now supported on Omniverse Enterprise. Users can also easily export data created in NX Software from Siemens Digital Industries Software.
- Omniverse DeepSearch: Now generally available, this AI-powered service lets teams intuitively search through extremely large, untagged 3D databases with natural language or using 2D reference images. This unlocks major value in previously unwieldy digital backlots and asset collections that lacked the ability to search.
- Omniverse Farm: A completely renewed user interface provides improved usability and performance, plus Kubernetes support.
- Omniverse Cloud: New cloud containers for Enterprise Nucleus Server, Replicator, Farm and Isaac Sim for AWS provide enterprises more flexibility in connecting and managing distributed teams all over the world. AWS’ security, identity and access-management controls allow teams to maintain complete control over their data. Containers are now available on Nvidia NGC.
Stronger Core Components for Creating 3D Worlds
The company’s flagship product, Omniverse Enterprise, is designed for maximum scalability and flexibility, allowing users to connect their projects and tools to a shared virtual space.
The company’s flagship product, Omniverse Enterprise, is designed for maximum scalability and flexibility, allowing users to connect their projects and tools to a shared virtual space. The latest version of the platform includes updates to its core components, such as the Omniverse Kit SDK. This new tool lets users build advanced applications and extensions easily.
The latest version of Omniverse Enterprise also includes the Omniverse Create app, which is a reference tool that enables users to create large-scale, USD-denominated worlds. It now supports multi-viewport and DLSS 3, making it easier for users to interact with complex scenes.
The company’s Omniverse View app, which is used to review 3D scenes, has been streamlined and is now focused on the approval process. New interactive features, such as markup and annotations, make presentations easier to manage and more interactive.
The company’s collaboration and database engine, Omniverse Nucleus, has also been updated with new tools that help users manage their projects and workflows. New features such as the ability to handle atomic checkpoints have been added to the server. Additionally, the Large File Transfer service has been updated to allow users to move files between their various locations.
Omniverse Enterprise
Many industries have experienced the enhanced capabilities of Omniverse Enterprise as part of the enterprise solutions.
One of the world’s largest advertising and marketing networks, Dentsu International, uses Omniverse Enterprise to help its various agencies work more efficiently.
As part of its ongoing efforts to enhance its pipeline, the company is currently working on integrating the capabilities of generative AI into its various design tools.
ZHA, an architectural firm, is known for its unique and innovative designs. Through its use of Omniverse Enterprise, its team can now accelerate its processes and create custom tools. The company’s goal is to create transformative residential, corporate, and cultural spaces through its cutting-edge technologies.
“We are working with Nvidia to incorporate Omniverse as the connective infrastructure of our tech stack. Our goal is to retain design intent across the various project stages and improve productivity,” said Shajay Bhooshan, associate director at Zaha Hadid Architects, in a statement. “We expect Nvidia Omniverse to play a critical, supportive role to our efforts to create a platform that’s agnostic, version-controlled and a single source of truth for design data, as it evolves from idea to delivery.”
The subscription-based Omniverse Enterprise platform is available from a variety of companies, including Dell Technologies, BoxX Technologies, Lenovo, and Z by HP. It is designed to run on various platforms, including mobile and desktop workstations, and is compatible with the latest Intel and AMD technologies.
Omniverse Avatar Cloud Engine (ACE)
To help developers and teams build virtual assistants and avatars, the early-access program for the Nvidia Omniverse AI Cloud Engine is now available. This suite of cloud-native AI components makes it easier to create and deploy intelligent digital assistants.
The Omniverse ACE platform enables developers to easily add AI building blocks to their existing avatars, and it can be deployed on any cloud. With the ability to create and deploy AI assistants for different industries, organizations can improve their existing workflows and increase their profitability.
Through the program, members will have access to the pre-production versions of the company’s AI components, as well as the necessary documentation and tooling to build cloud-native AI applications for interactive avatars.
Bringing interactive AI Avatars to Life with Omniverse ACE
Most methods for creating interactive AI avatars require extensive expertise and manual workflows. With the help of Omniverse ACE, developers can easily integrate the company’s artificial intelligence components into their existing applications.
Since it was first unveiled in September, the Omniverse ACE program has been shared with a few partners to get early feedback. Now, the company is looking for more partners to help develop the platform and push the envelope with new features and innovations.
Through the early-access program, members can get a preview of the company’s pre-production versions of its AI components, such as its 3D animation and conversational AI modules. These include a microservice that enables developers to create realistic facial animations using Omniverse’s audio-based technology.
Some of the partners that have used the Omniverse ACE platform to enhance their workflows for creating AI avatars include Epic Games and Ready Player Me.
Ready Player Me is a platform that lets users create 3D characters for cross-game play. With the help from the Omniverse ACE microservice, developers can now create realistic facial animations.
In a statement, Timmu Tõke, CEO of Ready Player Me noted that digital avatars are becoming more prevalent in people’s lives. They are being used in games and social apps, and they can also be entered into the metaverse. With the help of the Omniverse ACE platform, developers can now easily create and deploy AI characters in their existing applications.
MetaHuman, a technology developed by Epic Games, was able to create high-fidelity digital humans that were incredibly realistic. Through the partnership between the company and Omniverse, users will now be able to create even more engaging 3D models through the Omniverse ACE platform.
Generative AI Comes to Omniverse
According to the company, the increasing number of people working in the design, engineering, and creative industries using 3D workflows has been driving the need for more realistic digital models.
Through the use of AI-powered tools, creators and animators can now create 3D simulations and environments that are more realistic than before.
The company’s flagship product, Omniverse, is now being expanded with the addition of new tools and features for 3D artists. These include a suite of experimental AI software for creating realistic environments and simulations.
The company also announced the availability of thousands of free assets for its Omniverse platform. These assets are designed to help accelerate the adoption of 3D workflows.
In addition, a new release of the Omniverse Launcher for Blender has been released that adds 3D generative capabilities. It also allows users to easily transfer and swap rigged characters. Another new feature in the app is the ability to perform one-button operations to reattach a rigged character’s head.
“One of the hottest topics in the industry these days is generative AI and so we brought using our research team and new aspects in AI toy boxes are bringing these generative AI capabilities into the platform,” Kerris said.
With the new panel for optimization, users can now create multiple USD scenes in their multi-app workflows in real time.
Several generative AI tools, such as the audio2Face, audio2Gesture, and audio2Emotion, have also received performance updates, which make it easier for creators and developers to integrate them into their existing 3D workflows.
Creators can generate facial expressions from an audio file using Audio2Face; realistic emotions ranging from happy and excited to sad and regretful with Audio2Emotion; and realistic upper-body movement using Audio2Gesture. These audio-to-animation tools are game-changers for 3D artists, eliminating the need to perform tedious, manual tasks.
The availability of AI-powered creator tools has been driving the growth of the creative community. When the company introduced the Nvidia Canvas, it made it easier for artists to create beautiful and effortless landscapes. In the coming weeks, the company will be releasing an update to the platform that will allow users to create 360 surround images.
With the AI Toy Box, creators can now easily create 3D meshes using 2D inputs.
The company’s AI tools make it easier for users to create high-quality outputs, which are ideal for the increasing demand for virtual worlds and content in the metaverse.
“The demand for 3D skills is skyrocketing, but learning 3D can be pretty scary to some, and definitely time consuming,” said Jae Solina, aka JSFilmz, in a statement. “But these new platform developments not only let creatives and technical professionals continue to work in their favorite 3D tools, but also supercharge their craft and even use AI to assist them in their workflows.”
The company’s Omniverse Launcher is now available to system builders through the company’s portal, allowing them to pre-install it on their laptops. This will allow them to provide optimized experiences for 3D artists. The first laptops with this feature will be released later in 2023.
The company’s free mod platform, known as the Nvidia RTX Remix is a free modding platform, built on Omniverse, that enables modders to quickly create and share RTXON mods for classic games, each with full ray tracing, enhanced materials, NVIDIA DLSS 3 and NVIDIA Reflex. Its release in early access is coming soon.
The company’s Portal with RTX mod was built using the company’s RTX Remix engine. It was created by the original developer of Portal: Prelude, who also released an unofficial version of the game in 2008.
In addition, the company’s Omniverse platform allows users to access thousands of free USD assets, such as the Winter World Minecraft experience. They can also learn how to create their own SimReady assets using the company’s platform. With the help of various 3D tools, such as Autodesk Maya, 3ds Max, and Adobe Substance 3D Painter, creators can now charge their existing workflows with real-time rendering and AI.
The company’s new tools are designed to help 3D artists push the boundaries of their creativity and create new digital worlds. They can now create lifelike characters and reimagine digital worlds through the combined power of generative AI, audio-to-animation, and the metaverse.
According to the company, it has also added new tools for Isaac Sim that make it easier for developers to create robots for industrial settings. In addition, the company has also released the alpha version of its Unity Omniverse Connector. This allows users to perform various tasks, such as generating automatic UVs and fixing geometry.
Let us know how FS Studio can help you with your Omniverse goals! We are a leader in advanced software engineering, specializing in IoT, Virtual Reality, and embedded device development. We provide the expertise that gets products to market! Contact us today!
