Rodin add-on for Omniverse

Introduction

The Rodin add-on for Omniverse is a powerful integration tool that supports most of the functions available on Rodin's webpage, allowing users to access image-based generation capabilities directly within the Omniverse environment. It enables users to replace target images, adjust generation settings, utilize ControlNet with selected objects, and choose between automatic and manual generation modes—all while maintaining a seamless workflow between Omniverse and the Rodin web interface through the convenient floating window functionality.

Overview

The Rodin Bridge for Omniverse integrates Rodin's powerful AI-based 3D generation capabilities directly into your Omniverse. This integration consists of two main components:

Installation

1. You have a deemos.rodin.tool.zip archive file

2. In Omniverse, navigate to Developer → Extensions

3. Click the hamburger menu icon (☰) in the "Extensions" window

4. Select Import Extension from the dropdown menu

5. Choose the deemos.rodin.tool.zip file

6. After successful import, "Rodin" will appear in the Extensions list

7. Enable the extension, then click Rodin → Launch Rodin in the menu bar, and the RodinBridge window will appear in the interface

Basic Usage

The Rodin add-on integrates most Rodin's generation functions directly in Omniverse. Operation requires interaction in both Omniverse and the Rodin webpage.

Single Image Generation

1. Click 'Remove' and 'Load Image' to replace the default image with the image you want to generate the 3D asset with.

2. Choose 'None' in ControlNet options and choose 'One Click' for the fastest generation experience. The rest of the settings are identical to those on Rodin webpage.

3. Once they are adjusted, click 'Submit' to begin the process.

The Rodin webpage will automatically appear if not already open. On the Rodin webpage, activate the floating window using the toggle switch.

You can monitor the generation process in the floating window. The generated asset will be automatically imported into Omniverse scene.

You can also import featured assets or generated assets by hovering on the target asset and press the emerged 'Export' button.

Advanced Functions

ControlNet:

To enable ControlNet, select an object in scene and choose your desired ControlNet mode. You can then adjust ControlNet settings as needed (identical to Rodin webpage settings).

Multiview Mode:

You can use 'Load Image' to add more images as the input for generation. Rodin will automatically process them as the input for multi-view generation.

Generation Mode:

You can choose between One Click mode and Manual mode.

One Click: Process runs without step-by-step guidance.

Manual: Requires step-by-step operation in the floating window. The process is identical to that on Rodin webpage.