NVIDIA Edify: Empowering Developers with Custom Data-Trained Model Creation

NVIDIA’s New AI Foundry: Revolutionizing Content Creation with Edify

—

Introduction:

In today’s fast-paced digital world, the ability to rapidly generate high-quality content is more crucial than ever. NVIDIA, a leader in AI and graphics technology, has introduced groundbreaking tools to support developers and creators in producing content more efficiently. This post is part of the AI Decoded series, which aims to simplify AI concepts and highlight the latest advancements in hardware, software, and tools for RTX PC users.

—

NVIDIA AI Foundry: Empowering Developers

NVIDIA has launched the NVIDIA AI Foundry, a platform designed to help companies train generative AI models using their licensed data. At the core of this initiative is NVIDIA Edify, a versatile AI architecture capable of generating images, videos, 3D assets, 360-degree high-dynamic-range imaging (HDRi), and physically based rendering (PBR) materials from simple text prompts. This allows companies to create customized AI models tailored to their specific needs.

—

Key Features of NVIDIA Edify:

1. Versatile Content Generation:
   Edify can produce various types of content, including 2D images, 3D models, and environment maps, making it a comprehensive tool for creators.

2. Training Efficiency:
   One of Edify’s standout features is its ability to generate high-quality content with fewer training images, making the training process faster and more efficient.

3. Fine-Tuning Capabilities:
   Edify allows for fine-tuning models to match specific styles or learn unique characters and objects, providing creators with greater control over the final output.

   —

   Generative AI by Getty Images: A Case Study

   One notable application of NVIDIA AI Foundry and Edify is the Generative AI by Getty Images, a service that offers commercially safe generative photography. By training the AI on its licensed content, Getty Images ensures that no copyrighted characters or products are included in the dataset. This not only avoids legal issues but also opens a new revenue stream for contributors, as they receive a share of the profits.

   —

   Asset Generation with Edify:

   Edify’s capabilities extend beyond image generation. Here are some of its key functionalities:

4. High-Quality Image Generation:
   Edify Image can generate four 1K resolution images in about six seconds, twice as fast as previous models. These images can be upscaled to 4K resolution using a generative upscaler that adds additional details.

5. Advanced Controls:
   Users can control various aspects of image generation, such as focal length and depth of field, through advanced prompt adherence and camera controls. Features like Sketch and Depth ControlNets enable users to guide the generation process by providing sketches or copying the composition of existing images.

6. Image Editing:
   Edify Image includes tools like InPaint, Replace, and OutPaint, which allow users to modify images by adding or changing content and adjusting aspect ratios. Segment, another feature, can mask objects using simple text prompts, making the editing process more intuitive.

7. 3D Meshes:
   Edify can create artist-ready 3D meshes with clean topology, up to 4K PBR materials, and automatic UV mapping for easier texture editing. A fast preview mode generates results in just ten seconds, which can be further refined into full 3D meshes.

8. 360 HDRi Environment Maps:
   Edify 360 HDRi can generate environment maps of natural landscapes up to 16K resolution from text or image prompts. These maps can be used for lighting, reflections, or as backgrounds, saving users the time spent searching for suitable HDRi images.

   —

   Multimodal Capabilities:

   Edify’s unique multimodal capability allows it to combine different asset types, enabling advanced workflows. For instance, users can prototype a full scene in minutes using simple text prompts, as demonstrated in the NVIDIA Research SIGGRAPH demo. By combining Edify 3D, 360 HDRi, and Image, artists can generate a scene in 3D, adjust object positions and framing, and then use Edify Image to create a photorealistic final image.

   —

   Generative AI by Getty Images: Enhancing Content Creation

   Getty Images, a leading provider of visual content, has utilized NVIDIA AI Foundry to train an Edify Image model for its generative AI service. Available through Generative AI by Getty Images for enterprises and Generative AI by iStock for small businesses and amateur creators, this service allows users to generate and modify images using AI models powered by NVIDIA Edify.

   Recent updates to the service include faster generation times, higher prompt adherence, and the introduction of Camera Controls. Users can now apply generative AI tools to preshot creative content, enabling rapid iteration and perfection of visuals. These capabilities will soon be available on Gettyimages.com.

   —

   Conclusion:

   NVIDIA’s AI Foundry and Edify are transforming the landscape of content creation. By providing developers and creators with powerful, efficient tools, NVIDIA is enabling the rapid generation of high-quality content across various media types. The collaboration with Getty Images showcases the potential of these technologies in real-world applications, offering a glimpse into the future of generative AI.

   —

   Stay Informed:

   Generative AI is revolutionizing industries like gaming, videoconferencing, and interactive experiences. To stay updated on the latest advancements, consider subscribing to the AI Decoded newsletter.

   —

   Explore More:

   For a hands-on experience with Generative AI by Getty Images, visit ai.nvidia.com. Embrace the future of content creation with NVIDIA’s cutting-edge AI tools.

   —

   In summary, NVIDIA’s initiatives, particularly through the AI Foundry and Edify, are setting new standards in the realm of generative AI. By simplifying the content creation process and enhancing creative control, these tools are poised to significantly impact various industries, from entertainment to advertising. The collaboration with Getty Images is just the beginning, showcasing the vast potential and practical applications of NVIDIA’s advanced AI technologies.

For more Information, Refer to this article.