Generate 3D Assets from Image

Transform a user-provided 2D image into various 3D assets, including 3D meshes and Gaussian splats, along with corresponding audio files based on a specified theme. This skill leverages advanced AI APIs for multi-modal generation.

תחום: עיצוב

מתי להשתמש

Integrate this skill when a user needs to quickly prototype 3D content or assets from a single image, especially for design, game development, or virtual reality applications, and requires corresponding audio.

מתי זה מופעל

when the user asks to generate 3D assets and audio from an image

תגיות: 3d-design, ai-generation, image-to-3d, gaussian-splats, audio-synthesis

SKILL.md

--- name: Generate 3D Assets from Image description: Transform a user-provided 2D image into various 3D assets, including 3D meshes and Gaussian splats, along with corresponding audio files based on a specified theme. leverages advanced AI APIs for multi-modal generation. when_to_trigger: when the user asks to generate 3D assets and audio from an image --- ## Overview Generate a comprehensive set of 3D assets (meshes, Gaussian splats) and accompanying audio from a single input image. is ideal for rapid prototyping and content creation in design and immersive media. ## When to use Use when a user provides an image and explicitly requests the creation of 3D models or scenes, along with audio. This is particularly useful for designers and developers looking to accelerate their workflow. ## How it works 1. Receive the user-provided 2D image. If no image is provided, ask the user to upload one. 2. Prompt the user for an optional theme or context for the audio generation. If not provided, interpret the visual cues from the image to infer a suitable audio theme. 3. Send the image to a specialized external AI API capable of converting 2D images into 3D mesh data. Specify the desired output format (e.g., OBJ, FBX). 4. Concurrently, send the image to another specialized external AI API to generate Gaussian splats, capturing detailed scene information. 5. Using the inferred or provided theme, generate an appropriate audio file through a separate AI audio synthesis API. Ensure the audio duration is suitable for dynamic 3D asset presentation. 6. Compile all generated assets: 3D mesh file, Gaussian splat data, and the audio file. 7. Provide download links for each asset separately: the 3D mesh, the Gaussian splat data, and the audio file. Clearly label each link. 8. Offer a brief description of each generated asset, highlighting key features or potential uses. ## Example usage **User:** "Can you turn this image of a forest into 3D models and generate some ambient forest sounds?" ## References - Claude + external AI APIs now generate 3D/mesh/audio from images (https://digg.com/ai) - Claude + external AI APIs now generate 3D/mesh/audio from images (http://mckinsey.com/capabilities/tech-and-ai/our-insights/superagency-in-the-workplace-empowering-people-to-unlock-ais-full-potential-at-work)