Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: yueyang1996.github.io/holodeck/ Code: github.com/allenai/Holode… How did we leverage Objaverse assets to create interactive 3D environments? 👇
7
58
241
34K
138
Download Video
To enhance object retrieval and placement accuracy, we ask OpenAI's GPT-4-Vision API to annotate the following attributes of Objaverse assets: 1/
@sunfanyun How hard would it be to constrain the exterior shape of the environment? If this can generate floor plans within a pre-defined envelope I have immediate customers 👀
@sunfanyun Does this require me to have a Gurobi license?