Design Your Dream Aircraft: Enter the AI Plane Configurator (AI + Unity)

The AI Plane Configurator is an interactive prototype that allows users to customize the look of a 3D airplane model. It combines several technologies: Intuiface for UI navigation, AI for user input processing, and Unity for manipulating 3D models.

How It Works

Users begin by selecting an airplane type to customize based on size and flight range. This is done by dragging an icon across an area, and the coordinates are translated into X and Y indexes ranging from 0 to 100.

These numbers are then fed into an Excel sheet and used as part of an AI prompt run through the OpenAI-GPT Interface Asset. The prompt instructs the AI on how to interpret the input data and query the appropriate aircraft model from the limited database included in the prompt.

The integration of Intuiface and Unity comes into play at this point. The AI’s outcome acts as a filter for an Excel database containing the same set of airplanes. Each aircraft has an associated URL that triggers a Unity animation. The Unity app must be running in the background, while Intuiface runs in the foreground with a transparent background. The Unity app features a basic configurator for changing colors, adding stickers, and customizing the 3D low poly aircraft.



During the development of this prototype, a few insights were gained:

  • The use of AI as a selection mechanism from a database was not necessary for the project but served as an exploration of Intuiface integration with GPT. However, the outcomes from GPT seem inconsistent, possibly due to the prompt or limitations in sending specific parameters via API

  • Extracting and saving the text generated by the GPT prompt proved challenging. I implemented a workaround using a timer attached to the GPT text field in the collection, but there might be a simpler solution

  • Communication between Intuiface and Unity was achieved using HttpListener. Please check the article about the Intui3D Gallery for more information

  • The various customizable colored parts of the airplane were created in Blender, whereas the 360 skybox was done using Blockade Labs

Experience the Plane Configurator

Feel free to download and test the AI Plane Configurator prototype. It works on Windows only and it’s designed for a traditional 1920x1080 HD screen.

Special thanks to our XR specialist Maria Sanchez Isaza and Peder Nelson of The Museum of Flight in Seattle, USA.


I’m on vacation and still had to jump in. Another excellent achievement, @tosolini. Congrats to you and the extended team. A great illustration of how Intuiface can be treated like an orchestrator, a middleman conducting the contributions of other services.

Regarding your ChatGPT challenges, can you confirm that you’re still using Version 3.5 and not Version 4? I wonder if that contributes to the issues you’ve had.

Thanks @geoff. The current Intuiface OpenAI-GPT Interface Asset is good enough to support the old OpenAI models. Since its release early this year, OpenAI has changed a few things on their end. To benefit from the latest models (like GPT 4), I think we may need some of @seb time to upgrade the IA :slight_smile:

1 Like