Augmented Reality (AR) and 3D in Player Next Gen

Show & Tell
1

3d

I’d like to introduce a new prototype that utilizes Player Next Gen (PLN) and its recent support for 3D assets to provide Augmented Reality (AR) experiences on mobile devices.

This prototype offers the ability to explore a series of 3D photospheres featuring various locations in Italy. These 360-degree images were captured using the Polycam iPhone app, known for its 3D scanning capabilities. Recently, Polycam introduced the ability to generate 360-degree panoramas directly on your iPhone, using AI to fill in gaps at the zenith and nadir.

For each panorama, I exported two file formats from Polycam. The first is a GLB file, which Intuiface PLN can display within HTML. The second is a USDZ file, which iOS can natively display in AR mode within the Safari browser. This is the Excel database that powers this experience.

3D
3D909×429 93.9 KB

Please note that while GLB files can be included in the Intuiface XP, USDZ files require hosting on an external web server to enable AR functionality on iOS. In my case, I hosted the USDZ files on Azure and provided their URLs in the Excel database.

The GLB panoramas are genuine 3D models, allowing you to rotate and zoom them. To view a sphere in AR mode, simply click the “View in Augmented Reality” button, wait for the model to download, tap the static AR thumbnail, and position the 3D sphere on a suitable plane. Intuiface PLN does not inherently support opening URLs in a new browser tab, but we have a solution: @Seb has shared a custom IA called “OpenWindows” that opens a new tab in your system browser and loads the specified URL.

Download Augmented Reality PLN (40MB)

Try it out on your iPhone, keeping in mind that it works with recent devices running Safari as the default browser.

QR Intuiface3D

3 Likes
2

I used a 6th Gen iPad (released 2018), and it worked like a charm with perfectly good performance. Super impressive, Paolo.

1 Like
3

Thanks! Glad to see new PLN capabilities expanding on multiple platforms

4

I’d like to share how my previous prototype has evolved into a more refined experience, now called FlightFusion.

FlightFusion is a web app designed to enhance the museum journey using emerging technologies.

By extending the on-site museum experience, FlightFusion offers visitors the opportunity to engage with immersive features, enabling interaction with digital representations of the exhibits directly on their mobile devices.

Key features of FlightFusion include:

• Interactive 3D Scenes: Rendered using the Gaussian Splatting method and captured with the Luma AI app.
• 3D Models: Created using Lidar or photogrammetry with the Polycam app.
• Web Experience: A database-driven interface developed in Intuiface and deployed with Player NextGen

Scan this QR code and give it a try on your own mobile device:

qr

Feel free to download and re-use this prototype for your own projects.

This web app is a result of a collaboration between Tosolini Productions and The Museum of Flight in Seattle, WA.. As always, a big thanks to @Seb for the continued support.