June 2022
AR Treasure Hunt
A pirate🏴☠️-themed scavenger hunt, in Augmented Reality!
Find the treasure by solving minigames and finding the red ❌ on the map. Video:
The scene is placed around you depending on your surroundings.
For example: the cannon is always placed perpendicularly facing a wall, so it can (spoiler alert) shoot a hole in it.
It uses real-time world meshing – Lidar, or a Machine Learning fallback – to generate a model of your surroundings.
The pirate map 🗺️ is drawn accurately based on this world mesh, and it’s rendered in a pirate-y hand-drawn style.
Objects interact with the environment, by using baked camera textures on top of debris animations!