At Sony Immersive Music Studios, I was an Immersive Entertainment Intern working with the team to create rapid prototypes of MR interactive music experience using Unreal Engine 5 and Blueprints. I also supported the projects by modeling characters and environment assets using Maya.
The work I helped create was demonstrated and pitched immersive prototypes to various domestic and overseas teams across Sony.
This MFA thesis project is a historical fiction Augmented Reality installation that combines mobile AR technology and IoT in order to create an immersive, spatial experience. The installation will also include a number of curated archival prints, predominantly family inherited pieces, in order to elevate the narrative experience. With the help of another mobile UI designer, I am in charge of developing and designing the AR and IoT elements that power the narrative and gameplay mechanics of this interactive installation.
Summary:
A granddaughter tries to uncover a hidden moment from her grandfather’s past by studying archival material from the 1980s China and through a series of conversations with family members. In doing so, she uncovers certain traumatic memories from the past and needs to make a decision between preserving her family’s history or protecting her and her family’s well being.
Submitted to the Human-Computer Interaction International 2023 conference (link)
At ILMxLab, I was the Experience Designer Intern in charge of interactive media research, documentation, and prototyping.
Using Unreal and the Oculus Quest, I designed and play-tested level grey-boxes, metrics gym, and VR levels. Using Figma, I documented level top-downs, UI/UX control systems, and AR experiences for various in-studio departments. I also pitched and presented my work regarding mixed reality experiences with the design team at xLab.
An iOS Augmented Reality (AR) app that allows historians to study and interact with IIIF archival content remotely in AR space.
As the software engineer on this project, I developed the app architecture and UI/UX code to support and process JSON data downloaded from IIIF APIs by using ARKit and SwiftUI.
Follow along with Booksnake at our Twitter or on our website
Video Demo for potential “snapping feature“.
Ideally, users will be able to receive some feedback, visual and physical haptics, when the AR object is scaled to specific sizes: 50% or 100% of the original size. This prototype demo tries to demonstrate what actions users need to take and the “feel“ of the app when interacting with this feature.
Currently this feature is still in progress as playtesting results suggest that users often do not try to scale the AR objects via pinching the mobile screen. As such, this snapping feature may not be a high priority addition to Booksnake.
As the Unity Developer in charge of Web APIs on this project, I am working with a team at USC to develop an interactive WebVR reconstruction of the Vatican’s Stanza della Segnatura Library. Using Unity and Scalar, we hope to create an immersive space where historians can study spatial experiences between archival and architectural elements.
Previous iteration of project here
Learn more about the current project here
Road Less Traveled is a historical, visual novel game based on the story of Tatsu, the first woman to climb Mt. Fuji, and Mary Lacy, the first women to be given a pension from the British admiralty as a shipwright. Both stories will touch on the struggles women experience on their respective travels to prove their worth in society.
As the game mechanics developer and UI designer, I have designed and created interactive components to reflect the character’s experiences or narrative arc of the game.
Link to game here
As the developer and designer, I worked together in a team of developers and composers to create this 3D puzzle game. I was responsible for drawing art assets, designing the puzzles and VFX, and scripting the game mechanics.
A Page Turns is a 3D escape room adventure that takes place between the pages of a pop-up book. Playing as a child trapped in their PlayRoom, you must transport between the room and a magical book to find clues and collect items to escape.
Download Game here
Seismic AR was an Augmented Reality mobile feature that allowed customers to access 3D models on their Seismic cloud and showcase and interact with 3D models in real space.
As the iOS mobile engineer on this project, I helped the company increased sales competitiveness for clientele by achieving feature parity through designing, developing, and publishing this app using ARKit.
To see the mobile feature in action with the larger product, visit the company website here
Jefferson Misfit (2020)
A text-based adventure game where players can understand the effects of unjust societal prejudices against high schoolers.
As the gameplay developer on this project, I created the backend pipelines, developed the game interface in Unity, and oversaw the QA tests and bug fixes.
Download and play our game here