AR Art Overlay Prototype

Using AR to bring an art piece to life has rapidly turned into an active and exciting art genre. I was contacted by an artist looking for new ways to share their art with the world. They asked if I would be able to prototype an AR app that will take their finished art pieces and make it deeper by adding audio, animations, and information to the existing piece. I decided to create a prototype to help determine the feasibility of this idea.

I chose my cyber warrior ai art piece

I then enhance it with special FX, artist information, and audio.

Here is a video of the final presentation. The artist is very interested in moving forward with some exciting new projects.

Skills demonstrated in this prototype:

  • AR Development
  • Develop AR experiences that use trackable targets in the environment
  • Build AR projects to mobile devices
  • Create basic application interactions with Visual Scripting
  • AR Design
  • Research future AR use cases to prepare for developing new kinds of applications
  • Evaluate platform capabilities and limitations in order to determine whether or not a given feature will work.

Virtual Reality AI Character Prototype

I created my AI virtual assistant named “Guie” over 10 years ago to help me with debugging code on large programming projects. She has been invaluable to me over these years while researching and developing applications for a wide variety of devices from Desktop PCs to mobile. I am very excited to announce that she is now available in XR to assist me with VR and AR application development.

I am proud to present this project as a demonstration of my skills in all aspects of the multimedia production process in addition to creating VR experiences. I hope you will agree that this turned out to be a great prototype!

Sample of my storyboard.

Following the best practices for multimedia development, I started by creating the storyboards and design documents. This critical step must not be skipped, even when developing a small project by yourself.

XR Rig Input Manager

Next I engineered a Virtual Reality Interaction Rig that will allow me to build and debug the project using VR devices.

AI Art representation of me working in my multimedia studios.

I tapped into my 20+ years of multimedia production skills to create the graphics used in the scene, as well as recording and producing the audio script.

Once all of the multimedia elements were in place, I began the process of bringing the project to life in Unity. Controlling and animating a 3D character is a fun and challenging task!

The final step was engineering the APK package for installation on the VR device. There are a complex set of configurations that must be correctly assembled in order for the package to be allowed into the secure OS that powers the VR headsets. Feel free to reach out to me if you would like a copy of the prototype.

Augmented Reality AI Character

One of the most exciting uses for augmented reality is to display AI characters into the real world. I was challenged to use the knowledge I have gained in the field of AR to produce a prototype that would place a life-size 3D character into the real world.

Continue reading Augmented Reality AI Character

XR Fusebox Project

AI generated art representing my multimedia production studios.

I’m very proud of my completion of the augmented reality fuse box challenge project.  This was a very exciting course in which I learned  how to program A/R image target recognition applications without an external third party engine.  Using only Unity built-in functionality I was able to define an image target and spawn a 3D object onto that target through the user’s camera. 

Continue reading XR Fusebox Project

AR Face Filter

New recruits use facial tracking filters to take memorable “selfies”

These days most folks are familiar with facial tracking and recognition technology. It has become quite commonplace to have the camera track your face while in a zoom meeting. Who hasn’t been able to resist adding cat ears or a king’s crown to your video feed while the boss drones away during a meeting?

Continue reading AR Face Filter

Visual Scripting In Unity : Rotate an object

Here are variations on how to rotate an object using visual scripting. For this demonstration I made two cubes rotate automatically as well as via user input. One will rotate using the XBox controller and the other one is controlled using keyboard.

Continue reading Visual Scripting In Unity : Rotate an object

Unity Junior Programmer Mission: Create With code Challenge 5 – Whack A Food

In this challenge I was required to put my User Interface skills to the test with this whack-a-mole-like challenge. The project scope is a game in which you have to get all the food that pops up on a grid while avoiding the skulls.

Continue reading Unity Junior Programmer Mission: Create With code Challenge 5 – Whack A Food

Unity Junior Programmer Mission Create With code Unit 5 – User Interface

In this Unit, I programmed a game to test the player’s reflexes, where the goal is to click and destroy objects randomly tossed in the air before they can fall off the screen. In creating this prototype, I learned how to implement a User Interface – or UI – into my projects. I added a title screen with a difficulty select menu that allows the user to control how challenging the gameplay is. In addition, I added a score display that will track how many points the player has earned, and a Game Over screen, which will allow the player to restart and try again.

Continue reading Unity Junior Programmer Mission Create With code Unit 5 – User Interface

Markerless AR

Markerless Augmented Reality Development Environment

This type of augmented reality technology is called markerless AR.  Using this technique you do not need to program an image Target to project your metaverse scene into the real world.   Instead the AR engine is analyzing the environment and detecting a ground plane. When the ground plane is detected the reticule will align and you may then project a 3D object or environment that will stay locked in at those exact coordinates.

Continue reading Markerless AR

Unity Junior Programmer Mission Create With code Unit 3 – Sound and Effects

3d Metaverse Application Development Workspace

The objective of this fun project was to program an endless side-scrolling game with a fast-paced runner style of gameplay. While completing this prototype, I learned how to completely transform the experience of my projects using sound effects and music. I also learned how to create dynamic endless repeating backgrounds that are critical for a side-scrolling gameplay experience.  The final piece of work was learning how to use particle effects such as splatters and explosions. They seem to make the game so much more satisfying to play!

Continue reading Unity Junior Programmer Mission Create With code Unit 3 – Sound and Effects