AR Art Overlay Prototype

Using AR to bring an art piece to life has rapidly turned into an active and exciting art genre. I was contacted by an artist looking for new ways to share their art with the world. They asked if I would be able to prototype an AR app that will take their finished art pieces and make it deeper by adding audio, animations, and information to the existing piece. I decided to create a prototype to help determine the feasibility of this idea.

I chose my cyber warrior ai art piece

I then enhance it with special FX, artist information, and audio.

Here is a video of the final presentation. The artist is very interested in moving forward with some exciting new projects.

Skills demonstrated in this prototype:

  • AR Development
  • Develop AR experiences that use trackable targets in the environment
  • Build AR projects to mobile devices
  • Create basic application interactions with Visual Scripting
  • AR Design
  • Research future AR use cases to prepare for developing new kinds of applications
  • Evaluate platform capabilities and limitations in order to determine whether or not a given feature will work.

Virtual Reality AI Character Prototype

I created my AI virtual assistant named “Guie” over 10 years ago to help me with debugging code on large programming projects. She has been invaluable to me over these years while researching and developing applications for a wide variety of devices from Desktop PCs to mobile. I am very excited to announce that she is now available in XR to assist me with VR and AR application development.

I am proud to present this project as a demonstration of my skills in all aspects of the multimedia production process in addition to creating VR experiences. I hope you will agree that this turned out to be a great prototype!

Sample of my storyboard.

Following the best practices for multimedia development, I started by creating the storyboards and design documents. This critical step must not be skipped, even when developing a small project by yourself.

XR Rig Input Manager

Next I engineered a Virtual Reality Interaction Rig that will allow me to build and debug the project using VR devices.

AI Art representation of me working in my multimedia studios.

I tapped into my 20+ years of multimedia production skills to create the graphics used in the scene, as well as recording and producing the audio script.

Once all of the multimedia elements were in place, I began the process of bringing the project to life in Unity. Controlling and animating a 3D character is a fun and challenging task!

The final step was engineering the APK package for installation on the VR device. There are a complex set of configurations that must be correctly assembled in order for the package to be allowed into the secure OS that powers the VR headsets. Feel free to reach out to me if you would like a copy of the prototype.

Augmented Reality AI Character

One of the most exciting uses for augmented reality is to display AI characters into the real world. I was challenged to use the knowledge I have gained in the field of AR to produce a prototype that would place a life-size 3D character into the real world.

Continue reading Augmented Reality AI Character

XR Fusebox Project

AI generated art representing my multimedia production studios.

I’m very proud of my completion of the augmented reality fuse box challenge project.  This was a very exciting course in which I learned  how to program A/R image target recognition applications without an external third party engine.  Using only Unity built-in functionality I was able to define an image target and spawn a 3D object onto that target through the user’s camera. 

Continue reading XR Fusebox Project

AR Face Filter

New recruits use facial tracking filters to take memorable “selfies”

These days most folks are familiar with facial tracking and recognition technology. It has become quite commonplace to have the camera track your face while in a zoom meeting. Who hasn’t been able to resist adding cat ears or a king’s crown to your video feed while the boss drones away during a meeting?

Continue reading AR Face Filter

Unity Junior Programmer Mission: Create With code Challenge 5 – Whack A Food

In this challenge I was required to put my User Interface skills to the test with this whack-a-mole-like challenge. The project scope is a game in which you have to get all the food that pops up on a grid while avoiding the skulls.

Continue reading Unity Junior Programmer Mission: Create With code Challenge 5 – Whack A Food

Unity Junior Programmer Mission Create With code Unit 5 – User Interface

In this Unit, you I programmed a game to test the player’s reflexes, where the goal is to click and destroy objects randomly tossed in the air before they can fall off the screen. In creating this prototype, I learned how to implement a User Interface – or UI – into my projects. I added a title screen with a difficulty select menu that allows the user to control how challenging the gameplay is. In addition, I added a score display that will track how many points the player has earned, and a Game Over screen, which will allow the player to restart and try again.

Continue reading Unity Junior Programmer Mission Create With code Unit 5 – User Interface

Unity Junior Programmer Create With Code Challenge 4 – Soccer Scripting

Custom Unity Development Environment

The challenge: use the skills I just learned in the Sumo Battle prototype in a completely different context: the soccer field. Just like in the prototype, you will control a ball by rotating the camera around it and applying a forward force, but instead of knocking them off the edge, your goal is to knock them into the opposing net while they try to get into your net. Just like in the Sumo Battle, after every round a new wave will spawn with more enemy balls, putting your defense to the test. However, almost nothing in this project is functioning! It was my job to get it working correctly.

Continue reading Unity Junior Programmer Create With Code Challenge 4 – Soccer Scripting

Unity Junior Programmer Mission Create With code Unit 4 – Gameplay Mechanics

Unity Development Environment

In this Unit, the goal was to program an arcade-style Sumo battle with the objective of knocking increasingly difficult waves of enemies off of a floating island, using power ups to help defeat them. In creating this prototype, I practiced implementing new gameplay mechanics, which are new rules or systems that make the game more interesting to play. The project scope included programming a powerup, which give the player a temporary advantage. Also included was the requirement to program increasingly difficult enemy waves, which make survival more challenging for the player. I learned how a good balance of powerups and increasing difficulty make for a much more interesting gameplay experience.

Continue reading Unity Junior Programmer Mission Create With code Unit 4 – Gameplay Mechanics

Markerless AR

Markerless Augmented Reality Development Environment

This type of augmented reality technology is called markerless AR.  Using this technique you do not need to program an image Target to project your metaverse scene into the real world.   Instead the AR engine is analyzing the environment and detecting a ground plane. When the ground plane is detected the reticule will align and you may then project a 3D object or environment that will stay locked in at those exact coordinates.

Continue reading Markerless AR