Sound and FX in the Metaverse

While most people think about the Metaverse as being a media that  involves visual art, there is an often overlooked area that can greatly enhance a metaverse project. Currently most apps and games have a pumping soundtrack and sword slashing game play. The ability to use 3D spatial audio effects to provide an exciting user experience has just started to be implemented.  Current projects are just scraping the surface of what can be done to provide a fun and exciting audio experience for the user. 

This project will demonstrate that I can produce high quality sound effects to greatly enhance the user experience. I was provided the virtual “set” and instructed to add a static background music as well as a 3D spatial surround sound effect. I placed the effect on a pot boiling on the stove. As you move closer you can hear the bubbling. I also added an Easter egg… if  you put your ear by the door, you can hear ambient sounds in the next room. Check it out and let me know what you think.

https://meta.dwdenney.com/audiodemo1

Screenshot of development environment

A/R Virtual Button

Image Target with 3D objects hovering over

We’ve covered the basics of AR targeting in the first few lessons and now we move on to an exciting feature: a virtual button that can recognize when you are touching it. I used Photoshop and designed a custom image Target in the style of a game board. There are placeholders for 3D models of a cube and a sphere, and there is a “button” as well.

The completed scene when run on your Android device will recognize button press and switch from a sphere to a cube hovering over the game board display.

viewing the image Target game board through the camera of an Android device.

The possibilities for interactive displays and art exhibits are endless. I look forward to seeing how this technology will grow and develop to be used more in the future. Feel free to contact me if you need any projects completed using this amazing technology.

Download the APK here https://meta.dwdenney.com/ARVirtualButton.apk and try it with this image target:

A/R Enhanced Comic Books

With this fun project I set out to enhance comic books using augmented reality technology. I chose a few covers from some of my favorites and tried to follow the theme of the comic book cover while adding augmented reality enhancements. The 3D objects and animations that enhance the scene when viewed through a camera seem to be a perfect combination.

Building on what I learned in my first project, I made five different AR targets and programmed each one with a different augmented reality effect. Some of them are quite complex such as smoke coming out of the chimney of a house and even characters that attempt to attack an enemy.

The first one is the cover of one of my beloved childhood comic book characters: Garfield. What could be better than looking at the cover through a camera and seeing Garfield trying to devour a steaming cheeseburger.

Continue reading A/R Enhanced Comic Books

Augmented Reality Application with Clothing Image Target

In this exciting project I created an augmented reality (A/R) application with a clothing based Image Target using the Unity 3D engine and A/R camera recognition.

DeeDub’s workspace in the Unity 3D engine

This application will let you view through your camera and see your surroundings enhanced with augmented reality. When the camera recognizes a certain image that has been programmed in, it’s able to place a 3D animated character on surface of the image.

Image Target with AR recognition

I programmed the camera to recognize a “Live Happy” logo that is on my wife’s apron. When the camera recognizes the logo it projects a 3D animated action figure walking around the logo. Once the image is tracked and the AR recognition has locked in place, you can move the device around and watch the AR camera match your movements.

Feel free to check out the APK (you’ll need to sideload it via developer mode on an Android device). One you load up the APK and install it on your device, open the app and point the camera at this logo:

A picture of a logo from an apron. It will be used as an image target in this application.

Unity Junior Programmer Mission Create With code Challenge 3 – Physics

In this challenge I was tasked to apply my knowledge of physics, scrolling backgrounds, and special effects to a balloon floating through town. The balloon must pick up tokens while avoiding explosions. I had to do a lot of troubleshooting in this project because it was riddled with errors. 

Upon successfully  completing this challenge I became proficient in application scripting , debugging, diagnosing and fixing code. I also practiced resolving compilation errors and fixing the cause of an exception.

https://meta.dwdenney.com/balloonfloat/

Whack A Food 2D Game

Image of coding environment  featuring Unity and Visual Studio
Working in Unity with Visual Studio Integration Development Environment

In this Unity learning challenge I put my User Interface skills to the test with this whack-a-mole-like challenge in which you have to get all the food that pops up on a grid while avoiding the skulls. I was required to debug buttons, mouse clicks, score tracking, restart sequences, and difficulty setting to get to the bottom of this one. I tested the  application, made a log of any errors/bugs in the code and gameplay. Using C# scripting and  utilizing various Unity APIs, I completed the debugging, diagnosing and fixing code that compiles but fails to perform as expected.

Challenge Outcome:

  • All of the buttons look nice with their text properly aligned
  • When you select a difficulty, the spawn rate changes accordingly
  • When you click a food, it is destroyed and the score is updated in the top-left
  • When you lose the game, a restart button appears that lets you play again

https://meta.dwdenney.com/whackafood/

3D Metaverse Script, Sculpt, Model and Design

I have a wide variety of Metaverse scripting skills, as well as 3D sculpting, modeling and design. Please check out the samples.

I have certifications in 3D sculpting, modeling and animation using 3D Studio Max. I also have skills using Unity, Blender, True Space 3D, Maya, Poser and Bryce

Skagit Valley College Student Document Repository

If the Financial Aid Department is the heart of the college institution, then the Skagit Valley College was suffering from a stroke. The heart was clogged up from the result of years of managing paperwork using tried and true ancient techniques: the in person delivery of hand filed paper forms.

And then corona virus came to deliver the death blow. Due to the pandemic, the college campus was forced to close. Unable to allow students to come to campus and process in person financial aid meant that our college might suffer the same fate as several other Washington State institutions and be shut down completely.

They came to me with this problem desperate for a solution. They needed a document repository that could be integrated with our current Legacy student management system data, but that will also be able to transition with our data over the next few years as the school completes its move to a new student data management system. They needed a way to assign the forms to the students, and a portal where students could securely upload their documents.

The college had a legacy document storage system in place, aging and in need of replacement. The system had fallen out of development and was no longer being supported. The decision was to either purchase an expensive out of the box system, or develop one in-house. Due to the success of previous projects, the President of SVC decided to have me develop a custom in-house document storage and management solution that would be easily integrated into our student data management system.

During the planning phase, the project management documents were drawn up, key deliverables determined, and the use case scenarios developed.

A screen shot of the student document repository user interface.
A screen shot of the student document repository user interface.

Throughout the software development life cycle, those documents were referred to in order to prevent feature / scope creep from setting back the projected completion date. Using Agile project management I completed several sprints of user story backlogs, and the scrum retrospectives revealed valuable lessons learned about the techniques used to program the application.

 In the midst of the pandemic, forced into working remotely, I was under the pressure to save the college by finishing my application well ahead of the projected schedule.

The project close was met with very satisfied stake holders, and the project sponsor was happy to sign off the completed product.