understand the different types of immersive technologies
be aware of the different methods of creating such technologies
understand how Unity works.
have created or adapted a simple augumented reality project
Activity 1: Introduction to immersive technologies
Watch this video.
the complete video is just under 40 minutes. Feel free to skip parts that are less interesting. However, do watch the first few minutes of each of the six sections
Activity 2: Terminology check
Work in pairs. Discuss what you understand the following terms to mean.
Immersive technologies
XR Extended reality
VR Virtual reality
AR Augumented reality
MR Mixed reality
Compare your ideas with other groups or your tutor.
Activity 3: ChatGPT check
These definitions were generated using ChatGPT. Please check them for any halluciations, i.e. any factual errors that ChatGPT accidently introduced.
Immersive technologies
describes software and devices that blur the line between the physical world and the digital (or simulated) world.
Virtual reality is a digital experience that completely immerses users in a simulated environment. Unlike other forms of immersive technology, it requires special equipment such as a headset and hand controllers
Augumented reality overlays digital elements onto the real world, enhancing the user's physical environment. Users can interact with these digital elements using their smartphones or augumented reality glasses.
Mixed reality is a blend of virtual and augumented reality. It anchors digital objects to the real world, allowing users to interact with these objects as if they were real.
Extended reality is a catch-all term encompassing virtual, augumented, and mixed reality. It refers to all real-and-virtual combined environments and human-machine interactions generated by computer technology and wearables.
Work in pairs. Compare your evaluations.
Activity 4: Terminological issues
Work in pairs. First, check your understanding of the term. Second, discuss the issues that may arise related to the term. Third, if neither of you are able to identify related issues, search the web for ideas.
Head-Mounted Display (HMD)
Haptic feedback
Field of View (FoV)
6 Degrees of Freedom (6DoF)
Tracking
Input Devices
Spatial Audio
Rendering and Real-Time Graphics
Scene Understanding
Latency
Have you experienced any issues listed above as a user or developer?
Share your experiences with your partner.
Activity 5: Immersive technology tools
Read this short introduction to relevant tools.
a variety of tools used for creating immersive experiences. Each tool comes with its own strengths and limitations, and the choice of tool often depends on the specific requirements of the project.
Unity: This game development platform is widely used to create VR, AR, and MR experiences. It is known for its robustness and flexibility.
Unreal Engine: This is another popular platform for creating VR experiences, known for its high-quality graphics capabilities.
ARKit: This is Apple's platform for creating AR experiences on iOS devices.
ARCore: This is Google's platform for creating AR experiences on Android devices.
To create a simple AR experience using ARCore or ARKit, you'll need a smartphone with the latest version of ARCore (for Android) or ARKit (for iOS) installed. You'll also need a computer with Unity installed.
Step 1: Open Unity and create a new AR project.
Step 2: Import the ARCore or ARKit plugin, depending on your platform.
Step 3: Add an AR Session and AR Session Origin to your scene.
Activity 6: Augumented reality: Real-world problem solving
Scenario: You are working as a TA for professor at a university in Japan. The professor has an urgent request.
Listen to the request for help.
Your task is to:
confirm the requirements directly with the professor
identify the technologies to use
create a prototype
provide a plan for the professor on how to improve or extend the prototype, indicating resource needs.
