Students use world building for social good

Scroll Down

Students in Arizona State University’s extended-reality degree programs are learning how to build worlds in order to solve problems using the latest technology — and they’re already earning accolades.

Extended reality, called XR, creates immersive, interconnected three-dimensional worlds using technologies that include virtual reality, augmented reality, artificial intelligence and blockchain.

The transdisciplinary master’s programs in the Herberger Institute for Design and the Arts teach learners how to tell stories and create experiences to solve problems, widen access to more people and seek justice – all by employing visions of futures and alternative worlds that they create.

The degrees are:

“I saw that the field was going to 3D and XR, so I wanted to get into what was next, and this was the best university I found that offered that skill set.”

Calvin Stanley, Experience Design student, The Design School

Programming experience not needed

Students come from a wide variety of undergraduate degree backgrounds, including media arts and science, graphic or industrial design, user experience and even film, theater and sculpture.

The master’s degrees, called XRts, for “extended-reality technologies,” do not require proficiency in coding, except for the media arts and sciences degree, which focuses on software development, he said.

At the ASU California Center Broadway, students in the Narrative and Emerging Media program are getting help with the technology side with modules on coding, according to Nonny de la Peña, founding director of the program and a professor of practice.

“I’m training students to become producers and directors, not engineers. But they need to know how the sausage is made, and I do everything to support that,” she said.

Students in Los Angeles and Mesa can work together.

“With the haptics lab, the gear we bought is also at the MIX, so there are ways for people (to work) together. We have a wonderful and fluid connection across the programs,” Peña said.

The XR degrees prepare students for a variety of careers, not only in entertainment and journalism, but also in other sectors of society. Most of the worlds the students are creating using these technologies are for workforce development, health care, safety training and conservation.

Students already putting their degrees to work 

Much of the work is to benefit society. Students are now working on an AI project to help people who are vision-impaired, and students in California learned about how to use blockchain technology for social good.

Other students are building worlds to create empathy.

One of de la Peña’s students, Cameron Kostopoulos, debuted his project, “Body of Mine VR,” an immersive virtual-reality experience, at the SXSW 2023 festival in March. It also was screened at the Venice Film Festival earlier this month. The experience places the viewer into another body for an exploration of gender dysphoria and trans identity. He used a combination of several technologies, including Planar virtual-production technology, to create “Body of Mine VR,” which combines full-body, face and eye tracking with audio interviews. At one point, the viewer looks into a mirror and sees themselves blink.

Kostopoulos’ project won “Best XR for Change” award from the Games for Change Festival event in June, as well as the Special Jury Award at SXSW and a student BAFTA Award.

Calvin Stanley is a second-year student in the Experience Design degree program, having earned his undergraduate degree in human-centered design at a university in India.

“After my undergrad I worked a little bit in UX design, and being in the field of technology and seeing how the trends were going, I felt like I was working on something very screen-oriented and 2D,” he said.

“I saw that the field was going to 3D and XR, so I wanted to get into what was next, and this was the best university I found that offered that skill set.”

He has been learning to use the Unreal world-building engine, motion-capture technology, immersive digital platform Spatial as well as 3D printing and laser cutting.

The technology is constantly being updated

“Once I feel like I’ve learned something and have a grasp of how it can be used, the next update rolls in or the next resolution comes in and we have to think about how it will be in the future, because this is future-based,” Stanley said.

“I’m now working on a project in 8K, but maybe in two years it will be in 16K.”

Stanley, who expects to graduate in the spring, already has his projects out in the public. As a student worker in ASU’s Resilient Visions CoLab, he helped to create “Mission to the Future: Arizona in 2045,” an interactive exhibit at the Arizona Science Center. The lab used motion capture to create an animated AI character that talks to kids.

Now, Stanley and the lab are working on a project with the City of Hope Cancer Center.

“We’re working with women who are undergoing breast cancer treatment, and our research is along the lines of how a natural environment and breathing techniques can reduce stress,” he said.

“People in chemotherapy can’t always have access to those environments, so we’re trying to see if the same drop in stress levels happens in a VR environment. I’m in charge of creating the photorealistic environments of five national parks across the US.”

Stanley also is in discussions with the city of Mesa on an urban-planning project that would create an immersive visualization of different architectural approaches.

“With these projects, the narrative drives the technology and vice versa,” he said. “Some things are tough to explain without actually experiencing them inside of a space.”

We invite you to explore our XRts degrees at xrts.asu.edu.