3D smart glasses help students build literacy skills

A recent Australian study into learning with mixed reality technology has found that the use of 3D virtual objects overlayed on the real world enhanced and improved print-based, twodimensional (2D) written and illustrated texts through the creation of digital multimedia versions.

Lead researcher Professor Kathy Mills said the outcomes showed the benefits of transmedia storytelling using a variety of platforms to boost students’ storytelling, communication and creativity.

“This new generation of wearable technology is not a passing fad, it is the way of the future,” said Mills, of Australian Catholic University’s Institute for Learning Sciences and Teacher Education (ILSTE).

“Using mixed reality technology supports students to produce truly multimedia texts, improves their digital literacy skills, and enhances their storytelling across different modes. Using such technologies targets multimodal literacy learning that is an important part of the national curriculum.”

Bring stories to life

As part of the study, published in the journal Learning, Media and Technology, the students, aged 10 and 11 years old, first produced traditional 2D written and illustrated narratives set in different biomes. Next, they used Microsoft HoloLens 2 devices to bring their stories to life by using a range of hologram images superimposed over the real classroom to illustrate the setting, characters, and events of their texts.

The students used voice activated video recording to tell their stories supported by the 3D holograms. Researchers were able to monitor their work by livestreaming the students’ view through their 3D mixed reality smart glasses to a computer. They were consequently able to understand the students’ experiences with the novel storytelling process and its similarities and distinctions to conventional forms of writing a story.

“The students were absolutely mesmerised,” she said. “They were totally immersed in this experience that turned their 2D drawings and print-based writing into 3D interactive holographic scenes that they could talk to.

“They were able to provide greater visual detail to their stories, move holograms around to provide different perspectives and angles, and focus viewer attention in ways they could not do with conventional 2D media.”

Haptic gestures

Mills said the students’ interactions with the virtual environment using hand and finger movements, known as haptics, to carry out functions such as grabbing, dragging, pinching, pointing, and touching holograms, supported and embedded their learning.

“The in-air haptic gestures allow for deeper meaning-making by activating the brain in a more stimulating and interactive way.”

Despite excitement over the new tech, the study also noted that students believed the art of storytelling was still at the heart of the activity.

“This technology will have a significant impact on education in the future, particular as the cost of these resources drops,” added Mills. “But it is not at the expense of traditional forms of literacy, rather it’s complementary and gives students the best of the material and virtual reality worlds.”

Find out more at: bit.ly/3dglassesstudy

CODE MASTER: PROGRAMMING LOGIC GAME 1to WIN!

Try a different take on coding by learning the basics without a computer. In Code Master: Programming Logic Game, travel to an exotic world in search of power crystals. Along the way, players use programming logic to navigate the map. But think carefully as, in each level, only one specific sequence of actions will lead to success. As well as teaching the principles behind programming, players also build planning, sequential reasoning and problem-solving skills.

We have one Code Master: Programming Logic Game to give away. Enter online.

Entries close Monday 31 July.

2to WIN!

Usb Dust Plug Charging Port Cover

Dust. Clothing Lint. Sand. Crumbs. Dirt. There are all manner of unwanted materials that can find their way into the ports on your devices. Gradually, they can build up and, eventually, start to cause connection and charging problems. Keep them out and your ports clean and empty with a USB Dust Plug Charging Port Cover. Made from a rubber/silica gel mix, they fit snugly and can be easily removed.

We have two packs of five dust plugs (mixed colours) up for grabs. Be in to win one of them by entering on our website.

Entries close Monday 31 July.

2to WIN!