Five.

Heirlum

Discover and explore a city through its music.

Person interacting with Heirlums in AR headset.
Person sharing an Heirlum with another person wearing a headset.

design challenge

How might we immerse people in the musical culture of a city through exploration and spontaneous discovery?

Target Audience for toolkit:

Tourists, city-explorers

My Roles

Lead Designer
UX Researcher

Team

Sam O'Brien
Erfan Dastournejad
Sebastian Torres

Timeline

October - December
(3 Months) 2018

key interaction moments

1

Person records a performance in their AR headset.

2

Person shares performance in headsets with a friend.

3

Person drops the recorded performance at the location.

4

Another person, at different time, explores all the Heirlums dropped in his area

5

Person pursues the Heirlum that they saw when they were browsing

6

Person discovers the location where the Heirlum was dropped and the recording itself

background

Exploratory Design

This project was an exercise in conceptual and exploratory design. We were not trying to solve for a design "problem." Rather we were looking for a design opportunity based on our personal experiences with music.

How We Arrived at the Design Challenge

We asked ourselves how do people currently experience music and why do people listen to music in general?

Brainstorming whiteboard with post it notes.

Current Music Experiences are Isolated

We noticed that streaming music experiences, which are currently very popular, are very individual, personalized, and on-demand. We wanted to explore how we could create a collective music listening experience focused on sharing.

Drawing Inspiration

We were inspired by Jack Mackie's bronze footsteps on Capitol Hill in Seattle, which invite passerby to follow footsteps to learn dances.

Passerby watch as a person interacts with a street installation in Capitol Hill, Seattle.

Phase 1: physical installation

Storyboarding

One of my ideas was a geography based music discovery experience, where people could find music tagged to specific landmarks in the world. To communicate my idea, I drew the following storyboard that portrays a person discovering the song Waterfalls by TLC at a water fountain.

A storyboard depicting an early idea version of our installation idea.

Sketching

I sketched out different ideas as our group discussed them during our brainstorming sessions.

Idea 1: The Jukebox

Early brainstorming sketch of our installation.

Idea 2: Interactive Node Installation

Early sketch of our interactive node installation.

video prototyping

Planning Video Shots

I helped plan our shots and write the narration for the video prototype.

First Video Prototype

After a day of shooting I edited our teams first video prototype demonstrating our interactive node idea.

key interaction moments

Person notices glowing orb on wall that emits a faint sound.
Person approaches orb and view and hears the preview of the performance playing inside.
Person touches orb which intensifies with light and sound and pulses away along the sculpture.
Person follows pulse along the sculpture.
Person finds the full sculpture in one central location where it projects and plays the performance.
People congregate around the hear of the sculpture and admire the musical performances.

Evaluation

While we were pleased with the experience portrayed in our video demo, we felt that the sculpture had several limitations:

To resolve these issues, we decided it would be appropriate to transfer the essence and experience of our sculpture to an AR application.

phase 2: AR experience

sketching

I sketched an idea of people discovering music by following virtual breadcrumbs that led to dropped music recordings in AR.

Sketch of new AR idea.

Storyboarding a New Concept

Pushing off the virtual breadcrumb idea, my team and I developed a new concept: people discover a city's music culture by sharing, pursuing, and exchanging recordings of artists and musicians in AR. I wrote the storyline for the storyboard, while my teammate, Erfan Dastournejad, drew the frames.

Storyboard of new AR Heirlum idea.
Storyboard of new Heirlum idea.

feature Highlights & design rationale

Color System

I used two different colors to distinguish between heirlums dropped by you versus heirlums dropped by other people.

Heirlums in Your Collection

Blue Heirlum representing Heirlum in your collection.

Heirlums Dropped by Others

Magenta Heirlum representing Heirlum dropped by another person.

UI Navigation Ring

We avoided gestural navigation because it forces users to make movements that looks strange from an outsider's perspective. In a search for a more subtle navigation method, we decided to use a touch sensitive ring which users could interact with using just their thumb.

Person scrolling through Heirlums using interactive ring.
Scrolling through Heirlums in AR headset.

Compass/Distance Based Navigation

We also moved away from the "breadcrumb" navigation that we planned in an earlier sketch to a compass driven navigation that pointed the user in the general direction they needed to go. The compass navigation gave users more freedom and encouraged them to look at their environment.

Navigation compass guiding a person towards an Heirlum
back to work

4nikitak@gmail.com