HUB-AR caters their mobile app, H.AR, to large, outdoor-event organizers. The augmented reality technology and user-centered approach allow people to find people and places.

Role
  • Product Design
  • UX Design
  • Visual Design
  • Branding + Identity
Deliverables
  • Competitive analysis
  • User research + surveys
  • User personas
  • User stories + flows
  • Wireframes
  • Style guide
  • Mockups
  • Clickable prototype
Tools
  • Sketch
  • InVision
  • Craft plugin
  • Adobe Illustrator
  • Adobe PhotoShop

Duration: About 1 month

OVERVIEW

Problem

Dolores Park, a mostly lawn,16-acre public park in San Francisco’s Mission District, draws large crowds on sunny days. During those times, people have trouble finding each other and experience long bathroom lines. Additionally, the large crowds attract charismatic vendors who sell consumable products by walking around. Users find it hard to find these vendors when they want to.

Solution

A mobile app that leverages augmented reality technology as a wayfinding tool to find people and moving vendors. The second component of the solution is communal input as a way to share information on restroom line lengths and vendor locations.

See Prototype

DESIGN PROCESS

Icon with smiley face

Takeaways

Explaining *4.1 Product Repositioning:


Though I initially had my sights on a product for a specific location, designing features led to the realization that the same technology can apply to many other situations; particularly large, outdoor events.


This is where the idea got bigger. If finding people and locations, finding changing locations, and rating places can help alleviate the stresses of crowded events with the aid of AR, HUB-AR has the potential to access the events market.

DISCOVERY

WHY DOLORES PARK?

Dolores Park during Pride Weekend.

Intro

Due to its great location, milder Mission District micro-climate, and beautiful views of the city, Dolores Park draws huge crowds on sunny weekends while the height of its human-density occurs during Pride Weekend every year.


Though I’ve frequented this park numerous times, I can’t recall a bad day at the park. Only small blips along the road (like finding people). I realized that this was the first common problem on a typical day there and wondered about more opportunities to make a good day a great and seamless day.

Often a fun set of characters (and animals).

It's Free, Casual, and Organic

Dolores Park reflects the diversity, quirkiness, and freedom of expression that exemplify San Francisco’s unique qualities. Costumes, spontaneous shows, tight-rope-walking, and leash-free dogs are commonplace. People come to play, to picnic, see their friends, people-watch, and be part of the palpable energy.


Additionally, alcohol and marijuana are freely comsumed on site. Although public drinking is illegal on public property in California, this law is somehow overlooked at Dolores. Long before marijuana was legal, people consumed it there freely. This almost-unspoken “pass” that people get at this particular location adds to the atmosphere of the park.

Google Earth model

The Landscape

The park is fairly large (16 acres) and open with large slopes down to Dolores St. With it being so open, I conjectured that the lack of landmarks was part of the reason people had trouble finding each other

Coconut Kyle (far left) and Truffle Man (far right)

The Amenities

Dolores Park also serves as an economic opportunity for people. The most well-known vendors are the “Truffle Man” and “Coconut Kyle” (Or, Michael, the Coconut Guy).


With people imbibing freely, restrooms lines are a concern for many Dolo-goers (later confirmed with data).

"Dolo" app from 2013

A Friend-locating App Did Exist

A friend-finding app, Dolo, existed in 2013, but is now defunct. This app is not to be confused with a more recent app, also called Dolo, that offers insider-local tips.


Since 2013, Dolores Park has only gotten more crowded on nice days and Pride attracts more people than ever before.

AR + Dolores Park = ?

With my interest in AR, I knew that this would be a great opportunity to take a fresh look at the Dolores Park experience to facilitate opportunities.


Halfway into wireframing the app, I realize that the features tested at Dolores Park can apply to other outdoor situations, which led to the eventual concept of HUB-AR.

COMPETITIVE ANALYSIS

Pokemon Go

Players can collect virtual creatures that evolve and battle with each other.

  • Great 3D animation / graphics
  • Immersiveness: 1) 3D map reflects weather and time. 2) Can see same Pokemon with other people. 3) People have to meet IRL locations to "raid" Pokemon (the more people, the more likely to catch)
  • Must be in flat, open area for maximum AR effect
  • Would be great to battle other players in AR
Yelp Monocle

Available in the regular Yelp app. Overlays Yelp-reviewed places to your camera’s view.

  • Uses familiar Yelp UI
  • Immersiveness: Makes Yelp come to life
  • Distances from you to places shown are not accurate
  • Dots on compass confusing in relation to what’s shown
  • Review sign is not in an obvious location when you get to your destination
  • Hard to know if users can accomplish their goals with the aid of this tool
Arrow

Users can animate text and make scenes come to AR life. Can record scenes to share.

  • Animated 3D signs and effects are engaging
  • Many customization options (fun + expression)
  • Immersiveness: Placing the message in space means the user can experience the message
  • Scaling and depth control for objects is confusing: there is one slider to control both
  • Would be great to have selfie-camera capabilities
iScape

Users can place landscape elements in AR to design their real spaces (indoor or outdoor).

  • 3D models are detailed and convincing
  • Makes designing small landscapes accessible
  • Immersiveness: Quality of 3D model and placing large items allows user to experience a newly designed space
  • Downloading models take time and bad reception will make process very slow
  • Would be great to upload user’s own 3D models
Icon with smiley face

Takeaways

  • The problem across AR apps these days is that the “magic” disappears when new objects interact with virtual objects (see image above). AR objects introduced after virtual objects are placed appear behind the AR object, even if the real life object should be in front.
  • Pokemon Go is a great example of AR’s ability to create immersive experiences. For H.AR's MVP, this level of immersion is not necessary as much as accuracy.
  • Yelp Monocle's confusing wayfinding feedback was a great starting point to understand executing wayfinding in AR.
  • Arrow’s floating messsages was a good lesson in legibility and scale in relation to a virtual object’s surroundings.
  • iScape’s large-object-placing demonstrates a great deal of promise in how detailed 3D models can enhance the immersive experience.

USER RESEARCH

Survey Goal

The goal of the survey was to pinpoint and prioritize the user needs of Dolores Park-goers for the purposes of an MVP. The beauty of augmented reality is that it reveals hidden layers of information that users can't otherwise access. With an understanding that this information will only be available upon user-participation, the survey also tested what users want versus what they're willing to do.

What Do People Do At The Park?

What are the reasons you've visited Dolores Park?

97%

To hang out with friends

;

55%

For a special event (like Pride)

;

16%

To hang out solo

;

What kinds of activities have you participated in there?

97%

Eat / drink

;

97%

People-watch

;

77%

Drink alcohol

;

55%

Smoke pot

;
What Do Dolo-goers Want?

Have you ever had trouble finding people at the park?

87%

Yes

;

10%

No

;

3%

I have never had to find people

;

Why do you think you had trouble finding people?

93%

It was too crowded

;

70%

No significant landmarks to refer to

;

37%

Poor communication

;

What information would you like to know about the rest of the park while you're there?

87%

How long the bathroom lines are

;

68%

Where are the vendors?

;

39%

Who is single?

;

29%

I'd like to see messages/signs from other groups

;
What Are Users Willing To Do?

What information would you be willing to share publicly while you're at the park?

84%

How long the bathroom lines are

;

68%

Where are the vendors?

;

35%

If I'm single

;

42%

A message/sign from my group to other groups

;
Icon with smiley face

Takeaways

Though embarking on the social aspect was enticing (finding an avenue for singles and groups to mingle), the most obvious features to tackle for an MVP were:


  • A way for people to find each other
  • A way for people to know restroom line lengths
  • A way for people to know where the moving vendors are

STRATEGY

PERSONAS

Image of Jonny

Meet Jonny

The Social-media Butterfly

  • Age: 35
  • Occupation: Operations Consultant
  • Location: Oakland, CA

“It’s hard when there’s special events, it’s shoulder-to-shoulder, super-packed. There aren’t any landmarks. 10 feet over could mean like 500 people.”

Motivations
  • Likes outdoorsy things, gardening, cooking, and sharing things on Facebook, Instagram, and Snapchat
  • Likes to attend Pride events at the park
  • Also goes to Dolores park for doggy birthdays or random hangouts when the weather is nice
Goals
  • Finding her friends/group at the park
  • Finding a shorter line for the bathrooms when the park is packed
  • Finding things to share via social-media
Frustrations
  • Finding friends on crowded days
  • Long bathroom lines on crowded days, even at the port-o-potties
  • Would like to know if there was a calendar of local events that took place at the park
Image of Barry

Meet Barry

Keeping It Simple

  • Age: 28
  • Occupation: Software Engineer
  • Location: San Francisco, CA

“I can specifically remember walking on Dolores street and calling or texting friends and asking where they are. They may say things like “close to the center walk,” but that’s super general. It usually doesn’t take that long to find them, but it’s still always a process.”

Motivations
  • Likes efficiency and simplicity in things
  • Likes the outdoors and playing frisbee at the park
  • Single and ready to mingle
Goals
  • Finding his friends/group at the park
  • Having people join in on frisbee games when his group needs more players
  • Knowing if someone is single
Frustrations
  • It’s “always a process” to find his friends when he arrives at Dolores Park because there are no significant landmarks to refer to
  • There might be people at the park wanting to join in on a game, but it’s hard to communicate that
  • It would be nice to know if people are single to break the ice
Image of Emily

Meet Emily

Livin' In The Present

  • Age: 25
  • Occupation: Interior Designer
  • Location: San Francisco, CA

“Usually when I’m at Dolores, there is drinking involved. Handicap number two is that I’m checking my phone intermittently because I’m already socializing. I’d see a text and realize that the person has already been there for like 10 minutes and I’d call the person right away.”

Motivations
  • Likes yoga, traveling, and drawing. Embraces being mindful
  • Usually acts as "the gatherer" of her friends (planning/organizing)
  • Likes the one-on-one time with all her friends
Goals
  • Finding her friends/group and be found easily without having to find everyone who is trickling in to join the group
  • Having more uninterrupted time with friends
Frustrations
  • Finding friends on crowded days / having friends find her on crowded days when she’s already set up camp
  • Long bathroom lines on crowded days
  • Not knowing where the vendors are when she needs them
Image of Sal

Meet Jonny

The Social-media Butterfly

Image of Will

Meet Barry

Keeping It Simple

Image of Jim

Meet Emily

Livin' In The Present

  • Age: 35
  • Occupation: Operations Consultant
  • Location: Oakland, CA
  • Age: 28
  • Occupation: Software Engineer
  • Location: San Francisco, CA
  • Age: 25
  • Occupation: Interior Designer
  • Location: San Francisco, CA

“It’s hard when there’s special events, it’s shoulder-to-shoulder, super-packed. There aren’t any landmarks. 10 feet over could mean like 500 people.”

“I can specifically remember walking on Dolores street and calling or texting friends and asking where they are. They may say things like “close to the center walk,” but that’s super general. It usually doesn’t take that long to find them, but it’s still always a process.”

“Usually when I’m at Dolores, there is drinking involved. Handicap number two is that I’m checking my phone intermittently because I’m already socializing. I’d see a text and realize that the person has already been there for like 10 minutes and I’d call the person right away.”

Motivations
  • Likes outdoorsy things, gardening, cooking, and sharing things on Facebook, Instagram, and Snapchat
  • Likes to attend Pride events at the park
  • Also goes to Dolores park for doggy birthdays or random hangouts when the weather is nice
Motivations
  • Likes efficiency and simplicity in things
  • Likes the outdoors and playing frisbee at the park
  • Single and ready to mingle
Motivations
  • Likes yoga, traveling, and drawing. Embraces being mindful
  • Usually acts as "the gatherer" of her friends (planning/organizing)
  • Likes the one-on-one time with all her friends
Goals
  • Finding her friends/group at the park
  • Finding a shorter line for the bathrooms when the park is packed
  • Finding things to share via social-media
Goals
  • Finding his friends/group at the park
  • Having people join in on frisbee games when his group needs more players
  • Knowing if someone is single
Goals
  • Finding her friends/group and be found easily without having to find everyone who is trickling in to join the group
  • Long bathroom lines on crowded days
  • Not knowing where the vendors are when she needs them
Frustrations
  • Finding friends on crowded days
  • Long bathroom lines on crowded days, even at the port-o-potties
  • Would like to know if there was a calendar of local events that took place at the park
Frustrations
  • It’s “always a process” to find his friends when he arrives at Dolores Park because there are no significant landmarks to refer to.
  • There might be people at the park wanting to join in on a game, but it’s hard to communicate that
  • It would be nice to know if people are single to break the ice
Frustrations
  • Finding friends on crowded days / having friends find her on crowded days when she’s already set up camp
  • Long bathroom lines on crowded days
  • Would like to know where the vendors are more easily so she won’t leave the park to buy things
Icon with smiley face

Takeaways

The survey and user interviews allowed me to prioritize these user types:

  • Finder
  • Gatherer
  • Restroom Seeker
  • Restroom Reporter
  • Vendor Seeker
  • Vendor Reporter

With more time, it would've been great to include a feature to connect outdoor communal activities (like frisbee and yoga) and a way for singles to connect.

AR METHODS

Occlusion Is The Next Breakthrough

The issue I mentioned in Competitive Analysis, the problem with overlay when new and moving real-life objects are introduced to virtual objects, is an issue of occlusion.


That is, current apps in the market cannot detect the depth of new and fast-moving objects (like a hand), then render a masked version of the virtual objects to the user’s screen.


The two companies that I’ve seen actively tackling occlusion right now (Feb. 2019) are: Niantic and Placenote (though I’m sure there are other companies).

But, Occlusion Is Still Difficult

Current available apps’ inability to occlude AR objects, was particularly worrisome because finding someone through AR requires pointers/markers. Additionally, if the whole point is to navigate through large crowds (lots of fast, moving objects), how do we handle the issue of occlusion?


The answer was in some site analysis and in this article by Placenote and hinges on a pre-mapped environment.

Hacking Around the Occlusion Issue

GPS Accuracy

GPS accuracy has come a long way in smartphones and will only get better. According to MIT Technology Review and the IEEE, Broadcom chips allowing 30cm (slightly less than a foot) accuracy will begin rolling out. In fact, the Xiaomi Mi 8 include this chip and rolled out May 2018.

Marker Strategy

Icon with smiley face

Takeaways

  • Large-environment pre-mapping: theoretically possible. It seems plausible to pre-map a large environment for the model to communicate with the user’s location to determine where to show markers on the user’s screen. But I wonder what kind of processing power this will take.
  • Occlusion of non-static objects, still an issue. Image C shows an 8 foot volume on top of surfaces where people can stand. The purpose of this, as mentioned before, was to have markers exist above this volume. But, as for non-static objects (like people, shown in image D), the issue of occlusion, again, becomes an issue.
  • How will users ultimately see the marker? Theoretically, if the environment is pre-mapped, wouldn’t the app be able to detect what is NOT part of the model? I wonder how fast is this detection and with what accuracy is possible with current technology.
    Additionally, would users prefer to see: image F or image G?. The marker at image G is above the obstruction, where as in image F, the marker remains in front of the obstruction. Would the depth visualizer be enough? With the marker in front of the object, does this confuse things less than image G, where the marker looks like it’s above the obstruction?

INFORMATION ARCHITECTURE

USER STORIES + FLOWS

User Story #1:

As a finder I want to find my friend(s) as soon as possible so I can join the person or group.

User Flow:

Iteration 1 (initial sketch)

Iteration 2 (vectorized, cleaned up)

Iteration 3 (more thorough, shows users a way out)

Final Results Preview:
User Story #2:

As a gatherer I want to invite my friends so I can send them to my location to find me

User Flow:

Iteration 1 (initial sketch)

Iteration 2 (vectorized, cleaned up)

Iteration 3 (more thorough, shows users a way out)

Final Results Preview:

SITEMAP

WIREFRAMES

Sketches

Vectorized Lo-Fi

VISUAL DESIGN

BRANDING

Moodboard

My inspiration came from tropical images. Tropical, here, has a set of deep and saturated colors, light and muted colors, and high-chroma brights. The textures are organic and the feeling is festive.

Color Palette

From the moodboard images, I derived a color palette that gave off a similar vibe.

Layering In Nature

AR is about the layering of information, so I sought a way to convey a sense of layering with the UI. Inspired by natural elements, I experimented with some linework which was later incorporated as buttons and panels.

Hard Identity

Soft Identity

Logo

By "hard identity," I mean that H.AR should have a permanent logo that's simple and on the conservative side, while the "soft identity" can change as tastes change.

Typography

I chose one very screen-legible font, Inter. The single-font choice was made in anticipation of complex UI elements. With more types, I felt that future content may become needlessly cluttered.

HI-FI MOCKUPS

Company Website

HUB-AR, the app, is also a company and needed a website. Above shows two different schemes that were preference tested.

Mobile App

HUBS

The homepage for HUB-AR is where users can access all of their hubs. It can be Dolores Park (HUB-Dolo) or whichever hubs on the list (HUB-AR's clients).

THE AR IS FOR...

Setting virtual markers and having people be able to find it. The UI, shown at the right, still needs to be tested.

See Prototype

AID FROM MAPS

Orienting people will need more than just AR. I believe that clear, well-crafted, interactive 2D maps with icons will be necessary.

See Prototype

CATEGORIES

For the MVP, HUB-Dolo, has three distinct categories: 1) Events, 2) Restrooms, and 3) Vendors. Through the "Events" category users can find their friends and create their own event to drop their own markers.

See Prototype

FEATURES

"Restrooms" and "Vendors" have three features: request, report, and find. The "request" feature sends a message to the park so other users can "report" this info. The "find" feature allows users to either find the restroom or vendor.

USER TESTING

PREFERENCE TESTS

67%

33%

Web Landing

Users generally liked the details shown in the darker version.

**

32%

68%

App Colors

Users preferred the lighter background for clarity.

**

**Results may have changed since posting

PROTOTYPE TESTING

REFLECTIONS