Design Process
The making of Recordo
FOUR MONTHS OF DEVELOPMENT
Project Development Timeline
SCOPING THE PROBLEM SPACE
Problem Statements
Problem: The widespread use of mobile technology among senior citizens, including those aged 60 and above, has grown significantly (Pew Research Center, 13). However, research indicates that older users face challenges when it comes to learning and retaining new technological skills beyond basic functions. Despite the increasing ownership of smartphones among adults over 65, they tend to make errors, require more time to acquire skills, and need additional assistance, especially in tasks beyond basic phone use (Kelley & Charness, 1995). So How might we help the elderly to record information about processes and procedures important to their daily lives, and ensure this population can easily access and retain that information?
User Priorities: Our target audience is elderly mobile device users who often resist or are unfamiliar with new technology. They need assistance with documenting steps for unfamiliar technologies and daily life procedures. Seniors prioritize staying connected with family, monitoring health, and daily tasks, but their resistance to change, despite potential benefits, stems from perceived barriers due to their age.
Existing Solutions: Elderly mobile technology users primarily rely on basic built-in mobile apps or desktop word processors for process documentation, but many prefer handwritten notes due to security concerns and the perceived complexity of digital tools. This reliance on traditional methods limits their access to mobile technology’s benefits. Existing digital tools, while feature-rich, can overwhelm older users. There’s a clear need for a simplified process documentation application tailored to tech-averse seniors struggling with complex tasks like appliance use or app installation.
Design Requirements: Our proposed tool aims to simplify the documentation of daily technology procedures for older users, ensuring ease of use and replicability. Key features include creating, editing, and deleting procedure documents, browsing saved procedures, and integrating multimedia for instructional purposes. Additionally, we plan to explore the potential for external users, like caretakers, to contribute and collectively edit documents, leveraging AI transcription for user-generated multimedia elements. We’re also investigating the feasibility of offering a pre-loaded library of basic technology-related procedures to create a valuable archive for elderly users.
Stakeholders: The primary stakeholders are elderly mobile technology users. Physicians and family members could play a role in seniors’ tech adoption (Abdelrahman et al., 2020) and could contribute to the app as contributors. However, the app aims to primarily address the potential interaction challenges faced by the elderly.
USE CASE ILLUSTRATION
Story Board
1.Rita is not great at remembering how to use smart applications.
2.She alway asks her son, and he would explain to her.
3. A few months later, Rita forget how to use it again,
4.Rita’s son is away and not available
5.Rita’s son made all the note in the app for her, so she can check it out anytime!
6. Each application has video and audio transcription, explaining how to use it. (Created by her son)
7. Rita can replay the steps that she missed if she only forgets a certain part of the process.
8.Rita feels empowered and now makes her own coffee without asking for anyone’s help.
GETTING TO KNOW THE USER
User Interview
- Understand the target domain’s usage of technology and their levels of proficiency.
- Understand the target domain’s preferences for devices, applications, and activities.
- Understand how the target domain approaches learning new things associated with technology and how they retain that information.
- Understand how the target domain accesses what they’ve learned afterward.
- Learn about the relationship between members of the target domain and other individuals involved in their use and learning of new technology.
In addition to the interview, we also administered a short survey before the interview that gauged user’s proficiency in operating an array of traditional home appliances, smart devices, & mobile phone applications.
This assessment questionnaire enumerates various household appliances, smart devices, and mobile phone functionalities commonly utilized in people’s lives. Given the distinct usage scenarios and levels of difficulty associated with these three categories of products, we aim to gain insights into the usage patterns of elderly individuals through this assessment questionnaire. Our objective is to pinpoint specific areas where they encounter difficulties. Click to View the pre-interview assessment
You can click to see the full file.
- What devices or machines do you use on a daily basis?
- What about your smartphone? What do you use it for? Which applications do you use the most?
- How confident do you feel in your ability to use mobile devices on a scale of 1–10, with 1 being least confident and 10 being most confident?
- What about your confidence in using technology in general (such as smart TVs, smart assistants, etc.) on a scale of 1–10?
- Do you feel like you understand immediately when learning how to operate a new device or machine, or do you take more time to work through the steps of a procedure?
- Do you usually prefer to learn new things independently, or do you prefer to learn with the help of others?
- Three scenarios (Questions to me ade for coffee maker, smart device and smartphone)
- If someone gave you a new coffee machine, how would you go about learning how to use it?
- If you ran into an issue while operating that same coffee machine, how would you go about learning how to fix it?
- What steps would you take to ensure you can remember how to operate the coffee machine in the future?
- In general, how do you store important information you need to reference in the future?
- What is your preferred method for learning how to do something new, such as operate a new device or gadget? For example, do you watch YouTube videos, review product manuals, ask others for help, or take a different approach?
Interviewee Profiles
- Our team conducted five, 10-to-20-minute semi-structured interviews with five interviewees over the age of 55, all of whom both owned and used a smartphone.
- The interviews were conducted either in-person in Ann Arbor, Michigan or remotely via Zoom, with participants based in Kaohsiung, Taiwan and Quito, Ecuador.
- All transcripts were generated using Zoom’s built-in transcription functionality, with Spanish and Mandarin interviews translated into English by the relevant interviewers.
INTERVIEWEE #1 | Location: In Person (Ann Arbor, MI) | Age: 70 | Gender: M
Characteristics: Physician. Prefers staying at home over traveling. Uses a laptop primarily to watch videos and read news headlines. Uses an older model of smartphone that provides basic functionality. Depends heavily on help from wife and three adult children for tech needs.
Interview conducted in English.
INTERVIEWEE #2 | Location: In Person (Ann Arbor, MI) | Age: 59 | Gender: F
Characteristics: Homemaker. Began using Facebook recently with initial reluctance. Uses a desktop computer for managing accounts and a smartphone for social media and taking pictures. Adventurous, interested in learning about new technologies but does not necessarily incorporate them into her life.
Interview conducted in English.
INTERVIEWEE #3 | Location: Online (Quito, Ecuador) | Age: 61 | Gender: F
Characteristics: Handcraft specialist. Divorced, grandmother lives by herself, and owns a cat. Leads a relatively simple life, selling specialty handcrafted items, socializing with friends, and enjoys watching movies. Not particularly tech-savvy, but confidently uses basic functions on her cell phone. Rarely uses newer tech devices like smart assistants.
Interview conducted in Spanish.
INTERVIEWEE #4 | Location: Online (Kaohsiung, Taiwan) | Age: 56 | Gender: F
Characteristics: Works as a manager at a local bank. She has a routine 9-5 job, which keeps her busy throughout the week. She lives alone as her spouse and children are not currently residing with her. She has a small dog for companionship. Recently exposed to newer tech devices like smart assistants.
Interview conducted in Mandarin.
INTERVIEWEE #5 | Location: Online (Quito, Ecuador) | Age: 58 | Gender: F
Characteristics: Personal Assistant. Divorced, has one daughter who she lives with. She is pretty knowledgeable tech-wise. Manages two smartphones, utilizes a variety of applications and services. Lives a busy life around work but enjoys sharing with friends a lot. Not familiar or interested in new technology.
Interview conducted in Spanish.
Interview Findings
Self-directed learning enhances overall proficiency and results in longer-term retention of skills.
“If I made my own notes, I believe I would remember better.”
“There are people who set it up for me, which also hampers my learning.”
Learning modalities and Environmental factors can influence the acquisition and retention of skills across different technological platforms.
“I physically write it down, or write in my Notes on my phone”
“I would write a note and put it on the door of the fridge,” and “I save emails or I write emails to myself.”
Users may find themselves learning (or not learning) from videos in different languages, delivered too quickly, or simply not relevant to the problem they are trying to solve.
“I usually start by using YouTube, and if I feel unable to handle something on my own, I always rely on my sons or a close friend to supplement that information. Tutorials are my primary go-to.”
“Even if I wanted to learn, many online tutorial videos speak too fast for me to understand,I am not like younger people.”
Older users often find new technology complex and fear the responsibility for any damage, leading to avoidance strategies to cope with tech challenges.
“I’m actually quite afraid of breaking things or making them worse.”
“I wait for another day to see if the problem goes away!”
“If it’s too complicated or complex of a smart system, then I may not even bother about it.”
Personas
User Flow Diagram
Paper Prototype
1. Welcome Page
The landing page for the application where either new users can create an account or existing users can sign into their account
2. Sign In
Existing users can either input their email and password to access the app or begin password recovery
3. Sign Up
New users are prompted to fill out the Name, Email, Password, and Password Confirmation fields to create their account with the app.
4. Onboarding
Once new users have created an account, they are guided through onboarding slides that introduce them to key app functionality
1.Start Recording
If user decides to “Create Recording,” they are taken to camera function with ability to toggle between Auto/Manual recording modes
2. Recording
The user presses the central Record button and performs all their desired procedure steps in one uninterrupted video
3.Finish Recording
After completion of the recording, the user presses the Stop button and is prompted to confirm whether to save or delete the recorded procedure
4. AI Processing
Upon pressing Save, AI video editing begins process of separating recorded video into steps for user to review
5. Result Review
The AI-generated step videos are displayed for user review. The app begins playing each step with its transcript. User can tap on any step or tap the “pencil” icon to edit transcript.
6. Edit or Delete Clip
User is able to make adjustments to the clip using the timeline editing tool, by dragging or tapping on “+” and “-” signs. “Save” is pressed when done
7. Name Procedure
Upon reviewing all procedure steps and making desired edits, user is prompted to name and describe the procedure before final “Save” of the recorded procedure
8. Published Confirmation
Upon pressing “Save” button, the user is presented with a confirmation screen that indicates procedure was published and is accessible in their library
1. Switch to Manual Mode
If user instead toggles to Manual mode, they are directed to screen with empty video frame placeholders to fill in with media steps
2. Recording
After tapping on an empty placeholder, the user can press the Record button to film a short video. In this example screen, the user is recording second step
3. Importing Media
Instead of producing an in-app video recording, users can opt to upload existing media from their Camera Roll, such as video and images, to a step
4. Tap to Review Media
User can tap on an individual step frame to review the recorded or uploaded media and decide whether to edit the step
5. Edit or Delete Step Media
User is able to make adjustments to the step using the timeline editing tool, by dragging or tapping on “+” and “-” signs. “Save” is pressed when done
6. AI Transcpting
Upon pressing Save, AI video editing begins process of transcpting the text.
7.Result Review
The videos are displayed for user review. The app begins playing each step with its transcript. User can tap on any step or tap the “pencil” icon to edit transcript.
8. Name Procedure
Upon reviewing all procedure steps and making desired edits, user is prompted to name and describe the procedure before final “Save” of the recorded procedure
5. Procedures Page
Users can view the list of existing procedures they have created using the app and have the option to search and filter results
6. Procedure Steps
Upon clicking on a listed procedure, users can view procedure details broken down into steps through the individual procedure page
7. Step Video
After clicking on a particular step, the user is taken to the relevant video recording. A transcript of any audio associated with the step is also available
Paper Prototype User Testing
TEST A: SIGN-IN + AUTO MODE TASKS (User #1 + User #2)
In this user test, we have two tasks that we would like you to complete using the application:
- The first task is to sign in to an existing account on the application
- The second task is to use the application’s Auto Mode to record a procedure
TEST B: MANUAL MODE TASKS (User #3)
In this testing case, you will be exploring the Manual Mode for recording procedures, which has more capabilities than the Auto Mode. In this user test, we have four tasks that we would like you to complete using the application:
- The first task is to record Step 1 using the phone camera
- The second task is to import existing images and videos from the phone’s Camera Roll as separate steps into the procedure
- The third task is to edit the length of the video in Step 3 down to 20 seconds
- The fourth task is to publish the procedure, then name it
User Feedback / Analysis:
User exhibited hesitation when interacting with the plus sign icon on the home page. However, after a thorough examination of the interface, they deduced that it was used to create a new procedure. The absence of a label or text descriptor likely contributed to this confusion.
Potential Solution:
Labeling more elements or standardizing action buttons across the application will improve how these available actions are perceived, especially for elderly users. A more descriptive or clear presentation of primary actions is needed to guide user interaction.
User Feedback / Analysis:
User faced challenges while attempting to operate the smart assistant and record its use with just one hand. This specific user scenario may not have been taken into full consideration.
Potential Solution:
Our app could provide suggestions at the onboarding or tutorial levels—or even a module in the Support Library—to advise users on how to overcome this difficulty and provide interaction alternatives.
User Feedback / Analysis:
Upon reaching the ‘Review Procedure’ page, user expressed: “I don’t understand what this is.” The prototype did not adequately communicate to the user that review would be possible post-AI processing. This page lacked clear indications and descriptors, and left the user puzzled about its purpose and functionality.
Potential Solution:
Our app needs to provide the necessary information and support for users—in the onboarding process and on this specific ‘Review Procedure’ screen—so that they are able to identify when AI processing is occurring, as well as understand that the resultant page will be a preview of their new procedure that they can act upon.
User Feedback / Analysis:
User was unaware of possibility of speaking during recording session to make use of the available AI transcription feature. They also questioned whether the step frames would populate only if they had provided audio input during recording. This feature lacks clear communication about the app’s reliance on audio input to effectively divide content into distinct step frames.
Potential Solution:
A pre-recording prompt or guide could educate users on the role of voice input, and a visual cue during recording could encourage them to utilize the feature.
User Feedback / Analysis:
User was able to understand the purpose of the ‘Review Procedure’ page, but did not immediately notice the ‘Publish’ button at the top right of the screen. Action buttons are often placed at the bottom of the screen, which could have contributed to the user’s difficulty in locating ‘Publish’ in the top right corner of the interface. While this particular placement prevents premature publication and encourages thorough review, it could also introduce a usability challenge.
Potential Solution:
It may be beneficial to introduce subtle visual cues or guidance to direct attention toward the ‘Publish’ button in the top right corner, in a way that ensures users are aware of all available functions on a given page without detracting from their review process.
User Feedback / Analysis:
User was uncertain about the function of the two sets of +/- buttons in the video editing interface. They questioned aloud whether it mattered which side of the video they edited from. This indicates potential misalignment between design intent and user perception.
Potential Solution:
It is important for our app to rely on more familiar user interface patterns and OS conventions to help users have a better chance of recognizing the gestures that need to be performed to edit the length of a video clip.
User Feedback / Analysis:
User was confused when they tried to open their Camera Roll because they thought that the camera button indicated taking a photo. This confusion occurred because the button did not make it clear that it could be used to access existing photos.
Potential Solution:
Introducing a plus sign to the camera icon or using a photo thumbnail could create a more universally recognized symbol for importing or adding media, in alignment with common mobile OS conventions, in order to reduce user confusion.
Wireframes
Lo-Fi Digital Prototype and User Testing
Please expand to full screen.
- Login
- Review a project (has to choose”Smart Assistant”)
- 2-a: ask them to review all steps of Smart Assistant
- 2-b: ask them to review just step 3 of Smart Assistant
- 2-c: while on step 5, ask them to go back to step 2.
- Create a new procedure in Auto Mode.
- 3-a: Record one and satisfy the result, just publish.
- 3-b: Record the first one but not satisfied, so cancel the processing to retake recording.
- Create a new procedure in Manual mode.
- Following the steps in the order : 1. Record one video, 2. Import 3 media (in the sequence of my screen), save and review then publish.
- Ask them to review the Library and Profile (ask their thoughts and see if they scroll the content on Library )
User Feedback:
The interviewee proposed that when utilizing Auto mode, users may inadvertently skip a step during recording. Therefore, they recommend that the review page should provide an option for users to edit or add new recordings.
User Feedback:
The interviewee believes that the editing function should be accessible during the media insertion phase, rather than waiting until the review page. She suggests that users should be able to rearrange the order of the steps by dragging them and enter the editing page by double-tapping on the step frame.
User Feedback:
The interviewee suggests that the Publishing Page should include a section where users can specify the “type” of their project.
User Feedback:
The interviewee, after examining the library’s interface, believes that the home page should be as visually appealing as the library. Alternatively, they suggest providing users with the option to customize the layout, including categories and display formats, potentially through settings on the settings page.
Design Iteration
Reflections
This was my first app design project, and I learned a great deal throughout the process. I am deeply grateful for the SI582 – Interaction Design course offered by the School of Information at the University of Michigan, which provided me the opportunity to bring my ideas to life step by step. My collaboration with my team was seamless: Pedro, a UI designer from Ecuador with a wealth of design experience; Tara from Ann Arbor, Michigan, who brought excellent communication and teamwork skills; and myself, from Taiwan, contributing numerous creative ideas and meticulous design thinking.
Through this project, I clarified areas of confusion I had encountered in online courses—not just through practice, but through extensive reading. The field of Human-Computer Interaction (HCI) has a robust framework for service development, with clear guidelines from problem statement, scoping, storyboarding, user journey mapping, user interviews, to prototyping, which I really appreciate. This framework ensures that designers care not only about aesthetics but also about being well-informed. Each phase is underpinned by theoretical foundations, including understanding human cognition, how perception and memory work, and how to evaluate usability.
I believe this project has the potential to develop into a real service product, and I hope to bring it to fruition in my future career!
Photos
