Indeed Employer Feature Usability Study
Executive Summary
As a UX researcher in a rapid research capacity, I partnered with a colleague to evaluate two new features based on earlier research: saving video interview questions for reuse and saving promising candidates for other job positions.
Using moderated usability testing with employers, we evaluated how usable these features were and how well they supported employer needs.
We identified key usability issues and provided actionable recommendations: For the saved questions feature, we found terminology confusion and apparently redundant save options that hindered usability. For the candidate saving feature, we discovered employers wanted to personalize messages and were confused when saved candidates seemed to disappear.
Our recommendations led to concrete improvements: the question-saving team conducted a follow-up study incorporating our changes, resulting in improved understandability and ease of use, while the candidate-saving team's designer confirmed implementation of our recommendations.
This project demonstrated the effectiveness of targeted rapid research in delivering valuable user experience improvements in a short timeframe.
Saving Video Interview Questions
Saving Promising Candidates
The Challenge
Indeed's SMB teams had developed two new features to improve employers' hiring workflows:
The ability to save and reuse video interview questions
The ability to save promising candidates for consideration in other job openings
Both features were developed in response to a previous round of evaluative research, but the teams needed to understand:
How intuitive were these new features to use?
Did they effectively address the actual needs of employers?
What refinements were needed before full deployment?
My partner and I collaborated closely with the product teams to establish clear research objectives and ensure our findings would directly support their development decisions.
Methodologies
Method Selection and Rationale
I selected moderated usability testing within a rapid research framework as the primary methodology.
Why Rapid Research:
Time-sensitive development cycle: The product teams needed actionable insights quickly to meet development deadlines
Iterative approach: Rapid research allowed for multiple rounds of testing and refinement
Focused scope: By narrowing our research questions to specific usability concerns, we could deliver high-impact findings efficiently
Resource optimization: The approach maximized insights while minimizing time investment from stakeholders and participants
Why Moderated Usability Testing:
We needed specific feedback on interaction patterns and user interface elements
The features were already in prototype form and needed validation before final development
The tasks had clear success metrics that could be observed
We needed rich qualitative insights about employer expectations and mental models
Rapid Research Approach
Compressed Timeline: Completed research cycle in 2 weeks (planning to presentation of findings and recommendations)
Participants: Employers from SMB segments who regularly conduct interviews and hiring
Session Structure:
Remote moderated sessions (1 hour each)
Structured task scenarios with consistent moderation protocol
Real-time synthesis of findings between sessions
Test Materials: Interactive prototypes of both features with focused interaction points
Tasks: Realistic scenarios that required participants to use the new features within typical workflows
Data Collection:
Think-aloud protocol for verbal feedback
Observed confusion points and workarounds
Post-task reflection questions
Analysis Approach:
Same-day synthesis after each session
Pattern identification across participants
Severity ranking of identified issues
Collaborative solution development with product teams
Presentation of findings and recommendations delivered within 48 hours of final session
Key Findings
Saved Interview Questions Feature
Positive Finding: All participants expressed interest in sharing saved question sets with colleagues, indicating strong potential value for team collaboration.
Finding 1: Terminology confusion Employers were confused by the "Question Templates Library" label and didn't intuitively know where to find their saved questions.
Evidence: The majority of participants hesitated when asked to locate their saved questions, with comments like "I'm not sure what a template library means in this context."
Finding 2: Redundant save options Employers were uncertain about the difference between two similar-looking save options, creating decision paralysis.
Evidence: Most participants asked for clarification about the difference between "Save" and "Save to template library" buttons.
Saving Candidates for Later Feature
Positive Finding: Employers were very enthusiastic about the concept of saving promising candidates, with several participants sharing additional scenarios where this feature would be valuable.
Finding 1: Message personalization needed Employers strongly desired the ability to personalize messages sent to candidates when considering them for alternative positions.
Evidence: Nearly all participants attempted to edit the message template and expressed frustration when unable to do so.
Finding 2: Candidate disappearance confusion Employers were confused when candidates they "saved for later" seemed to disappear from their view without clear indication of where they went.
Evidence: Most participants expressed confusion with comments like "Where did she go?" after saving a candidate.
Confusing name for saved questions
Confusing to have two save buttons
Employers wanted to personalize messages
Seems like Janett disappeared after saving her
Recommendations
Saved Questions Feature Recommendations:
Rename "Question Templates Library" to "Your saved interview questions" to clarify functionality
Rationale: Uses plain language that directly describes the content
Expected impact: Reduced confusion and faster task completion
Consolidate save options into a single dropdown with clear labeling
Rationale: Eliminates redundancy and clarifies the difference between options
Expected impact: Reduced decision paralysis and confusion
Save Candidates Feature Recommendations:
Add message personalization capability when considering candidates for other positions
Rationale: Employers want to maintain a personal connection with promising candidates
Expected impact: Increased employer satisfaction and more effective candidate communication
Improve visibility of saved candidates by showing them in the job's saved candidates list with an "undo" option
Rationale: Creates a clear visual trail of actions taken with candidates
Expected impact: Reduced confusion about where candidates go after being saved
Rename saved questions location
Rename default save with a dropdown for template
Enable editing of the message
No more disappearing Janett
Impact and Outcomes
Implementation Results
Saved Questions Feature:
The team conducted a follow-up study during a later rapid research session, incorporating both of our recommended changes
Results showed significant improvements in understandability and ease of use
The collaborative approach between research and product teams enabled quick iteration and implementation
Save Candidates Feature:
The designer confirmed implementation of the recommended changes:
New behavior for "saved for later" candidates for improved visibility
Editable messages when considering candidates for alternative positions
The designer adopted our recommendations without requiring additional validation, demonstrating the clarity and feasibility of our proposed solutions
Business Impact
These improvements directly support Indeed's business goals by:
Reducing time spent on repetitive tasks in the hiring process
Improving employer satisfaction with the platform
Increasing the likelihood of finding suitable candidates by enabling cross-job consideration
Supporting better candidate experience through personalized employer communication
The enthusiastic reception of the "save candidates for later" feature in particular indicated strong potential for increasing employer retention and satisfaction with the platform.
Key Learnings & Transferable Insights
This project demonstrated how targeted usability testing with a focused approach can yield significant improvements to feature design. By collaborating closely with product teams throughout the process—from establishing research objectives to delivering actionable recommendations—we were able to positively impact the employer experience on the Indeed platform.
The success of this rapid research approach reinforced the value of iterative testing in the product development process. Both teams were able to take our findings and quickly implement changes, with one team conducting their own follow-up study to validate improvements. The fact that both concepts were well understood by employers, with the "save candidates for later" feature being particularly well-received, validates the value of user-centered design in creating effective recruitment tools.