Background

Credible is a marketplace for student loans, student loan refinancing, and personal loan. Pre-qualification is an important part of the whole process: By filling one pre-qualification form, users will be able to see a list of qualified lenders and rates.

GOAL AND METRICS

Increase the conversation of pre-qualification form

Before I started, it’s important to understand the problem and make sure all the stakeholders are aligned on the same goal. So I talked to the product manager, loan operation and client success team and listed out the following design success metrics.

Form conversion

Increase the conversion rate of pre-qualification form - increase the percentage of user who finished the form compared to the number of users who start the form.

Process completion

Improve conversion rates through the full funnel: If the design has a positive impact on these aspects, we could consider it as successful.

User friendly

Improve the overall experience of the pre-qualification form. Make the form more efficient and friendly to fill out.

Round 1

Broad explorations

RESEARCH & EXPLORATIONS

Users don't want to create account

Conversation data from Google Analytics reveals that there is a large drop off on the last step. We learned from survey that users don't want to create account. But an account is necessary for finalizing loan application. Our hypothesis is that different flow of creating accounts will impact conversion. Here are several options I’ve explored.

Current
Create account at end of form

Option 1
Create account at beginning

Option 2
Create account after result summary

Option 3
Separate email and password

DESIGN AND A/B TESTING

Test creating account flow

One of the challenges we have is that, in order to track different designs impact around the full funnel, the traffic on Credible is not large enough to run multiple ab testing at the same time. So we have to select one direction and run only 2 to 3 testing at the same time to confidently test the hypothesis. We ranked these three directions based on impact and effort. We choose to test the create account flow because we believe it will have the highest impact with relative low implementation efforts.

Baseline: create accounts at the end of the form

In the current design, we try to push the difficult part to the end of form so that user will start easily and make through the end with momentum. But we are still seeing a lot of drop-off at the create account step.

Create account first

Creating accounts first will definitely cause a lot of drop-off at the very beginning. But on the other hand, by revealing the most sensitive information at the front, this will filter out low intent users and improve the conversion later in the process.

Create account after user get results

Give user tease of the result will motivate users to create accounts. For users who receive rates, give users a tease of how many options they have got and overlay the modal on their dashboards. But for users who didn’t receive any rates, we don’t want to mislead them so the main message is “Your result is ready” and it won’t be an overlay of the dashboard.

Ask email at front and password at the end

The hypothesis here is that separating email and password will reduce the feeling of creating accounts so that user feel this is less friction.

RESULT

Creating accounts at beginning won

The experiment has been running for about 1 months to make sure we have enough data and draw the conclusion without bias.

+15.7%

Creating accounts first

Variation 1 has 1.3% increase on form conversion and 15.7% increase on from starting the form to close a loan.

-6.4%

After getting results

Variation 3 has negative performance compared to baseline. It has a 6.4% decrease on form conversion and 1.9% decrease on close loan.

LEARNING

Creating accounts is not the real problem

1) Even though variation 1 and 2 ’s form conversion are pretty similar, but creating accounts first have a more positive impact later in the process with indicates that our hypothesis is correct. Users who are willing to create accounts first have higher intend and will convert better later in the process.

2) Separating the email address and password field variation performs worst. This indicates that “creating account” itself is not the real problem. There is some reason behind “I don’t want to create account”

Round 2

Dig deep into the problem

RESEARCH

Why don’t users want to create accounts?

Quantitative

The 1st round experiment has set up a good foundation for us. The data reveals that on creating account page, there is a large amount of drop off, but after creating accounts, there are very few users abandon the form. So it’s clear that the biggest opportunity is how can get more low intend users filling the form and checking their rates.

Qualitative

The testing result from the first iteration also reveals that what really bothers users is not creating accounts, we need to dip deeper to learn the reason behind that. So I did more depth interview with users. The real insight comes after I asked several why.

Findings

The user research reveals the real friction of creating accounts is that we are asking user their personal/private information without offering them any value. Users don’t have any idea of what’s going happen next and what they can get.

HYPOTHESIS AND CONCEPTS

Transparency at beginning of the form

Based on user research the primary problem we are trying to address is to build trust with users through bringing more transparency.

Same reason as mentioned above, now we need to choose directions we want to test. Since the improvements are all focusing on create account page, efforts to implement the design are about the same, this time I did internal concept testing. With the testing, I asked participants to rank different concepts based on the helpfulness. Concept 5 and concept 3 get the highest ranking. Below is the summary of this concept evaluation:

DESIGN ITERATIONS

Iterations on rate estimator

After the internal testing, I decided to move forward with the video walkthrough concept and the rate estimator concept. It’s time to push the details. I did several iterations to make sure users can understand how to use it.

Iteration 1

(Option 5 from the previous step)

Iteration 2

Design with real content and data

Iteration 3

Rate chart add too much cognitive load

Iteration 4

1. Credit score section took too much space. 2. Too much number to process

Iteration 5

Use red on poor credit score bad may give user negative feeling

Iteration 6

Users indicated they don’t know the slider is interactive

TESTING

Design variations

Variation 1: Video to illustrate the process

This variation features a quick walkthrough video of our process up to a dashboard. The hypothesis was that showing users our simple process would help users know what to expect, and therefore make the process feel known and simple.

Variation 2: Rate estimator

This variation aims to see if showing potential rates would, in fact, increase sign-ups and overall conversion. This variation features an interactive slider where users can estimate their credit score (by 10 point increments), and we will display the lowest possible rate across lenders.

RESULT

Video variation won the test

+6.6%

Video variation

Video variation has a slightly 1.8% decrease on account creating compared to baseline, but it has a 2.1% lift on form conversion and 6.6% lift on close loan

-3.6%

Rate estimator variation

Rate estimator variation has 12.3% decrease on account creating compared to baseline and 3.6% decrease on close loan.

LEARNING

Transparency helps to build trust

-From the winning variation, we learned that providing users context about the process and what to expect appears to help build trust with users and contribute to higher overall conversion after a user has been prequalified.

Even though rates estimator concept performs worse than the video we still want to understand why users are leaving. So I put up an exit survey asking users why they are leaving this page. It turns out that the primary reason is that the rates are too high for them. Even though this variation didn’t perform very well, we still think this is an interesting concept that we could evolve and use in other scenarios in the future.

Round 3

Opportunities on Mobile

RESEARCH

Mobile traffic ramped up

Quantitative:
Loan application is complex and we don't expect users finish the process on their phone. However, in 2017 Credible’s mobile traffic start to ramp up and exceed desktop traffic but the form conversion rate on mobile is pretty low. So it’s time to put more investment on mobile and improve the experience on mobile.
‍
Qualitative:
In order to understand the pain points and frictions on mobile, I did a usability test on the old mobile form. Here are the key insights
-Limited information in viewport causes a lot of scrolling back and forth
-Users’ initial impression is the form is really long and would take them a while to finish
-Users had difficulties answering some questions (e.g. income), they need to click tooltips and use the help content. But tooltips on mobile generally doesn't have a good ux

HYPOTHESIS AND CONCEPTS

More efficient way to fill the form on mobile

Based on the research finding, the team came up with four design principles. I explored 3 options: the chat UI, one question per step and linking to other social network to pre-fill information. In order to pick the which option we are going to implement, we listed out how each concept would solve the problem and how difficult it is to implement and decide to move forward with one question per page option first.

Reduce scroll back and forth

Make the form shorter or make the form feel shorter

Add more humanize factor to the form

Surface the help content to streamline the process

DESIGN ITERATIONS

Iterations on one question per page

Variation 1: Video to illustrate the process

Iteration 2: Turn dropdown to multiple selections

I tested the prototype above, it successfully reduced the back and forth scrolling. But I still found that all the drop-down fields still requires multiple taps. In order to simplify this part, I changed the drop-down fields to multiple selection fields.

The challenge here is that if the selection has more than five options, what should we do? The product manager helped me analysis the option selection data. We found out that the first four selected options cover 93.17% of our users. So the solution is to surface the top four selected options and hide other options in “Other”.

Iteration 3: Add delight to the product

The last iteration is to add more delight to the design and make the look and feel more friendly for our users. So I added icons on every page and animations on some key pages.

TESTING

Design variations

We tested the final one question per page design with old design (baseline). Below is the two design’s overall flow.

RESULT AND LEARNING

One question per page won the test

Variation 1 has an 18.5% lift on form conversation compared to baseline and an 8.8% lift on closing loan. We decided to call one question per page as the winner and allocate 100% traffic.

The analysis validated our hypothesis that asking one question at one time streamline the process.

By surfacing the help content and why we are asking these questions, users have less difficulty answering questions. We see a decreased drop off rate on some “hard” questions.

In the future, we are planning to test the new design also on the desktop

Option 1 - Value prompt

Participants like it's straightforward but value prompt is too vague and doesn’t resonate with them

Option 2 - Social proof

Participants think social proof is important but they prefer reviews from the third party. Participant won’t trust testimonials.

Option 3 -Process Video

Participants find it’s very helpful to understand the process, the video makes it easier to understand

Option 4 - Sample dashboard

Participants like that they can know what lenders are on our platform but the information is too generic

Option 5 - Estimator

Participants all feel this is really helpful to get an estimated range before jumping into creating accounts they indicated that if the rates are good they are more likely to sign up.

Company

Have a Project Idea?

Web Design

UI/UX

Motion

Branding

Framer

Development

Webflow