July 16, 2021
How Wealthfront’s Scientific Product Development Process Helped 2X Their User Growth
Get the best content on product management,
UX, and growth delivered to your inbox every week.
As a product manager (PM), your biggest wins come from creating products that delight customers. Customer-centric products create memorable experiences that keep customers coming back for more. Satisfied customers spread the word to their network, inspiring others to sign up and enjoy the same value.
No wonder companies spend so much time, energy, and money rolling out shiny new features, hoping to instantly find the one that makes customers fall in love.
Andy Rachleff, the CEO of Wealthfront, is famous for saying, “You can't iterate your way to product-market fit. Either the dog eats the food, or they don't.” In other words, adding new features won’t solve a product-market fit problem.
Companies need a clear, detailed, and customer-centric approach to the product development process that puts customers at the center of the roadmap and aligns every product decision with their best interests. PMs will fall victim to their own biases and make critical decisions based on assumptions rather than verified data from the horse’s mouth, without a process in place.
Wealthfront consistently nails the customer-centric product development process. Little wonder they have an impressive 450,000 clients and counting.
So, what’s the secret to their success? How did they grow to become one of the largest independent digital wealth management firms?
In Episode 1 of the People Driven Products podcast, we talked to Dan Slate, Wealthfront’s Senior Director of Product Management, to learn about the company’s strategic product development process. Dan oversees the product team within the organization as they collaborate to create a financial system that favors people over institutions. His experimentation-based approach to building and shipping customer-centric products has helped drive the company’s growth.
We'll take a deep dive into Wealthfront's step-by-step scientific product development process. You’ll see first-hand how Dan tests what customers think about a feature, his go-to consumer insight methods, and the essential trait he believes every great product manager needs to thrive. Finally, you’ll learn why Wealthfront's robust product development process works well for them and how you can apply his 5-step approach to your product strategy.
Wealthfront’s Scientific Product Development Process
It can be pretty tough for PMs to choose the right ideas to explore, which features to roll out, or where to focus their efforts. In addition, it’s sometimes difficult to know whose opinions to prioritize: the customers', the executive team’s, or your own gut. That’s why it’s essential to have a well-defined product development process.
Wealthfront adopts a scientific experimentation approach to product development. Dan’s perspective on product management reveals his healthy obsession with delighting customers. “At its core, product management is about running experiments to learn about what customers want and what they value,” Dan says (tweet this).
Together with his team, Dan created Wealthfront’s experimentation framework to test ideas and uncover the best solution for customers. The framework is a three-part process. Here’s what it looks like:
The product team, customers, stakeholders, and data/research from industry experts contribute insights to drive the process. These insights are fed into the product feature backlog. Finally, product managers put these insights through a step-by-step process to choose the right idea to explore (or feature to build).
Like a science experiment, the process includes the following steps:
- Step 1: Make an observation
- Step 2: Ask questions
- Step 3: Craft a hypothesis
- Step 4: Test the hypothesis
- Step 5: Iterate
Let's discuss each step in detail:
Step 1: Make an observation
For PMs, an observation simply means identifying a customers’ pain point. Every product (and product feature) is designed to solve a specific problem the customer is experiencing. And the true measure of a product's success is not its visibility but its impact—how well it solves customers’ problems.
Wealthfront uses a customer development framework to engage with and listen to their customers to determine their needs. They validate ideas generated with this framework as well.
So, how does it work?
The framework relies on user insights that come from a variety of sources. Dan's top three go-to customer insights sources are the consumer insights team, data science team, and product support team.
Let’s explore each in detail:
1. Customer Insights Team
Dan considers the customer insights team as one of Wealthfront’s secret weapons. “The customer insights team is an experienced team that is constantly working ahead of our roadmap using a variety of methods to help us understand what our customers are thinking about next," he says.
The team uses a blend of surveys, qualitative interviews, and traditional methods like user research and usability testing. They generate rich customer insights that reveal customers’ motivations, explain their behavior, and pinpoint what the team should prioritize in the next release.
One example is Wealthfront’s survey of customers who opened an account but never made a direct deposit. They try to understand what roadblocks prevented these customers from doing so. In this case, user research software is used to get insights faster so PMs can make stronger observations and informed product decisions in seconds, not days or weeks.
With Userleap, for example, your customer insights, research, or even your product team can launch targeted micro surveys to learn, in real-time, why your customers sign up, engage with certain features, and stay loyal or churn.
You can launch these microsurveys in a few minutes by selecting a template that correlates to the product issue you are experiencing and start getting insights within 1-2 days.
2. Data Science & Product Support Teams
The data science team generates insights based on data in Wealthfront's customer database. The product support team generates insights from daily tickets. Product managers read through these tickets and figure out what customers are asking. The support team categorizes this data, so it's easier to prioritize issues that come up frequently.
"We use these insights to enhance the product and also validate bigger opportunities we have been thinking about. We spot themes in what our customers expect from us next,” Dan said. “That's an incredible advantage when you think about the investing market right now.”
Dan added that the data obtained from customers’ daily inquiries helped the team visualize the monumental shifts in consumer behavior in real-time. It still has a huge influence over Wealthfront’s product development process.
3. Other Insight Generation Methods
Wealthfront also uses social media to understand why customers choose to use their service. The team tries to identify what they need to do to inspire trust and loyalty in customers and boost retention rates.
Wealthfront also gets qualitative, visual feedback from a small group of early adopters through video interviews. That way, the team receives unparalleled insight into what is working and what wasn't. They also play these videos during biweekly product review meetings for the rest of the team.
"I think one thing you get from those videos is that you can sense the energy people have about the features,” Dan says. “It's one thing to read a customer review on a sheet of paper or a slide. But to actually see them say it. You can gauge it over and over again to see if this is something that people really want.”
A mix of surveys, insights from product support teams, and visual feedback gave the team clarity into the core features that resonated with customers. With these insights, they nailed the core use case for that product, expanding its audience and delivering its promise.
Step 2: Ask a Question
After making an observation, the next step is to find your customer's “why.”
Knowing your customers’ “why” helps you create a compelling roadmap that secures buy-in from stakeholders and enthusiasm from the organization. It also allows you to choose features to prioritize (tweet this).
A critical "why" to keep in mind, according to Dan, is the reason your customers hired you in the first place. When you understand why they hired you, you can focus your efforts on solving that particular pain point. In other words, the core product has to be working before you expand and sell them on a new feature.
"It doesn't make sense to expand to new product lines if you haven't delighted your customers with the core use case they hired you for,” Dan says. “It’s critical to know what your customer is hiring you for on that first use case and make sure you delight them and nail that before moving on to adjacent markets or problems.”
Moving on to explore new product opportunities before nailing your core use case sets your company up for failure. “It results in a shifting of resources back and forth between different product lines and the company,” Dan says. It’s like a dog-chasing-its-tail situation—resulting in wasted time, energy, and money.
It’s easy for inexperienced product managers to fall prey to the next feature fallacy. They may think building a new feature will solve all the problems their business or product is facing. However, nailing the core product offering (and keeping your promise to your customers) is what matters most.
Customers are rarely interested in adopting new offerings from a company that hasn’t first delighted them and won their trust. So instead, focus on satisfying the early adopters before expanding to new product offerings.
"At Wealthfront, when we look at building products, we focus on delighting the early adopters,” Dan says. “We make sure that the product works well for them. We try to understand the source of the value, and we figure out whether or not we've found a product-market fit before moving onto opportunities to expand further."
Bottom line: Before expanding your product's scope, confirm you have satisfied the early adopters.
Step 3: Develop a Hypothesis
Innovative product teams build on the ideas generated from their customer insights. They don’t indulge assumptions. Instead, they craft a strong hypothesis from the ideas generated and test it before investing in it.
Dan's article, the visionary dilemma, outlines two key elements PMs must consider when deciding whether to expand the scope of a product or focus on improving the product: product performance and resourcing.
Let’s explore each in detail:
Dan believes that a brand “earns the right to explore new product opportunities when the performance of your product and new enhancements surpasses what customers value or are prepared to use.” To understand the concept better, Dan uses a simplified version of Clay Christensen’s product performance framework:
Any product at the far left end of the blue line hasn't earned the right to explore new product opportunities. In other words, when your product hasn't fulfilled its initial promise (the solution it promises), investing resources to create new product lines will be a waste. On the other hand, when you focus on delighting your customer first before rolling out shiny new features, you'll keep progressing up and to the right of the blue line, exceeding customer expectations.
Wealthfront also uses a framework internally called exploration vs. optimization to determine where to invest resources.
With this framework, Dan and his team identify what the customers need most at a given time and where they should channel their resources. Dan says, “broadening product scope too soon often results in resource shifting from one product to the next, which rarely results in any one product being successful.”
PMs need to answer these questions when deciding when to kick off new product development:
- How much do we need to invest in maintaining dominance in our core product?
- How much do we need to invest to launch a new product successfully?
Evaluating and answering these questions help PMs determine whether or not they have the team resources they need to go in both directions or prioritize one over the other. Here’s how you can tell where to focus your efforts:
To pursue new product opportunities, resourcing should “stack” over time toward new product opportunities, so you don’t shift focus from your core product abruptly. If pursuing new product opportunities causes you to divert too many resources from the core product, that’s a sign that you are investing too soon.
Ignoring resource assessment sets you and your team up for failure. You risk taking on too much too soon, failing to delight customers, and decreasing your chances of earning their trust and loyalty.
Based on insights from resource assessment, the team can allocate time on either improving the core product offering or exploring new opportunities. The time allotted depends on the stage of the product’s development, where the company is, and the strategy at a given time. Many of the new opportunities fail once they are tested, while some are shelved for future use. But, overall, the method helps the team invest company resources in the right direction instead of shifting them back and forth, eventually wasting them.
Step 4: Test the Hypothesis
After crafting a hypothesis, the next step is to test it.
Depending on the product, Wealthfront uses a clickable prototype to get concrete evidence that customers will use the new feature (or product). They also try to understand how customers will get value from the update.
How do they get the answers they need?
According to Dan, relying on the words and enthusiasm of customers when it comes to rolling out new product features isn't a great way to go. People’s actions don’t always align with what they say. So, PMs shouldn’t prioritize everything a customer demands. That's why testing is critical.
Here's how Wealthfront tests a hypothesis:
When testing an idea, Dan and his team take a core insight and formulate a point of view. Then, they try to figure out if that insight is a problem for their customers. This part is critical because that’s where they determine if customers truly need the product or it’s a mere desire with no real, long-term value.
Next, they try to envision what the solution might look like. The result of this process is a clickable prototype presented to the customers. The goal is to figure out if these customers would use the product if it existed. If the answer is no, they don’t throw in the towel. Instead, they push to understand why.
According to Dan, it's usually in the process of understanding “why” that you uncover insight about the true nature of the problem, and it allows the team to iterate their point of view. For example, most customers don't realize the cost of developing a product feature. So, if you ask if you should build a new feature, they'll say yes. The way around spending too much on a feature no one might use is to get some sort of commitment from them.
Dan and his team assess whether or not they should pursue a new product by asking customers if they are willing to pay to be a part of an early access program. Gauging their commitment level is critical to Wealthfront’s overall health, given the timelines and complexities of the products.
“If we're going to spend six months to a year bringing a new product to market, we want to know that we're pretty darn confident that it's going to have the impact that we expect," Dan says.
The trick is to make sure that the scales are in your favor. Aim to be right more often than not, and the magnitude of success should be high.
Let’s Explore Two Contrasting Examples Wealthfront's Hypotheses Tested:
In late 2018, Wealthfront rolled out a free financial planning product to give customers access to world-class financial advice.
The team hypothesized that before clients could invest, they needed to do financial planning. Existing customers signaled that their financial planning offering was valuable and resonated with them. So, Wealthfront launched the product as a way to generate leads and convert them into investment clients:
The outcome wasn’t as anticipated. Even though it drove customer acquisition, the conversion rate wasn’t impressive.
On the flip side, they observed that customers had lots of cash sitting in low-interest-bearing accounts. So, in early 2019, they launched their high-interest cash management account for customers saving for short-term goals such as rent, a new car, etc.
The company partnered with FDIC-insured banks to hold customers’ deposits. The product performed far better than the financial planning feature tool, nearly doubling Wealthfront’s ARR that year.
So, even though both hypotheses passed the test, only the high-interest cash management account yielded more than the desired outcome.
Step 5: Iterate Outcomes
In this phase, the goal is to use the results to make new hypotheses and take a step back to evaluate your process. Are there loopholes or signs you overlooked? What could you have done better?
According to Dan, a product's success relies on a blend of validated insights and the PM's judgment. That's why product managers need to be intellectually honest with the data they gather from customers to avoid building the wrong things.
Every time Wealthfront runs their process, they first try to understand customer insights. They try to see how much they trust what the customers say, check out customers’ interviews stored on their wiki, and calibrate those insights against their judgment. The method isn't fool-proof, but product managers should be content knowing they'd never be 100% right all the time. But they can develop their judgment to make smarter decisions to utilize the product development budget effectively.
The #1 Quality PMs Who Want to Create People-driven Products Must Have
To build successful products, Dan believes the top skill all product managers need to have is curiosity. "Being a product manager is all about assumptions, so you need to be able to ask great questions, investigate the world around you, and always find ways to learn new things," he says.
Curiosity is a critical aspect of being an effective product manager. Find new ways to learn and be curious about the world around you. Keep an eye out for data points that don't make sense. Take a deep dive to find out why. Most times, you'll turn up with nothing. But one out of a hundred times, you might turn up with a game-changing insight for your business.
Conclusion: Embrace Customer-Centricity To Build Products People Love
Creating products that people love starts with a healthy customer obsession. And without customer insights, it’s impossible to know what your customer thinks, how they feel, and how they make decisions.
Instead of being laser-focused on the competitor's playbook, Dan and his product team at Wealthfront use customer insights to understand how they can deliver optimum customer value. Thanks to a robust experimentation framework that allows them to improve and learn continuously, Wealthfront is always working to serve customers better.