You are prioritising the backlog for a product that has no users yet, so there is no reach or impact data. How do you rank it?
Stop ranking by value, which you cannot know, and rank by uncertainty instead: sequence the work that would most cheaply tell you the whole idea is wrong. Scoring frameworks fed with invented numbers launder a guess into a decision, and their real cost is that nobody revisits the guess.
What the interviewer is scoring
- Whether the candidate switches the ranking criterion from value to uncertainty rather than inventing scores
- Does the answer identify which assumption failing would invalidate the most other work
- That the cost of learning is separated from the cost of building the real thing
- Whether the ranking states what evidence would reorder it, and when that evidence arrives
- Does the candidate name what must be built regardless of any learning, and why
Answer
Why a scoring framework produces the wrong answer here
Scoring models are ratio arithmetic. Every one of them divides some estimate of benefit by some estimate of cost, and the ranking they produce is only as meaningful as the numbers you feed in. With a live product, reach comes from instrumentation and impact comes from past releases, so the estimates are anchored to something. With no users, reach and impact are both invented, and the model becomes a machine for converting a guess into a number that looks like evidence.
That would be merely useless if it were visible. What makes it harmful is that the output is durable and the inputs are not. Three weeks later the spreadsheet is what people refer to, the reasoning behind each score has evaporated, and nobody re-examines the estimate that drove the whole ordering, because it no longer looks like an estimate. This is the specific failure to name if an interviewer asks you to apply a framework to a pre-launch backlog: not that scoring is bad, but that scoring hides which of your inputs is load-bearing.
Rank by what would change your mind
The useful reordering is to stop asking which item is most valuable and start asking which belief, if false, would waste the most subsequent work. That gives you a sequence rather than a ranking, and a sequence is what you actually need before launch.
Write the idea down as a short chain of things that all have to be true. For a tool that lets independent letting agents handle tenancy renewals, the chain might be: agents currently lose money on renewals; they handle enough of them for a tool to matter; they would let software send documents to tenants on their behalf; they will pay per property rather than per user; and we can obtain tenancy data from the systems they already use. Now ask of each link how confident you are, and how much of the plan collapses if it is false. The data-access link is the interesting one, because if the incumbent systems will not export tenancy records then almost nothing else on the backlog has a purpose. The pricing-model link is uncomfortable but survivable; you can change the pricing model without discarding the product.
So the first thing to work on is not the highest-value feature, it is whatever settles the data-access question, and that is very often not a feature at all. It might be two phone calls and reading a public API's documentation. A backlog whose first three items are integration spikes and pricing conversations is not an unfocused backlog, it is a correctly ordered one.
Separate the cost of learning from the cost of building
The move candidates miss is that each assumption has two prices: what it costs to test and what it costs to satisfy. Ranking on both together is what produces the sensible order.
| Assumption | Cost to test | Cost to build properly if true |
|---|---|---|
| Tenancy data can be extracted from incumbent systems | Two days reading docs and one call | Six to eight weeks of integration work |
| Agents will let us send documents to tenants | Four conversations | Already in the design |
| Agents will pay per property | Ten pricing conversations, or a landing page with prices | Nothing to build |
The pattern that emerges is nearly always the same: the assumptions that are expensive to satisfy are cheap to test, because testing is a question and satisfying is an engineering programme. That asymmetry is the whole argument for sequencing this way, and stating it explicitly is what makes the answer sound like experience rather than a recited method.
What you build regardless
Not everything is subject to learning, and pretending otherwise is its own failure. Some work has to happen because the product cannot exist without it, because it is a legal condition of operating, or because retrofitting it later costs several multiples of doing it now. Authentication, an audit trail in a regulated workflow, and the data model for the core entity all fall into this group. So does whatever is needed for anyone to see the product at all, which is easy to forget when the backlog has been written by people who already understand it.
Keep that group small and name it as a group, because it is where zero-to-one backlogs bloat. Every engineer has a defensible reason why some piece of infrastructure must come first, and the honest test is whether the cost of adding it after the first ten users is more than about twice the cost of adding it now. If it is not, it waits.
The failure mode you will not see coming
What sinks a pre-launch backlog is rarely insufficient rigour. It is rigour in the wrong direction — spending a fortnight producing a defensible ordering of forty items when the product will be unrecognisable after the first fifteen real users, and then defending that ordering because of the effort it cost. Sunk analytical cost behaves exactly like sunk engineering cost and is harder to spot, because the artefact looks like diligence.
Two habits guard against it. First, attach an expiry to the ordering: this sequence holds until the integration spike reports, and we re-rank then. Second, keep the list short enough that re-ranking is cheap. A backlog of a dozen items in a stated order that everybody can hold in their head survives contact with evidence; a scored register of forty items does not get re-scored, it gets worked through.
And when a founder or an executive arrives with the order already decided, the answer is not to produce competing scores, which invites an argument about numbers neither of you has. It is to agree the sequence and attach the assumption to it: we will build it in that order, and it rests on agents being able to export tenancy data, so let us spend two days confirming that before we spend six weeks assuming it. That framing costs nobody any face and it puts the falsifiable thing on record, which is the only part that matters afterwards.
With no users, the ranking criterion is not value but the cost of being wrong. Sequence the work that most cheaply tests the belief the rest of the plan depends on, and attach an expiry date to the ordering so evidence can reorder it.
Likely follow-ups
- Your riskiest assumption is that people will pay. What is the cheapest honest test of that?
- Your founder has already decided the answer and wants the backlog to reflect it. What do you do?
- How does your ranking change the week after the first ten real users arrive?
- Which item would you build even though you believe it adds no value, and why?
Related questions
- The platform migration has no user-visible benefit. How do you rank it against features customers are asking for?hardAlso on prioritisation5 min
- Feature delivery and paying down architectural debt are competing for the same engineers. How do you decide the split and defend it?hardAlso on prioritisation6 min
- Growth in your core market has flattened. Do you go upmarket, into an adjacent market, or deeper into what you have?hardAlso on sequencing5 min
- The bid is due in five days, three technical sections are unanswered and the clarification window has closed. How do you run the last five days?hardAlso on prioritisation5 min
- Tell me about a time you had far more work than you could deliver. How did you handle it?mediumAlso on prioritisation5 min
- Tell me about a time you had to deliver with unclear requirements or a deadline you did not believe in.mediumAlso on prioritisation6 min
- Your Product Backlog has grown past four hundred items and refinement takes two hours a week without anything getting clearer. What would you change?mediumAlso on prioritisation6 min
- Your team wants to rewrite a service that works. How do you decide, and how do you say no if that is the answer?hardAlso on prioritisation6 min