In the previous guide -- Getting Started Guide #4 - When (and How) to Run a Synthesis Study -- we covered how to set up a Synthesis study correctly. This is part 2, covering the next step, using the results properly.
How to read a Synthesis study and use the results to move a decision forward.
A Synthesis output is not meant to be read like a traditional report.
If you read it that way, you will either:
- over-interpret individual numbers, or
- miss the signal entirely
Instead, Synthesis answers a more specific question: Across everything we’ve learned, which patterns actually hold? And are they strong enough to act on?
Start with the right mindset
Before diving into the sections, it’s important to recalibrate expectations.
A Synthesis study is not:
- a measurement of real-world prevalence
- a statistically representative survey
It is a structured way to test whether patterns from earlier qualitative work remain consistent across contexts.
That means you are not reading for certainty. You are reading for pattern stability.
1. Where to start: the Executive Summary
When you open a Synthesis report, always start here.
The Executive Summary is not just a recap of results, it tells you what problem you are actually solving.
How to read it
Don’t look for isolated findings. Instead, look for the tension underlying them.
Most useful Synthesis outputs can be simplified into a structure like:
People are interested in X,
but something prevents them from acting on it
That “something” is what matters. It is the friction, contradiction, or constraint that defines your decision.
What you should take away
If you can summarize the entire study in one sentence, like: “There is interest, but it breaks down at this point.”
Then you’ve read this section correctly.
2. Understanding signal strength (Strong, Indicative, Exploratory)
Each finding in the report is labeled by signal strength. These labels are easy to misunderstand.
What they do NOT mean
They do not mean:
- how many people believe something
- how accurate something is in the real world
What they do mean
They tell you how stable a pattern is across simulated contexts.
- Strong => appears consistently across contexts
- Indicative => appears in some contexts, but not all
- Exploratory => appears narrowly, not yet stable
How to use them
- Strong signals can guide decisions directionally
- Indicative signals suggest areas to probe further
- Exploratory signals should not be acted on directly
A useful rule: Signal strength tells you how stable a pattern is, not how common it is.
3. Reading distributions: don’t treat them like survey data
Synthesis reports include distributions, which are percentages across options. This is where most misinterpretation happens.
What not to do
Avoid reading them like: “X% of people believe this”
That is not what the percentages represent!
What to look for instead
Distributions show:
- which direction is most common
- how strongly one option leads
- whether responses are divided or aligned
What does matter
Focus on:
- the gap between options
- not just the number itself
A leading option that is far ahead signals something very different from one that is only slightly ahead.
A useful rule: Look at how far the top option leads, not just its percentage.
4. Pay attention to distribution shape
Each question is usually summarized with a shape:
- Clustered
- Fragmented
- Mixed
This is one of the most useful -- and most overlooked -- parts of the report.
What each means
- Clustered
- One option clearly leads
- The signal is more stable and often actionable
- Fragmented
- Responses are split across options
- There is no clear agreement yet
- Mixed
- There is some direction, but no strong dominance
- The signal exists but is still early
How to use it
- Clustered signals can inform action
- Fragmented signals require caution
- Mixed signals suggest further exploration
A useful rule: Shape tells you whether a signal is ready to act on or still contested.
5. Directional lean: is there a clear way forward?
Each theme will also have a directional lean:
- positive
- negative
- neutral
What “neutral” means
Neutral does not mean “nothing is happening”. It just means there is no strong directional push yet.
Why this matters
A neutral outcome often indicates:
- multiple forces pulling in different directions
- unresolved tension
- incomplete signal
A useful rule: Neutral means “do not commit yet” not “there is no insight”.
6. Stable Patterns: what actually holds
This is one of the most important sections of the report. It consolidates which patterns remained consistent across contexts.
How to read it
Look for:
- repeated tensions
- recurring barriers
- consistent trade-offs
- shared motivations
What you are building
From this section, you should be able to form a simple structure:
Driver => what creates interest
Barrier => what blocks action
Implication => what this means for the decision
A useful rule: Stable Patterns are the closest thing to “truth” in a Synthesis study.
7. Decision signals: how confident should you be?
This section tells you how to interpret the overall result. In practical terms, it answers the question: Can we act yet?
Typical interpretations
Strong and consistent signals => you can move forward, with validation
Mixed or fragmented signals => proceed cautiously
Mostly indicative signals => direction exists, but needs testing
What this really means
Synthesis does not remove uncertainty. It helps you understand where uncertainty still matters.
A useful rule: Decision Signals tell you how confident you can be acting right now.
8. Open questions: where Synthesis stops
The final key section is the list of open questions.
What this represents
These are not weaknesses. They are the boundaries of what Synthesis can resolve.
How to use it
Treat this section as your next step:
- what to validate in real-world research
- what to test further
- what could change your decision
A useful rule: Open questions define what must be validated before committing.
Putting it all together
When reading any Synthesis study, follow this flow:
1. What is the core tension?
(from the Executive Summary)
2. Which signals are stable?
(from distribution + shape + strength)
3. What actually holds?
(from Stable Patterns)
4. Can we act?
(from Directional Lean and Decision Signals)
5. What still needs validation?
(from Open Questions)
Final takeaway
A Synthesis study isn’t about collecting opinions. It is about identifying which patterns hold, how strongly they hold, and whether that is enough to move a decision forward.
If you focus on that, Synthesis becomes extremely practical.
If you focus on percentages alone, it quickly becomes misleading.
------
We’ll continue publishing guides and FAQs on interpretation, validation, and how to get the most value out of each study type.
Remember: Project Brainstorm is an experimental beta. It is designed to help you see the market more clearly, not to replace judgement or downstream validation.
If you’d like to learn more about Project Brainstorm or share feedback on the Beta, you can reach us at contact@projectbrainstorm.xyz