MakerSpaceby DreamSpace Academy

Article

Measuring what we cannot yet claim

We found no strong causal evidence that makerspaces improve livelihoods in settings like ours. What an organisation should do about that.

Version 3.3.0 Published 27 August 2026 Updated 28 August 2026

The evidence gap, stated without softening

We went looking, deliberately sceptically, for evidence that makerspaces cause income, jobs or enterprise in rural and Global South settings. No causal claim survived verification. Not a weak one. None.

Here is what the nearest studies actually say.

StudyFindingWhy it does not close the gap
Youth skills randomised trial, Côte d’Ivoire[55] Large short-term employment effect The effect was gone by 12–15 months, and the programme was not maker-based.
Makerspaces and entrepreneurship[32] Positive effect on entrepreneurial entry United States data. Not rural, not the Global South, and income is not quantified.
Vocational training systematic review[56] Effects generally small; near zero for paid employment A sobering baseline that any skills-to-jobs claim has to clear first.
Youth enterprise trial, Rwanda[41] Unintended consequences from steering participants toward venturing Points the opposite way: the intervention can make things worse for the wrong people.

What is well evidenced is the educational half. Systematic review finds makerspaces fostering creativity across a substantial body of studies[24]; making maps onto recognised future-of-work competences and can incubate social innovation[29]; inclusion improves when agency transfers to participants[27]. The learning claim is solid. The livelihood claim is not.

The three tempting responses, and why each is worse

Say it anyway

Write “creates sustainable livelihoods” in the brochure and rely on nobody checking. This works right up until a funder’s evaluator checks, and then it costs more than the grant was worth.

Borrow adjacent evidence

Cite the United States makerspace study and hope the setting difference goes unnoticed. The study is real; the inference is not, and the difference is the entire question.

Drop the claim

Talk only about creativity and confidence. Safe, and it abandons the outcome the community actually came for. People are not here for creativity. They are here for a future.

What we do instead

Four moves, and together they are a strategy rather than a disclaimer.

  1. Split the claim into tiers. “Earn” is three different claims of very different strength — small income, a sustained livelihood, and work created for others. The first is near-term and low-risk. The second is the hypothesis. The third is present in the literature and unmeasured here. Once separated, each can be handled honestly rather than all three carrying the weakest footing.
  2. Frame the middle tier as a theory of change with a baseline, hedged against adjacent literature — never as a proven result.
  3. Design for durability, because fade-out is the documented failure mode. The strongest trial in this space showed gains disappearing within 18 months[55]. That is an argument for an ongoing relationship, mentorship and local enterprise connections rather than a course that ends and a certificate that goes in a drawer.
  4. Become the evidence generator. This is the part that turns a weakness into a contribution. The field lacks this evidence. An organisation running the intervention, with a participant register, an intake livelihood baseline and follow-up at 3, 6, 12, 24 and 36 months, is in a position almost nobody else is in — including following the people who left.

The eight instruments exist for exactly this. Note the ordering principle: instruments before indicators. Indicators added before a unique participant register and an intake baseline exist produce numbers without the baseline needed to interpret them.

What this asks of a funder

Fund the intervention and the evidence the field lacks.

Measurement of this kind is not free. Longitudinal follow-up at five points over three years, including tracing people who stopped attending, costs real staff time and produces no photographs. It is the first line cut from most budgets, and it is the only line that can settle the question.

It also requires accepting something uncomfortable in advance: we will publish results that are not flattering. Stopped projects get reported alongside successful ones. Ventures are reported as active, dormant, closed or transformed — separately. Limitations and incomplete evidence are published next to positive findings. If the answer turns out to be that this does not move livelihoods, that finding is worth more to the field than another set of attendance figures.

Hold us to it

Some specific commitments, so that this page is checkable rather than merely well-intentioned:

  • No income claim without an intake baseline and follow-up.
  • No community-impact claim inferred from a prototype or an award.
  • Unique people counted separately from attendances, always.
  • Leavers and their reasons recorded at every stage, and reported.
  • Targets set after a reliable baseline exists, never before.
  • Every result presented as baseline → target → actual → difference → explanation → corrective action.
  • Two conversion measures published rather than one, because a single ratio in this domain can exceed 100% and mean nothing.

And one more, which is the reason this article exists at all: where a number would be more persuasive than the truth, we publish the truth and explain why the number is missing. That is a slower way to build credibility and the only durable one.