Articles

How can a community measure impact using participants' own words?

Participant stories can show what changed and what it meant, if you collect them the same way and set them beside your other numbers.

What are people really experiencing in your program?

The numbers tell you how many people came. Their stories can help you understand what happened while they were there, what mattered to them and what needs to change.

You may know exactly how many families visited your food pantry last month, how many young people attended your sessions or how many residents completed a course.

Then someone asks, “What difference did it make?”

You probably have a story that comes to mind. Perhaps someone finally felt comfortable asking for help. Perhaps a small change made a difficult week more manageable. Or perhaps someone stopped coming, and you still do not know why.

How do you learn from these experiences without relying only on the stories that reach your desk?

Active Sensemaking starts by inviting people to share something that happened, then asking them what it meant. You look at those experiences together and use what you learn to decide what to try next.

Ask about a moment

“What did you think of our program?” is a difficult question to answer. It is broad, and people may worry about sounding ungrateful.

Try asking about an experience instead:

“Think about a time in the last two weeks when you needed help with something. What happened?”

Let people tell it in their own way. It might be a few sentences, a voice recording or a conversation with someone who writes it down for them.

Use the same invitation during each round of listening. Make it possible to answer on paper, by phone or online. Think, too, about who might need a different language or a quieter way to take part.

And make room for an honest answer. Someone should be able to describe a difficult experience without worrying that it will affect the support they receive.

Let the person tell you what mattered

Imagine someone says:

“She pulled up a chair and asked me to explain it again.”

You might hear a story about someone being kind. The person telling it might remember the relief of finally being understood. Or the frustration of having to explain everything one more time.

The words alone do not settle that question.

After someone shares a story, ask a few short questions about it. One might be:

“Looking back, what shaped what happened?”

A triangle could offer three possibilities:

  • The place and conditions.
  • The people involved.
  • The resources available.

The storyteller places a marker nearer the part that mattered most, or somewhere between them. More than one can be true.

A marker near “the people involved” does not automatically mean the people were helpful. Someone may have felt welcomed, ignored or misunderstood. You still need the story, and perhaps another question about whether they got the help they needed.

This is an important part of Active Sensemaking: the person who lived the experience gives you their interpretation.

Be curious about the differences

As stories come in, you can begin to explore them together.

You might notice that experiences differ between locations, age groups or days of the week. You might find a small group of stories that do not fit what everyone else is saying.

Those differences are worth opening up.

Read the stories behind the dots. Talk with staff and, where it is safe and practical, with participants. Ask what they notice before offering your own explanation.

You are trying to understand enough to make a useful next move.

What might that look like?

This example is fictional.

A homework club notices that fewer students are coming on Thursdays.

Staff wonder whether the students are simply too busy. They invite students to describe a recent time they needed help with schoolwork, then ask them to place their stories on the triangle.

Several Thursday stories sit near “the place and conditions.” But they describe different experiences.

One student could not concentrate because the room was noisy. Another liked finding a corner where nobody interrupted. A third had wanted help from a familiar tutor, who had already gone home.

“Students don’t like Thursdays” no longer seems like a useful explanation.

Staff discuss the stories with students. They decide to try keeping a familiar tutor later and setting aside a quieter work area.

A few weeks later, they invite another round of stories. They want to hear whether those changes helped, who they helped and what they may still be missing.

The listening leads to a small change. The next round helps them learn from it.

Tell people what you learned

Your funder may still need attendance figures, completion rates or other measures. Keep those.

Alongside them, explain what people’s experiences helped you understand:

“Several Thursday accounts described difficulty finding a quiet place or a familiar tutor. Other students valued working independently. We are trying a quieter work area and later tutor support, then gathering another round of experiences.”

A few short excerpts can help readers understand the range. Include a story that complicates your explanation, too.

Be clear about who you heard from. If you only spoke with people who still attend, you cannot assume you understand why others left.

And keep your claims proportionate. Stories can show what people experienced and what a change meant to them. On their own, they do not prove that your program caused an improvement.

Close the loop

Sharing a personal experience takes trust. People deserve to know what will happen to it.

Explain who will read their story, whether it might be quoted and how you will protect their privacy. Let them decline without losing support.

Then come back to them.

Tell them what you heard, what you are trying and what you still do not understand. Even when you cannot make the change someone wants, explaining what happened to their contribution matters.

That makes listening part of how you work, rather than something you do only when a report is due.

Try it with your team

Our free Place a Story exercise gives you a short fictional story to read or hear. Place the marble where you think the storyteller would put it, then reveal the explanation written for that example.

It can open a useful workshop conversation: what did each of us assume, and what did we overlook?

You can also try Pattern Spotting with sample data. Neither tool requires an account.

You do not need to begin with a large study. Start with something your community wants to understand, invite a few experiences and make time to discuss what they might be telling you.