Five Problems with How We Measure Social Change

For this month’s Nonprofit Millenial Bloggers Alliance post, we are tackling defining and measuring social impact.

I think we talk about social change so much that we underestimate what it takes to bring it to fruition.  Social change is inherently a societal concern with multiple layers and intersections, which makes defining it and measuring it difficult.  Can you really address health care without examining income, race, and gender?  Can you attribute a safer neighborhood to the efforts of a nonprofit or to changes in city legislature or both?

Given the complications in simply defining and examining social change, we need to stop assuming that the tools used to measure other objects—like profits—are adequate and effective.  In fact, many of the efforts I see for measuring our progress are short sighted, essentially boiling down to “Are we using donors money well?” Implied in this approach is that since donors are supporting our mission, if we please the donors, then we are fulfilling our mission.

While this approach is important for evaluating performance, it doesn’t tell us much about our progress towards social change.

  • For one, it doesn’t put people in need at the center of the measurement: I understand the push to be objective by ignoring the voices of the people we serve and to focus on things we can easily count (How many get counseling?  How many complete applications?)  Yet how people are experiencing change, problems in our approach, and potential new challenges cannot be easily documented quantitatively.
  • It assumes there cant be multiple interpretation of numbers: When I read data on how many inner city youth go off to college, I see that data as incomplete.  Why?  Because acceptance isn’t the issue– graduation is.  What’s the point of getting accepted if you don’t finish?  Yet for some acceptance is great, while others want to know the quality of schools, and others, like myself, want more long term data.  In other words, numbers are interpreted differently so no set of numbers is complete.
  • It leaves little room for collaboration: If one sector had the answer to our most pressing problems, then guess what?  Only one sector would exist.  And if social change merely required someone with good intentions and loads of time, our problems would’ve been solved decades ago.  Essentially, how are we including and examining the various other forces that impact the well being of people we serve?
  • It doesn’t include a long-term approach: Social change takes a while.  Providing immediate services to people is important but tracking changes in situations and circumstances won’t be captured in a yearly report.
  • It doesn’t allow for critical thinking: Without focusing on processes how do we know if our definition of social change is appropriate?  How do we know if what we are measuring adequately captures progress?  Once we focus on gathering numbers without engaging critically with our own processes, we lock ourselves into methods that may be outdated or problematic.

This is not to say that change should not be measured.  It should and absolutely needs to.  The concern is that the current models don’t capture the entire picture and we need to develop a more holistic approach.  

Check out how some of the other nonprofit millenial bloggers view this issue:
Colleen, Does Writing a Check Equal Social Change?
Elizabeth, What is Social Impact?
Elisa, Measuring Social Impact
Tracey, The Meaning of Social Impact
James, Measuring Social Impact


Introducing the Nonprofit Millenial Bloggers Alliance

In the almost two years that I have been blogging I have learned so much about the nonprofit sector and the challenges that young employees face.  This has motivated me to act and to connect with those who share my passion for creating a culture in the sector that values and actively supports young employees.

However, I always wondered how we could include more voices from the next generation in the conversation about the future of the nonprofit sector.  Then I came across this article in problogger about forming a blogging alliance.  While he talks about it being a secret mainly to benefit bloggers, I saw an opportunity to gather a group of young nonprofit bloggers who can help each other reach wider audiences and collectively bringing important issues about the nonprofit sector to the forefront  by actively engaging and sharing each other’s work.

So I am happy to announce that today is the official launch of the Nonprofit Millenial Bloggers Alliance!  This alliance (which is growing!), currently includes the following spectacular bloggers:

Make sure you visit each of their blogs for their take on the alliance.

While each of us looks at the nonprofit sector from a different perspective we share the view that millenials offer something valuable to nonprofits.  You can expect to see guest posts, monthly themes, and blogging challenges.

And this isn’t about listening to millenials simply because folks think we know what’s new and snazzy and we hope the conversation extends beyond our oft cited love of technology.  It’s about the realistic necessity of preparing the next generation to grapple with the pressing issues that have and will continue to shape the way we do business.  It’s about harnessing skills and ideas to move social change forward.  It’s about celebrating the new wave of dedication to public service and capturing it to invigorate our organizations and our lives.

I’m excited to be part of this and look forward to sharing and engaging the bloggers and everyone who is interested in this issue.  The goal is to create an online hub of thought leaders in the nonprofit sector.  In keeping with the spirit of preparing for the future we are starting with millennial bloggers but stay tuned for more!