About the AGRM's
Program Outcomes Evaluation Tools
One of the issues that we need to
address as we discuss measuring program outcomes is "What is our
purpose in gathering the data?" For rescue missions, there are
basically two reasons for measuring outcomes:
Our intended use of the
data will always set the tone for the data gathering we do. But, in
either case, the true test of whether we are effective is to be found
in our program graduates. Hopefully, they are one of the main reasons
our mission exists. Our primary "business" is changing
lives. And, our graduates are our main "product".
If we are not having a few
graduates a year - and if a significant number of them are not clean
and sober - and walking with the Lord - a year or two after leaving
our facilities - its time to re-think what we are doing in our
programs!
We've placed some of the
documents we created as part of the AGRM Rescue Mission Program
Assessment Project that you may download and edit for use at your own
rescue mission.
-
Outcome
Indicators - the "Success Factors" developed by
our focus groups.
-
Sample
Follow Up Interview - a sample questionnaire to be used in
phone follow-up of mission graduates. Uses above mentioned
indicators to gather data to be used in measuring program
outcomes.
The list of outcomes was
the result of focus group meetings conducted here in Kansas City on
February 5 & 6, 1999. We brought together about twenty directors
and counselors who oversee effective, well organized men's AND women's
residential programs. The question they pondered was simply "How
do we know if we have been successful in our efforts to help the
people served by our mission programs?"
What was produced as a
result of these efforts is a pretty simple - yet comprehensive
statement about which outcomes we ought to be tracking in our rescue
mission programs. Additionally, this list can serve as a guide to
program development. The notion here is simply if we are looking for
these outcomes we ought to be offering services through our programs
that equip are clients to actually achieve them. In other words, we
need to be proactive with these goals, rather than hoping for outcomes
we have not definitely scheduled into our program activities.
Michael
Liimatta, AGRM's Director of Education, developed the
questionnaire with input from Steve Burger,
Phil Rydman and other rescue mission leaders. It's purpose is to serve
as a model that can be used by mission staff members in follow-up
interviews with program GRADUATES - whether face-to-face or over the
phone. The basic notion here is that real success is measured by the
number of sober, godly formerly homeless people who have returned to
society as productive members as a result of our programs.
While
we do not have control of how people respond to our efforts to help
them - that's between them and God. But, what is it that makes rescue
missions different than all of the secular programs that help the
homeless? I'd say that, ultimately, it got to be the power of the
Gospel of Jesus Christ as exhibited by lives that are permanently
changed by an encounter with the Living God.
At rescue mission
programs, we build upon this spiritual commitment. We do it by helping
them to recover from an addiction to alcohol/drugs and providing
additional assistance like work programs, education and spiritual and
vocation training. With all the efforts and resources we are expending
in these endeavors, there's just got to be some fruit! That's what
these assessment efforts have been aiming for; giving us the ability
to tell the world what God is doing at our missions by providing
tangible proof of lives that are being changed.
Certainly, we must recognize that
we do tend to have many people who will never become PhD's or
corporate executives. As a matter of fact, there is a very significant
number of mentally ill, developmentally disabled, and brain damaged
addicts among our clientele. For some, living sober at the mission for
the rest of their lives may be their "high water mark." But,
even these folks that might be considered "low functioning",
we are still giving them the opportunity to experience a quality of
life that no other programs offered by secular agencies can.
So, as far as tracking program
outcomes, the key is knowing the people we serve and establishing
measures of success that are appropriate for them. Still, if we don't
take the time to look for appropriately measurable outcomes, we miss
the opportunity to properly evaluate our programs and staff. In my
opinion, this is a part of the good stewardship that is the hallmark
of any ministry committed to excellence in our service to God and His
people.