An evaluability assessment of a homeless program for families

An evaluability assessment was conducted at a shelter and transitional living program for homeless families as a tool to identify factors that are likely to impede an outcome evaluation and to maximize the utility of an evaluation. Various documents of the program were examined and semi-structured interviews were conducted with several staff. The assessment of program goals and objectives indicated a need for more clarity and specificity, both in their definitions and in how they were linked to program components. Also, indications of achievements of goals did not consistently have evidence of behavioral, observable change. In addition, more implementation of program components in a prescribed manner and measurements of progress were needed. One pattern observed was a lack of staff training requirements and manualized procedures. Based on the assessment, a number of recommendations were made: (1) clearly written policies and procedures for each of the program components; (2) Clarification of the program's stated goals and mission statement as to how they can be operationalized; (3) proximal behavioral measures as markers for internal changes; (4) goals plausibly linked with activities and other program components; (5) systematic and consistent documentation of activities and progress; (6) specific criteria and written procedure for advancing through stages of the program; (7) consequences and incentives for behaviors implemented according to consistent and specific procedures; (8) classes implemented in a standardized, prescribed manner; and (9) a follow up self-assessment given periodically to graduates of the program. Following these suggestions would provide the conditions for the program to demonstrate positive outcomes.