|
|
RSAT LINKS Linking Residential Substance Abuse Treatment Professionals to Resources and Information
Thomas L. Wilkinson.
In order to measure the effectiveness of the use of public (local, state and federal) dollars for substance abuse treatment of offenders, and demonstrate responsible stewardship of this public money, an accurate and thorough outcome analysis is warranted. Obtaining accurate outcome data requires an effective method to track the re-socialization of ex-offenders. This issue of Links provides data on a method developed by NIDA that may be useful in evaluating the effectiveness of substance abuse programs. Program administrators, funding sources and the general public want to know: How effective is the program at helping graduates to re-assimilate into society and remain drug and arrest free, and at what cost was this obtained?
Conducting a Cost Analysis In designing an outcome analysis, the type and amount of cost data to be collected, the method(s) to be used to collect the data, and the frequency of collection should be determined.. Some basic cost categories are:
Cost analysis provides a basis for developing the cost-effectiveness (relationship between program cost and program effectiveness) and cost-benefit analysis (measurement of both costs and outcomes in monetary terms) of the program.
Measuring Cost-Effectiveness In measuring the cost-effectiveness of the program, it is important to determine the measurement parameters to use. Some common ones are the following:
Outcomes after treatment can be: compared with before treatment experiences, or with a control group who has not received the treatment. However it is important to note that:
Linking Costs to Outcomes The most complete and useful cost-outcome analysis includes a detailed cost analysis of the treatment procedures and inmate processes conducted that brought about the outcomes. These analyzes necessitate the performance at the individual client level. This level of detail gives a clearer picture of cost versus outcome but is more complex and expensive to generate. If one has the resources to calculate the costs for each client, the sum of the cost of all clients is probably the most accurate cost data Graphs conveniently show the relationship between costs and outcomes. Microsoft Excel, Quattro Pro or Lotus 123 are all excellent for this purpose. As an example, the cost of treatment can be compared to drug-free days upon release. Methods for analyzing outcomes are the following:
Analyzing Cost-Benefit There are several potential measures of the cost-benefit of the program.
Measures of these are the following:
The reduction in criminal activity following substance abuse treatment may not produce a corresponding reduction in actual costs to society. Although costs to citizens drop in direct proportion to reductions in criminal acts perpetrated on those citizens, public expenses for criminal justice services may not decline in a similar manner. Typically, police courts and other components of the criminal justice services are on a fixed budget, while the need for criminal justice services greatly surpasses the ability to deliver those services. For this reason, the impact of substance abuse treatment on criminal justice resources saved because of a reduction in crimes committed by former substance abusers may be diverted to other criminal justice services. The entire budget for criminal services probably will still be spent. Similar problems may occur when cost savings benefits are measured for reduced health, mental health, and future drug treatment services. Because resources in these services typically are very limited, the actual reduction in expenditures may not be as much as might be expected from the reduction in patient use of services. Nevertheless, transforming effectiveness findings into estimated cost savings still may have considerable value for a program evaluator. In particular, cost savings estimates can show the magnitude of criminal justice and treatment resources that are now available to help other drug abusers who previously could not be helped because of budget restrictions. The following tables show ways to calculate types of costs and potential cost savings for benefit analysis, along with potential benefits that can be obtained.
Table 1 Types of Costs and Potential Cost Savings
Table 2 Potential Benefits Obtained
Cost-benefit analysis measures whether the outcomes of a program are worth the costs by:
Other ways that benefits can be expressed are in:
Some potential things to look out for when developing or analyzing a cost-benefit analysis are:
Comparing Programs and Components
An important component in outcome analysis is being able to compare between programs or components to determine which is the most effective in terms of cost, outcomes or both. There are a number of ways to do this. The Fishman table below shows how to apply cost and benefit in a comparison of two programs.
Table 3 - Fishman Table
Statistical tests can show how big a difference is and if the difference is real, that is if it is statistically significant. Ratios that can help are: cost-benefit, cost-effectiveness and cost-effectiveness vs. cost-benefit. Cost-effectiveness ratios are useful in decision making for comparing dollar outcomes between programs. If one program has a cost-per-drug-free day higher than another, it can be considered less effective. The cost-per-drug-free day has a number of useful characteristics. A day free of drugs is something concrete and understandable for most people. The challenge of this can be appreciated so this becomes a tangible measure. Measures such as this that people understand are useful in describing program outcomes. Comparing cost-effectiveness and cost-benefit ratios together to form a composite performance ratio that will take into account performance outcome and cost in one number is also useful. Graphing can help to show comparative performance. Cost-outcome graphs are visual pictures of program performance. For greater detail on graphing consult the NIDA outcome analysis guide or books on statistical methods. Outcome analysis is important to capture program success for use in informing legislators, government agencies and the general public about how the program is benefiting society. Providing regular reports on program progress is beneficial in keeping those who need to know informed. Tailoring the reports to fit the needs of the recipient is useful in getting maximum results from the analysis made.
For more information on outcome analysis, please contact Tom Wilkinson at 804.782.1938 or at mhwestcon@aol.com.
Main
Page----Criminal Justice Services----Services
& Programs----Publications |
Send an e-mail to
|