- Email: [email protected]
Recent evaluations
This section contains a listing of recent articles and reports describing evaluation in practice. Included are studies that deal with issues andprograms of interest to a broad spectrum of evaluators and consumers of evaluations (e.g., reports of effectiveness of evaluations, needs assessments, syntheses of a body of work, and critiques of such studies). Listing here implies no judgment about the quality of the work reported. Readers are invited to submit items. Afill bibliographic citation and a one-sentence description of the evaluation, stressing the purpose and methodology for each item, should be sent to Carl Wisler at 5028 Belt Road, N. W., Washington, DC 20016.
CRIME AND CORRECTIONS Automobile Theft. Collins, M.F. and Wilson, R.M. (December 1990). Automobile Theft: Estimating the Size of the Criminal Population. Journal of Quantitative Criminology, 6(4), 395-409. Animal abundance estimation procedures to estimate number of auto thieves. Correctional Programs. Hwang, S. (December 1990). Modeling the Suppression Effect of Correctional Programs on Juvenile Delinquency. Journal of Quantitative Criminology, 6(4), 377-393. Model-based approach to estimate effects of a correctional program on arrest rates of juveniles. Criminal Populations. Rossmo, D.K. & Routledge, R. (September 1990). Estimating the Size of Criminal Populations. Journal ofQuantitative Criminology, 6(3), 293-314. Capture-recapture analysis to estimate two criminal populations: migrating fugitives and street prostitutes. Intensive Supervision. Land, K.C., McCall, P.L. &Williams, J.R. (December 1990). Something that Works in Juvenile Justice. Evaluation Review, 14(6), 574-606. True experiment in North Carolina to estimate effects of intensive supervision on offenses reported and cited and on counselor’s judgment of “case” success.
EDUCATION
AND TRAINING
Compensatory Education. Slavenburg, J.H. (1991). Evaluation of Compensatory Education Programmes in Rotterdam, The Netherlands. International Journal of
Evaluation Practice, Vol. 12, No. 2, 1991, pp. 185-188. MN: 0101-8036
Copyright 0 1991 by JAI Press, Inc. All rights of reproduction in any form reserved.
185
186
EVALUATION
PRACTICE, 12(2), 1991
Educational Research, 1.5(l), 21-43. Non-experimental design with causal modelling to estimate program effects on attitudes and achievement. Drug Education. Klitzner, M., Gruenewald, P.J. & Bamberger, E. (1990). The Assessment of Parent-Led Prevention Programs: A Preliminary Assessment of Impact. Journal ofDrug Education, 20(l), 77-84. Non-equivalent comparison group design to estimate effects of program on drug and alcohol use, family relations and parental control of childrens’ social activities. Drug Education. Allison, K.R., Silverman, G. & Dignam, C. (1990). Effectson Students of Teacher Training in Use of a Drug Education Curriculum.Journaf ofDrug Education, 20(l), 31-46. Experimental design to estimate effects of a teacher training program on student outcomes including knowledge, attitudes and use of tobacco and alcohol. Drug Education. Kim, S., McLeod, J.H. & Shantzis, C. (1990). A Short-term Outcome Evaluation of the “I’m Special” Drug Abuse Prevention Program: A Revisit UsingSCATInventory.JournuZofDrugEducution, 20(2), 127-138. Before-and-after design to estimate program effect on children’s self-concept. Drug Education. Bruvold, W.H. (1990). A Meta-Analysis of the California SchoolBased Risk Reduction Program. Journal of Drug Education, 20(2), 139-152. Metaanalysis, using Hedges-Olkin technique, of eight programs. Drug Education. Ambtman, R., Madak, P, KOSS,D. & Strople, M.J. (1990). Evaluation of a Comprehensive Elementary School Curriculum-Based Drug Education Program. Journal of Drug Education, 29(2), 151-163. True experimental design to estimate program effects on content knowledge, observation skills and efficiency of instruction. Handgun Training. Miller, L.S. & Lainhart, R. (1989-1990). Prevention of Handgun Accidents Through Owner Training. International Quarterly of Community Health Education, 10(2), 125-134. Non-equivalent comparison group design to estimate training program effects on accident rate. Prevention of Tobacco Use. Chen, M.S., Schroeder, K.L., Glover, E.D., Bonaguro, J. & and Capwell, E.M. (March/April 1991). Tobacco Use Prevention in National School Curricula: Implications of astratified Random Sample. Health Values, 7(2), 3-9. Sample survey to determine distribution of curricula across grades K-12; part of an evaluation of the impact of the Comprehensive Smokeless Tobacco Health Education Act of 1986. HEALTH Cancer Prevention Campaign. Cameron, I.H. & McGuire, C. (1990). “Are You Survey Results. Health Dying to Get a Suntan ?” The Pre- and Post-Campaign Education Journal, 49(4), 166-170. Before-and-after design to estimate effects of a Europe Against Cancer public awareness programme to change (1) knowledge of the
Recent Evaluations
187
sun as a cause of cancer and of sun protection measures, (2) sunbathing behavior, and (3) attitude toward suntans. Cholesterol Campaign.van Beurden, E., James, R., Tyler, C. & Henrikson, D. (1990). Cholesterol Reduction is Sustainable: 12 Month Follow-Up of a Cholesterol Campaign in Rural Australia. Health Education Journal, 49(4), 181-184. Before-and-after design to estimate effects of dietary consultation program on cholesterol levels. Elderly Care. Hedrick, S.C., et al. (February 1991). Adult Day Health CareEvaluation Study: Methodology and Implementation. Health ServicesResearch, 2.5(6), 935-960. Description of an on-going true experiment at four Veterans’ Affairs facilities to study medical efficacy and cost effectiveness of an ambulatory day care program. Health Communication. Synder, L.B. (1991). The Impact of the Surgeon General’s “Understanding AIDS” Pamphlet in Connecticut. Health Communications, 3(l), 3757. One-shot sample survey to gauge impact of an information program. Health Communication. Gantz, W., Fitzmaurice, M. & Yoo, E. (1990). Seat Belt Campaigns and Buckling Up: Do the Media Make a Difference? Health Communicutions, 2(l), l-12. One-shot sample survey to measure perceived impact of an information campaign. Mammogram Campaign. Sobel, J., Curtin, A. & Fell, D (January/February 1991). The Oregon Breast Cancer Detection and Awareness Project: The Legacy of a Mammogram Screening Campaign. Health Values, 15(l), 3-8. Survey to determine womens’ compliance with rescreening guidelines two years after participation in a mammogram campaign. Medicaid. Lave, J.R. & Frank, R.G. (June 1990). Effect Payment on Length of Stay. Health Services Research, analysis to estimate effect of different payment methods patient (medical, surgical, and psychiatric) and hospital
of the Structure of Hospital 2.5(2), 327-347. Regression on length of stay by type of ownership.
Medicare. Newcomer, R., Harrington, C. & Friedlob, A. (1990). Social Health Maintenance Organizations: Assessing Their Initial Experience. Health Services Research, 25(3), 425-454. Descriptive information about a four-site national demonstration of a new form of health plan- based on program administrative data and a sample survey of beneficiaries. Mental Health Care. Schinner, A.P., Kamis-Gold, E., Delucia, N. & Rothbard, A.B. (June 1990). Organizational Determinants of Efficiency and Effectiveness in Mental Health Partial Care Programs. Health Services Research, 25(2), 387420. Data envelopment analysis to evaluate staff productivity, cost efficiency and service effectiveness of adult partial care programs in New Jersey.
188
EVALUATION
PRACTICE,
12(2), 1991
Nursing Home Care. Hu, T., Kaltreider, D.L., Igon, J.F., Yu, L.C. & Rohner, T.J. (August 1990). Cost Effectiveness of Training Incontinent Elderly in Nursing Homes: A Randomized Clinical Trial. Health Services Research, 25(3), 455-477. True experiment to estimate effects of six-month behavioral training therapy on wet episodes. Nutrition Information. Winett, R.A., et al. (1991). An Experimental Evaluation of a Prototype Public Access Nutrition Information System for Supermarkets. Health Psychology, 20(l), 75-78. True experiment to estimate effects of an interactive information system on fat and fiber content of food purchases.
TRANSPORTATION Speed Limit. Brown, D.B., Maghsoodloo, S. & McArdle, M.E. (Winter 1990). The Safety Impact of the 65 mph Speed Limit: A Case Study Using Alabama Accident Records. Journal of Safety Research, 21(4), 125-139. Before-and-after design to estimate effect of raising speed limit on accident frequency and severity.
CRIME AND CORRECTIONS Automobile Theft. Collins, M.F. and Wilson, R.M. (December 1990). Automobile Theft: Estimating the Size of the Criminal Population. Journal of Quantitative Criminology, 6(4), 395-409. Animal abundance estimation procedures to estimate number of auto thieves. Correctional Programs. Hwang, S. (December 1990). Modeling the Suppression Effect of Correctional Programs on Juvenile Delinquency. Journal of Quantitative Criminology, 6(4), 377-393. Model-based approach to estimate effects of a correctional program on arrest rates of juveniles. Criminal Populations. Rossmo, D.K. & Routledge, R. (September 1990). Estimating the Size of Criminal Populations. Journal ofQuantitative Criminology, 6(3), 293-314. Capture-recapture analysis to estimate two criminal populations: migrating fugitives and street prostitutes. Intensive Supervision. Land, K.C., McCall, P.L. &Williams, J.R. (December 1990). Something that Works in Juvenile Justice. Evaluation Review, 14(6), 574-606. True experiment in North Carolina to estimate effects of intensive supervision on offenses reported and cited and on counselor’s judgment of “case” success.
EDUCATION
AND TRAINING
Compensatory Education. Slavenburg, J.H. (1991). Evaluation of Compensatory Education Programmes in Rotterdam, The Netherlands. International Journal of
Evaluation Practice, Vol. 12, No. 2, 1991, pp. 185-188. MN: 0101-8036
Copyright 0 1991 by JAI Press, Inc. All rights of reproduction in any form reserved.
185
186
EVALUATION
PRACTICE, 12(2), 1991
Educational Research, 1.5(l), 21-43. Non-experimental design with causal modelling to estimate program effects on attitudes and achievement. Drug Education. Klitzner, M., Gruenewald, P.J. & Bamberger, E. (1990). The Assessment of Parent-Led Prevention Programs: A Preliminary Assessment of Impact. Journal ofDrug Education, 20(l), 77-84. Non-equivalent comparison group design to estimate effects of program on drug and alcohol use, family relations and parental control of childrens’ social activities. Drug Education. Allison, K.R., Silverman, G. & Dignam, C. (1990). Effectson Students of Teacher Training in Use of a Drug Education Curriculum.Journaf ofDrug Education, 20(l), 31-46. Experimental design to estimate effects of a teacher training program on student outcomes including knowledge, attitudes and use of tobacco and alcohol. Drug Education. Kim, S., McLeod, J.H. & Shantzis, C. (1990). A Short-term Outcome Evaluation of the “I’m Special” Drug Abuse Prevention Program: A Revisit UsingSCATInventory.JournuZofDrugEducution, 20(2), 127-138. Before-and-after design to estimate program effect on children’s self-concept. Drug Education. Bruvold, W.H. (1990). A Meta-Analysis of the California SchoolBased Risk Reduction Program. Journal of Drug Education, 20(2), 139-152. Metaanalysis, using Hedges-Olkin technique, of eight programs. Drug Education. Ambtman, R., Madak, P, KOSS,D. & Strople, M.J. (1990). Evaluation of a Comprehensive Elementary School Curriculum-Based Drug Education Program. Journal of Drug Education, 29(2), 151-163. True experimental design to estimate program effects on content knowledge, observation skills and efficiency of instruction. Handgun Training. Miller, L.S. & Lainhart, R. (1989-1990). Prevention of Handgun Accidents Through Owner Training. International Quarterly of Community Health Education, 10(2), 125-134. Non-equivalent comparison group design to estimate training program effects on accident rate. Prevention of Tobacco Use. Chen, M.S., Schroeder, K.L., Glover, E.D., Bonaguro, J. & and Capwell, E.M. (March/April 1991). Tobacco Use Prevention in National School Curricula: Implications of astratified Random Sample. Health Values, 7(2), 3-9. Sample survey to determine distribution of curricula across grades K-12; part of an evaluation of the impact of the Comprehensive Smokeless Tobacco Health Education Act of 1986. HEALTH Cancer Prevention Campaign. Cameron, I.H. & McGuire, C. (1990). “Are You Survey Results. Health Dying to Get a Suntan ?” The Pre- and Post-Campaign Education Journal, 49(4), 166-170. Before-and-after design to estimate effects of a Europe Against Cancer public awareness programme to change (1) knowledge of the
Recent Evaluations
187
sun as a cause of cancer and of sun protection measures, (2) sunbathing behavior, and (3) attitude toward suntans. Cholesterol Campaign.van Beurden, E., James, R., Tyler, C. & Henrikson, D. (1990). Cholesterol Reduction is Sustainable: 12 Month Follow-Up of a Cholesterol Campaign in Rural Australia. Health Education Journal, 49(4), 181-184. Before-and-after design to estimate effects of dietary consultation program on cholesterol levels. Elderly Care. Hedrick, S.C., et al. (February 1991). Adult Day Health CareEvaluation Study: Methodology and Implementation. Health ServicesResearch, 2.5(6), 935-960. Description of an on-going true experiment at four Veterans’ Affairs facilities to study medical efficacy and cost effectiveness of an ambulatory day care program. Health Communication. Synder, L.B. (1991). The Impact of the Surgeon General’s “Understanding AIDS” Pamphlet in Connecticut. Health Communications, 3(l), 3757. One-shot sample survey to gauge impact of an information program. Health Communication. Gantz, W., Fitzmaurice, M. & Yoo, E. (1990). Seat Belt Campaigns and Buckling Up: Do the Media Make a Difference? Health Communicutions, 2(l), l-12. One-shot sample survey to measure perceived impact of an information campaign. Mammogram Campaign. Sobel, J., Curtin, A. & Fell, D (January/February 1991). The Oregon Breast Cancer Detection and Awareness Project: The Legacy of a Mammogram Screening Campaign. Health Values, 15(l), 3-8. Survey to determine womens’ compliance with rescreening guidelines two years after participation in a mammogram campaign. Medicaid. Lave, J.R. & Frank, R.G. (June 1990). Effect Payment on Length of Stay. Health Services Research, analysis to estimate effect of different payment methods patient (medical, surgical, and psychiatric) and hospital
of the Structure of Hospital 2.5(2), 327-347. Regression on length of stay by type of ownership.
Medicare. Newcomer, R., Harrington, C. & Friedlob, A. (1990). Social Health Maintenance Organizations: Assessing Their Initial Experience. Health Services Research, 25(3), 425-454. Descriptive information about a four-site national demonstration of a new form of health plan- based on program administrative data and a sample survey of beneficiaries. Mental Health Care. Schinner, A.P., Kamis-Gold, E., Delucia, N. & Rothbard, A.B. (June 1990). Organizational Determinants of Efficiency and Effectiveness in Mental Health Partial Care Programs. Health Services Research, 25(2), 387420. Data envelopment analysis to evaluate staff productivity, cost efficiency and service effectiveness of adult partial care programs in New Jersey.
188
EVALUATION
PRACTICE,
12(2), 1991
Nursing Home Care. Hu, T., Kaltreider, D.L., Igon, J.F., Yu, L.C. & Rohner, T.J. (August 1990). Cost Effectiveness of Training Incontinent Elderly in Nursing Homes: A Randomized Clinical Trial. Health Services Research, 25(3), 455-477. True experiment to estimate effects of six-month behavioral training therapy on wet episodes. Nutrition Information. Winett, R.A., et al. (1991). An Experimental Evaluation of a Prototype Public Access Nutrition Information System for Supermarkets. Health Psychology, 20(l), 75-78. True experiment to estimate effects of an interactive information system on fat and fiber content of food purchases.
TRANSPORTATION Speed Limit. Brown, D.B., Maghsoodloo, S. & McArdle, M.E. (Winter 1990). The Safety Impact of the 65 mph Speed Limit: A Case Study Using Alabama Accident Records. Journal of Safety Research, 21(4), 125-139. Before-and-after design to estimate effect of raising speed limit on accident frequency and severity.