Recent Evaluations This secuon containsa listingofrecent articlesand reportsdescnbing evaluationin practice. Included are studies that deal \l.ith issues and programs of interest to a broad spectrum of evaluators and consumers of evaluations (e.g, reports of effecln'eness evaluauons, needs assessments, synthesesof a bodyof work; and cntiqu es of suchstudlcs). Listinghere impliesno judgment about quality of the work reported. Readers are imited to submit items. A full bibliographic citationand a one-sentencedescription of e~'aluatlon ope and methodology for each Item shouldbe sent to Carl n7slerat 5028 Belt Road,N.W, Washington, DC 20016.
CRIME AND CORRECTIONS Crime Prevention. Bennett, S. F., & Lavrakas, P. J. (1989, July). Community-based crime prevention: An assessment of the Eisenhower Foundation's Neighborhood Program. Crime and Delinquency, 35(3), 345-364. Nonequivalent comparison group design to estimate the effects of neighborhood watch programs on outcomes, such as prevalence of crime, fear of crime, and quality of life. Crime Prevention. Lattimore, P. K., Witte, A. D., & Baker, J. R. (1989, May). Experimental assessment of the effect of vocational training on youthful property offenders. National Bureau of Economic Research, Working Paper No. 2952. Experimental design to estimate effects of a North Carolina prison program on post-release arrests. Crime Prevention. Palmer, T., & Wedge, R. (1989, April). California's juvenile probation camps: Findings and Implications. Crime and Delinquency,35(2), 234-253. Factor analysis and multiple regression to identify characteristics of county camps which had higher and lower recidivism rates. Crime Prevention. Pennell, S., Curtis, C., Henderson, J., & Tayman, J. (1989, July). Guardian Angels: A unique approach to crime prevention. Crime and Delinquency, 35(3), 378-400. Nonequivalent comparison group design and other methods to estimate effects of Guardian Angel 60
61
activities on outcomes, such as reported violent offenses and citizens' feelings of safety. Crime Prevention. Rosenbaum, D. P., Lurigio, A.J., & Lavrakas, P.J. (1989, July). Enhancing citizen participation and solving serious crime: A national evaluation of crime stoppers programs. Crime and Delinquency, 35(3),401-420. Several evaluation strategies including a true experimental design to estimate the effect of amount of reward on the perceptions, attitudes, and behaviors of anonymous persons calling to report crimes.
EDUCATION AND EMPLOYMENT Antidiscrimination Policy. Heckman, J. J., & Payner, B. S. (1989, March). Determining the impact of federal antidiscrimination policy on the economic status of blacks: A study of South Carolina. American Economic Review, 79(1), 138-177. Multiple analyses to estimate effects of policy on black employment and economic progress. Comparable Worth. O'Neill, 1., Brien, M., & Cunningham, J. (1989, May). Effects of comparable worth policy: Evidence from Washington State.
PapersandProceedings ofthe Hundred and FirstAnnualMeeting of the American Economic Association, 305·309. Regression analysis to estimate the effects of a state comparable worth policy on wages and employment. Driver Education. Worden, J. K., et aI. (1989, March). Preventing alcoholimpaired driving through community self-regulation training. American Journal of Public Health, 79(3), 287-290. Non-equivalent comparison group design to estimate effect of community education program on blood-alcohol concentration of drivers. Economic Status. Heckman, J. J. (1989, February). The impact of government on the economic status of black Americans. National Bureau of Economic Research, Working Paper No. 2860. Review of evidence on black economic progress and relationship to government programs. Economics Education. Rhine, S.L.W. (1989, May). The effect of state mandates on student performance. Papers and Proceedings of the Hun-
dred and First Annual Meeting of the AmericanEconomic Association, 231-235. Two-stage least squares to compare economic literacy of high school students in states which mandate economic instruction and ones which do not. Educational Tracking Program. Gamoran, A., & Mare, R. D. (1989, March). Secondary school tracking and educational inequality: Campen-
62
sation, reinforcement, or neutrality? American Journal of Sociology, 94(5),1146-1183. Endogenous switching regression analysis to estimate effectsof program on mathematicsachievement and probability of graduationfrom high school. Magnet Schools. Rossell, C. H. (1988, Winter). Howeffectiveare voluntary planswith magnetschools? Educational Evaluation and Policy Analysis, 10(4),325-342. Several methods, including pooled time series, to compare long-term interracial exposure in school districts with voluntary reassignment to magnetschools to those with mandatory reassignment. On-the-Job Training. Lynch, L. M. (1989, March). Private sector training and its impact on the earnings of young workers. National Bureau of Economic Research, Working Paper No. 2872. Regression analysis applied to data from the NationalLongitudinalsurveyto estimate effects of trainingon earnings. Sex Education. Solomon, M. Z., & Dejong, W. (1989, April). Preventing AIDS and other STDs through condom promotion: Patient education. American Journal ofPublic Health, 79(4),453-458.Experimental design to estimateeffectsof educationalvideotape on patient's knowledgeabout and attitudes toward condom use and on willingness to redeem coupons for free condoms. Traffic Safety Education. Renaud, L., & Suissa, S. (1989, March). Evaluation of the efficacy of simulation games in traffic safety education of kindergarten children. American Journal of Public Health, 79(3), 307309. Experimental design to estimate effects of simulation games on attitudes, behavior,and transfer of learning aboutpedestriansafety.
ENERGY Energy Conservation. Berry, L., & Witte, P. (1988). Gas heating system retrofitsfor low-incomehouseholds: Evaluation results and future directions. Energy Systems and Policy, 12(2), 119-134. True experimental designs to estimate energy savings resulting from retrofits implemented underthe Weatherization Assistance Program. Energy Conservation. Brown,M. A., Berry, L. G.,White, D. L., & Trumble, D. (1988). How influential is theauditor? Determinants of saleseffective-
63
ness in energy conservation programs. Energy systems and Policy, 12(2), 135-149. Binomial logit models and regression models to estimate effectiveness of energy auditors in a Florida conservation program. Energy Conservation. Schweitzer, M. (1988). Energy conservation for low-income households: A study of the organization and outcomes of weatherization assistance programs. Energy Systems and Policy, 12(2), 101-117. Sample survey of local weatherization programs to statistically test relationships between organizational characteristics and program outcomes. Energy Conservation. Walsh, R. (1989). The residential conservation service in Vermont: An evaluation of program implementation. Evaluation and Program Planning, 12(2), 153-161. Application of an implementation framework developed by Sabatier and Mazmanian.
ENVIRONMENT, AGRICULTURE, AND NATURAL RESOURCES Agricultural Development. 00, T. H., Hitzhusen, F., & Hushak, L. (1988, January). Factors related to errors in ex-ante evaluation of agricultural projects in developing countries. Journal of Developing Areas, 22(2), 199-206. Regression analysis to identify reasons for time overruns, cost overruns, and deviations in expected rates of return for agricultural development projects of the World Bank.
FAMILY AND INDIVIDUAL WELFARE Child Care. Bell, D. M., et al. (1989, April). Illness associated with child care: A study of incidence and cost. American Journal ofPublic Health, 79(4),479-484. Non-equivalent comparison groups to estimate effects of five forms of child care on illness rates. Homeless Children. U. S. General Accounting Office. (1989, June). Chilo dren and youths: About 68,000 homeless and 186,000 in shared housing at any given time. Survey and other methods to make national level estimates of homeless persons 16 years of age and younger.
64
FINANCIAL INSTITUTIONS AND TAX POLICY Payroll Tax Programs. AIm, J. (1988, July). Noncompliance and payroll taxation in Jamaica. Journal ofDeveloping Areas, 22(4), 477-495. Statistical analysis of the extent of compliance with five payroll tax programs and the effects of noncompliance.
HEALTH Accident Prevention. Guastello, S. J. (1989, February). Catastrophe modeling of the accident process: Evaluation of an accident reduction program using the Occupational Hazards Survey. Accident Analysis and Prevention, 21(1), 61-77. Catastrophe theory and regression analysis to estimate program effects. AIDS. U. S. General Accounting Office. (1989, June).AlDS Forecasting: Undercount 0/ cases and lack 0/ key data weaken estimates. PEMD-89-13. National estimates of the number of AIDS cases through 1991 to serve as a basis for federal resource allocation and public financing of health care services. Antismoking Campaign. Warner, K. (1989, February). Effects of the antismoking campaign: An update. American Journal 0/ Public Health, 79(2), 144-151. Regression analysis to estimate effect of antismoking campaign on cigarette consumption. Health Care Systems. Cockerham, W. C., Kunz, G., & Leuschen, G. (1989, June). Social stratification and health lifestyles in two systems of health care delivery: A comparison of the United States and West Germany. Journal ofHealth and Social Behavior, 29(2), 113-126. Regression analysis to compare individuals' efforts to "stay healthy" under two different health care systems. Health Insurance. Keeler, E. B., & Rolph, J. E. (1988, December). The demand for episodes of treatment in the health insurance experiment.Journal 0/ Health Economics, 7(4), 337-367. Regression and other analyses to estimate the effects of coinsurance and spending caps on demand for health services in the RAND health insurance experiment. Health Insurance. Keeler, E. D., Manning, W. G., & Wells, K. D. (1988, December). The demand for episodes of mental health services. Journal 0/ Health Economics, 7(4), 369-392. Survival analysis and other methods to estimate effects of coinsurance and spending caps on dem and for mental health services in the RAND health insurance experiment.
65
Hospital Programs. Zwanziger, J., & Melnick, G. A. (1988, December). The effects of hospital competition and the Medicare PPS program on hospital cost behavior in California. Journal of Health Economics, 7(4), 301-320. Regression analysis to estimate effects of California's "procompetition" legislation and Medicare's prospective payment system on hospital costs. Injury Deaths. Waller, A. E., Baker, S. P., & Szocka, A. (1989, March). Childhood injury deaths: National analysis and geographic variations.American Journal ofPublic Health, 79(3),310-315. Use of data from the National Center for Health Statistics to tabulate the causes of death by age, race, sex, and state of residence. Injury Prevention. Mohr, D. L., & Clemmer, D. 1. (1989, June). Evaluation of an occupational injury intervention in the petroleum drilling industry. Accident Analysis and Prevention, 21(3),263-271. Multiple time-series and prctest-posttest designs to estimate effects of new equipment in reducing injuries on mobile offshore drilling units. Malaria Program. Geser, A., Brubaker, G., & Draper, C. C. (1989, April). Effect of a malaria suppression program on the incidence ofAfrican Burkitt's Lymphoma. American Journal of Epidemiology, 129(4), 740-752. Use of time series to estimate effects of program on prevalence of malaria in Tanzania. Medicare. Gay, E. G., Kronenfeld, J. J., Baker, S. L., & Amidon, R. L. (1989, March). An appraisal of organizational response to fiscally constraining regulation: The case of hospitals and DRGs.Journal ofHealth and Social Behavior, 30(1), 41-55. Before and after comparison of responses of South Carolina hospitals to Medicare's prospective payment system and the resulting effects on health care services received by the elderly. National Health Insurance. O'Brien, B. (1989, March). The effect of patient charges on the utilization ofprescription medicines.JournalofHealth Economics, 81(1), 109-132. TIme-series regression analysis to estimate effects of charges to patients for prescription drugs covered by the British National Health Service. Parasite Infection Program. Gyorkos, T. W., et al. (1989, April). Effect of screening and treatment on imported intestinal parasite infections: Results from a randomized, controlled trial. American Journal of Epidemiology, 129(4), 753-761. Experimental design to estimate effects of program to reduce prevalence of infections among Southeast Asia refugees in Canada. Physician Extenders. Ferraro, K. F., & Southerland, T. (1989, June). Domains of medical practice: Physicians' assessment of the role ofphysician extenders. Journal ofHealth and Social Behavior, 30(2), 192-205. Views of a national sample of physicians on the impact of physician extenders (e.g.,
66
nurse practitioners and physician assistants) on quality of medical care; analysis methods included logistic regression, confirmatory factor analysis, and LISREL. Restrictive Smoking Policy. Biener, L, Abrams, D. B., Folick, M. J., & Dean, L. (1989, February). A comparative evaluation of a restrictive smoking policy in a general hospital. American Journal of Public Health, 79(2), 192-195. Before and after comparisons of effects of smoking policy on behavior and attitudes of smokers and nonsmokers in two hospitals.
NATIONAL SECURITY Arms Imports. Looney, R. E. (1989, January). The influence of arrns imports on Third World debt. Journal ofDeveloping Areas, 23(2), 221-232. Regression analysis to estimate the effects of arms imports on public debt in less developed countries. Weapons Testing. U. S. Department of Defense. (1989, January). FY
1988 Annual Report of the Director, Operational Test and Evaluation (unclassified version). Summary of evaluation activity and results by the DoD office charged with overseeing operational testing by the military services.
TRANSPORTATION Driver Improvement Programs. Struckman-Johnson, D. L., Lund, A . K, Williams, A. F., & Osborne, D. W. (1989, June). Comparative effects of driver improvement programs on crashes and violations. AccidentAnalysis and Prevention, 21(3), 203·215. Review of 65 studies evaluating driver improvement activities. Driver Risk Factors. Connolly, M. A., Kimball, A. W., & Moulton, L. H. (1989, February). Alcohol and traffic safety: A sensitivity analysis of data from composite sources . Accident Analysis and Prevention, 21(1), 1-31. Bayes' theorem and logistic regression to estimate effects of changing driver characteristics on probability of a fatality. DWI Programs. Levy, D., Shea, D., & Asch, P. (1989, March). Traffic safety effects of sobriety checkpoints and other local DWI programs in New Jersey. American Journal of Public Health, 79(3), 291·293. Covariance analysis to estimate effects of sobriety checkpoints and two education programs on single-vehicle, nighttime crash rates.
67
Safety Restraints. Foss, R. D. (1989, March). Evaluation of a communitywide incentive program to promote safety restraint use. American Journalof PublicHealth, 79(3),304-306. Street observations to estimate the proportion of children restrained by seat belts before, during, and after an incentive program. Vehicle Safety. Alassar, L. (1988, Spring). Analysis of heavy truck accident severity. Journal ofAdvancedTransportation, 22(1),77-91. Loglinear analysis of controllable and uncontrollable factors that determine the severity of accidents involving heavy trucks. Vehicle Safety. Zlatoper, T. J. (1989, April). Models explaining motor vehicle death rates in the United States. AccidentAnalysis and Prevention, 21(2), 125-154. Review of research (mostly regression analyses) of factors that account for death rates.