- Email: [email protected]
Recent evaluations
This section contains a listing of recent articles and reports describing evaluation in practice. Included are studies that deal with issues and programs of interest to a broad spectrum of evaluators and consumers of evaluations (e.g. ( reports of effectiveness evaluations, needs assessments, syntheses of a body of work, and critiques of such studies). Listing here implies no judgment about the quality of the work reported. Readers are invited to submit items. Afull bibliographic citation anda one- sentence description of the evaluation, stressing the purpose and methodology for each item, should be sent to Carl Wisler at 5028 Belt Road, N. W., Washington, DC. 20016.
CRIME AND CORRECTIONS Intensive Supervision Pearson, F.S. (October 1988). Evaluation of New Jersey’s Program. Crime and Delinquency, 34(4), 437-448.
Intensive
Supervision
Nonequivalent comparison groups to estimate program effects on recidivism, use of prison space, and costs.
EDUCATION AND EMPLOYMENT AIDS Education Abramson, P.R., J.C. Sekler, R. Berk, and M.Y. Cloud. (October 1989). An evaluation of an undergraduate course on AIDS. Evaluation Review, 13(5),
516-532. Nonequivalent comparison group design to estimate effects of course on knowledge, attitudes, and behavior relevant to AIDS.
Education Reform U.S. General Accounting Office. (September in Four School Districts. Washington, Case studies and analysis of available achievement,
1989). Education Reform: Initial Effects DC: PEMD-89-28.
data to evaluate effects of a variety of reforms on
dropout rates and vocational education enrollments.
Evaluation Practice, Vol. I I, No. I. 1990. pp.67-72 ISSN: 01914036
Copyright 0 1990 by JAI Press. Inc. All rights of rcpmductiunin any form reserved.
67
68
Evaluation
Practice,
11(l),
1990
Reemployment Corson, W., et al. (April 1989). The New Jersey Unemployment Insurance Reemployment Demonstration Project. Princeton, NJ: Mathematics Policy Research, Inc. True experiment to estimate effects of three forms of reemployment assistance on employment and earnings. (A joint project of the New Jersey Department of Labor and the U.S. Department of Labor. )
University Summer Program Ackermann, S . P. and G. J. Byock. ( 1989). Evaluation of the I988 Freshman Summer Program and Transfer Summer Program: Phase I and Phase II. Los Angeles, CA: University of California. First comprehensive evaluation of UCLA’s summer bridge program. (For a summary, write to Susan P. Ackermann, Center for Academic Interinstitutional Programs, UCLA, 405 HilgardGayley Center, Los Angeles, California 90024-1372.)
ENERGY Energy Conservation Coates, B. and D. Sumi. ( 1988). Evaluation of the Seattle Energy Code’s major projects requirement for new commercial buildings. Energy Systems and Policy, l2( l), 33-42. Interviews with buildingdesignerspluscomputersimulations designs and energy savings.
toestimateeffectsofcodeon
building
Energy Tax Dubin, J.A. and S.E. Henson. (September 1988). The distributional effects of the Federal Energy Tax Cut. Resources and Energy, lO(3), 191-212. Tobit model and IRS data to estimate effects, by different households, claimed.
of 1978 law on tax credits
FAMILY AND INDIVIDUAL WELFARE Care for the Elderly Vallerand, R.J., B.P. O’Connor, and M.R. Blais. (1989). Life satisfaction of elderly individuals in regular community housing, in low-cost community housing, and
Recent
69
Evaluations
high and low self-determination nursing homes. Internationaf and Human Development, 28(4), 277-283. Nonequivalent
comparison groups to contrast self-perceived
Journal of Aging
life satisfaction in three care settings.
Foster Care U.S.
General Accounting Office. (August 1989). Foster Care: Incomplete Implementation of the Reforms and Unknown Effectiveness. Washington, DC: PEMD-89- 17. Use of available data to assess implementation, effectiveness, Adoption Assistance and Child Welfare Act of 1980.
and need for reforms required by the
HEALTH Abortion Laws Joyce, T.J. and N. Mocan. (June 1989). The impact of a ban on legalized abortion on adolescent childbearing in New York City. iVurional Bureau of Economic Research, Working Paper No. 3002. Interrupted time-series to estimate the change in number of births to adolescents after liberalization of New York State abortion law.
Care for Mentally 111 Jerrell, J.M. and T. Hu. (Summer 1989). Cost-effectiveness of intensive clinical and case management compared with an existing system of care. Inquiry, 26(2), 224234. True experiment to estimate the effects and cost of a clinical and case management mentally ill clients.
approach for
Cost Control Eggert, G.M. and B. Friedman. (December 1988). The need for special interventions for multiple hospital admission patients. He&h Care Financing Review, 1988 Annual Supplement, 57-67. Review of effectiveness
of programs for reducing hospital days among high users.
Health Insurance Moyer, M.E. (Summer 1989). A revised look at the number of uninsured Americans. Health Afsairs, 8(2), 102- 110. Preliminary
results from March 1988 Current Population Survey.
70
Evaluation
Home and Community-Based
Practice,
11(l),
1990
Care
Vertrees, J.C., K.G. Manton, and G.S. Adler. (Summer 1989). Cost effectiveness of home and community-based care. Health Care Financing Review, 10(4), 65-78. Multiple
methods including nonequivalent comparison group designs and life-table analyses to
estimate effects of programs in Georgia and California.
Medicare Rate Regulation Hadley , J. and K. Swartz. (Spring 1989). The impacts on hospital costs between 1980 and 1984 of hospital rate regulation, competition, and changes in health insurance coverage. Inquiry, 26( 1), 35-47. Regression analysis to estimate effects of Medicare regulations, and other factors, on hospital costs.
Nurse Training Linn, M. W., B.S. Linn, S. Stein, and E.M. Stein. ( 1989). Effect of nursing home staff training on quality of patient survival. InternationalJournalofAging a&Human Development,
28(4),
305-315.
True experiment to estimate effects of nurse training on measures of depression, alienation, selfesteem, and locus of control among elderly patients.
Post Traumatic
Stress Syndrome
Spiro, S.E., A. Shaley, Z. Solomon, and M. Kotler. (October 1989). Self-reported change versus changed self-report. Evaluation Review, 13(5), 533-549. Before and after design of a treatment program for war veterans.
Respite Services Montgomery, R.J .V. (December design study. Health Care 133-138. True experiment
1988). Respite care: Lessons from a controlled Review, 1988 Annual Supplement,
Financing
to estimate effects of respite services on care-giver
burden, nursing home
placement and other measures.
Rural Health Care Huang, Y .L. and C.P. McLaughlin. (June 1989). Relative efficiency in rural primary health care: An application of data envelopment analysis. Health Services Research, DEA
24(2),
143-158.
to evaluate efficiency
of rural health programs on outcomes such as numbers of patient
encounters with physicians, new health practitioners, and nurses.
Recent
71
Evaluations
Tax Incentives
for Care-givers
Hendrickson, M .C. (December 1988). State tax incentives for persons giving informal care to the elderly. Health Care Financing Review, 1988 Annual Supplement, 123- 128. Nonequivalent comparison groups to estimate effects of Idaho and Arizona programs provision of services, contributions to health expenditures, and institutional placement.
NATIONAL
on the
SECURITY
Weapon Evaluation U.S.
General Accounting Office. (August 1989). Bigeye Operational Tests. Washington, DC: PEMD-89-29. Unclassified
U.S.
summary of a critique of Department
of
of Defense weapon tests.
General Accounting Office. (August 1989). Bigeye Developmental Issues. Washington, DC: PEMD-89-27. Unclassified
Bomb: Evaluation
summary of a critique of tests conducted
Bomb:
during the development
Unresolved of a weapon.
TRANSPORTATION Bicycle Safety DiGuiseppi, C. G., et al. (October 27, 1989). Bicycle helmet use by children. Journal of the American Medical Association, 262( 16), 2256-226 1. Short time series, with comparison helmet campaign.
series, to evaluate the effects of a community-wide
bicycle
Speed Limit Gallaher, M.M., et al. (October 27, 1989). Effects of the 6%mph speed limit on rural interstate fatalities in New Mexico. Journal of the American Medical Association, 262( 16), 2243-2245. Before and after design to estimate effect of raising rural speed limit on fatality rate.
U.S. Department of Transportation. (October 1989). Report to Congress on the Effects of the 65 mph Speed Limit through 1988. Washington, DC. Various statistical analyses to estimate effect of raising the speed limit on the number of fatalities occurring on rural interstate highways.
Evaluation
72
Practice,
11(l),
1990
Traffk Enforcement Rock, S.M. (August 1989). Impact of the 1980- 1983 Selected Traffic Enforcement Programs on traffic accidents in Batavia, Illinois. Evuluation Review, 13(4), 409-419. Interrupted time series design to estimate effects of police department programs to reduce accidents.
CRIME AND CORRECTIONS Intensive Supervision Pearson, F.S. (October 1988). Evaluation of New Jersey’s Program. Crime and Delinquency, 34(4), 437-448.
Intensive
Supervision
Nonequivalent comparison groups to estimate program effects on recidivism, use of prison space, and costs.
EDUCATION AND EMPLOYMENT AIDS Education Abramson, P.R., J.C. Sekler, R. Berk, and M.Y. Cloud. (October 1989). An evaluation of an undergraduate course on AIDS. Evaluation Review, 13(5),
516-532. Nonequivalent comparison group design to estimate effects of course on knowledge, attitudes, and behavior relevant to AIDS.
Education Reform U.S. General Accounting Office. (September in Four School Districts. Washington, Case studies and analysis of available achievement,
1989). Education Reform: Initial Effects DC: PEMD-89-28.
data to evaluate effects of a variety of reforms on
dropout rates and vocational education enrollments.
Evaluation Practice, Vol. I I, No. I. 1990. pp.67-72 ISSN: 01914036
Copyright 0 1990 by JAI Press. Inc. All rights of rcpmductiunin any form reserved.
67
68
Evaluation
Practice,
11(l),
1990
Reemployment Corson, W., et al. (April 1989). The New Jersey Unemployment Insurance Reemployment Demonstration Project. Princeton, NJ: Mathematics Policy Research, Inc. True experiment to estimate effects of three forms of reemployment assistance on employment and earnings. (A joint project of the New Jersey Department of Labor and the U.S. Department of Labor. )
University Summer Program Ackermann, S . P. and G. J. Byock. ( 1989). Evaluation of the I988 Freshman Summer Program and Transfer Summer Program: Phase I and Phase II. Los Angeles, CA: University of California. First comprehensive evaluation of UCLA’s summer bridge program. (For a summary, write to Susan P. Ackermann, Center for Academic Interinstitutional Programs, UCLA, 405 HilgardGayley Center, Los Angeles, California 90024-1372.)
ENERGY Energy Conservation Coates, B. and D. Sumi. ( 1988). Evaluation of the Seattle Energy Code’s major projects requirement for new commercial buildings. Energy Systems and Policy, l2( l), 33-42. Interviews with buildingdesignerspluscomputersimulations designs and energy savings.
toestimateeffectsofcodeon
building
Energy Tax Dubin, J.A. and S.E. Henson. (September 1988). The distributional effects of the Federal Energy Tax Cut. Resources and Energy, lO(3), 191-212. Tobit model and IRS data to estimate effects, by different households, claimed.
of 1978 law on tax credits
FAMILY AND INDIVIDUAL WELFARE Care for the Elderly Vallerand, R.J., B.P. O’Connor, and M.R. Blais. (1989). Life satisfaction of elderly individuals in regular community housing, in low-cost community housing, and
Recent
69
Evaluations
high and low self-determination nursing homes. Internationaf and Human Development, 28(4), 277-283. Nonequivalent
comparison groups to contrast self-perceived
Journal of Aging
life satisfaction in three care settings.
Foster Care U.S.
General Accounting Office. (August 1989). Foster Care: Incomplete Implementation of the Reforms and Unknown Effectiveness. Washington, DC: PEMD-89- 17. Use of available data to assess implementation, effectiveness, Adoption Assistance and Child Welfare Act of 1980.
and need for reforms required by the
HEALTH Abortion Laws Joyce, T.J. and N. Mocan. (June 1989). The impact of a ban on legalized abortion on adolescent childbearing in New York City. iVurional Bureau of Economic Research, Working Paper No. 3002. Interrupted time-series to estimate the change in number of births to adolescents after liberalization of New York State abortion law.
Care for Mentally 111 Jerrell, J.M. and T. Hu. (Summer 1989). Cost-effectiveness of intensive clinical and case management compared with an existing system of care. Inquiry, 26(2), 224234. True experiment to estimate the effects and cost of a clinical and case management mentally ill clients.
approach for
Cost Control Eggert, G.M. and B. Friedman. (December 1988). The need for special interventions for multiple hospital admission patients. He&h Care Financing Review, 1988 Annual Supplement, 57-67. Review of effectiveness
of programs for reducing hospital days among high users.
Health Insurance Moyer, M.E. (Summer 1989). A revised look at the number of uninsured Americans. Health Afsairs, 8(2), 102- 110. Preliminary
results from March 1988 Current Population Survey.
70
Evaluation
Home and Community-Based
Practice,
11(l),
1990
Care
Vertrees, J.C., K.G. Manton, and G.S. Adler. (Summer 1989). Cost effectiveness of home and community-based care. Health Care Financing Review, 10(4), 65-78. Multiple
methods including nonequivalent comparison group designs and life-table analyses to
estimate effects of programs in Georgia and California.
Medicare Rate Regulation Hadley , J. and K. Swartz. (Spring 1989). The impacts on hospital costs between 1980 and 1984 of hospital rate regulation, competition, and changes in health insurance coverage. Inquiry, 26( 1), 35-47. Regression analysis to estimate effects of Medicare regulations, and other factors, on hospital costs.
Nurse Training Linn, M. W., B.S. Linn, S. Stein, and E.M. Stein. ( 1989). Effect of nursing home staff training on quality of patient survival. InternationalJournalofAging a&Human Development,
28(4),
305-315.
True experiment to estimate effects of nurse training on measures of depression, alienation, selfesteem, and locus of control among elderly patients.
Post Traumatic
Stress Syndrome
Spiro, S.E., A. Shaley, Z. Solomon, and M. Kotler. (October 1989). Self-reported change versus changed self-report. Evaluation Review, 13(5), 533-549. Before and after design of a treatment program for war veterans.
Respite Services Montgomery, R.J .V. (December design study. Health Care 133-138. True experiment
1988). Respite care: Lessons from a controlled Review, 1988 Annual Supplement,
Financing
to estimate effects of respite services on care-giver
burden, nursing home
placement and other measures.
Rural Health Care Huang, Y .L. and C.P. McLaughlin. (June 1989). Relative efficiency in rural primary health care: An application of data envelopment analysis. Health Services Research, DEA
24(2),
143-158.
to evaluate efficiency
of rural health programs on outcomes such as numbers of patient
encounters with physicians, new health practitioners, and nurses.
Recent
71
Evaluations
Tax Incentives
for Care-givers
Hendrickson, M .C. (December 1988). State tax incentives for persons giving informal care to the elderly. Health Care Financing Review, 1988 Annual Supplement, 123- 128. Nonequivalent comparison groups to estimate effects of Idaho and Arizona programs provision of services, contributions to health expenditures, and institutional placement.
NATIONAL
on the
SECURITY
Weapon Evaluation U.S.
General Accounting Office. (August 1989). Bigeye Operational Tests. Washington, DC: PEMD-89-29. Unclassified
U.S.
summary of a critique of Department
of
of Defense weapon tests.
General Accounting Office. (August 1989). Bigeye Developmental Issues. Washington, DC: PEMD-89-27. Unclassified
Bomb: Evaluation
summary of a critique of tests conducted
Bomb:
during the development
Unresolved of a weapon.
TRANSPORTATION Bicycle Safety DiGuiseppi, C. G., et al. (October 27, 1989). Bicycle helmet use by children. Journal of the American Medical Association, 262( 16), 2256-226 1. Short time series, with comparison helmet campaign.
series, to evaluate the effects of a community-wide
bicycle
Speed Limit Gallaher, M.M., et al. (October 27, 1989). Effects of the 6%mph speed limit on rural interstate fatalities in New Mexico. Journal of the American Medical Association, 262( 16), 2243-2245. Before and after design to estimate effect of raising rural speed limit on fatality rate.
U.S. Department of Transportation. (October 1989). Report to Congress on the Effects of the 65 mph Speed Limit through 1988. Washington, DC. Various statistical analyses to estimate effect of raising the speed limit on the number of fatalities occurring on rural interstate highways.
Evaluation
72
Practice,
11(l),
1990
Traffk Enforcement Rock, S.M. (August 1989). Impact of the 1980- 1983 Selected Traffic Enforcement Programs on traffic accidents in Batavia, Illinois. Evuluation Review, 13(4), 409-419. Interrupted time series design to estimate effects of police department programs to reduce accidents.