Evaluation studies review annual (volume 1)

Evaluation and Program Planning, Vol. 1, pp. 319-324 Printed in the U.S.A. All rights reserved.

0149-7189/78/040319-06$02.00/O Copyright 0 1979 Pergamon Press Ltd

(1978)

BOOK REVIEWS Evaluation 1976,

Studies

672pp.,

Evaluation

Review

Studies

Review

Sage Publications,

1977,

Robert

Reviewers: Introduction No one ation

Perloff

(Robert

would

shops

being

requests

for

sults

ation,

be social

to

recognition

that

could

a plethora

Thus

be

producers

and

on

debate,

analysis,

of saying

and

be made

scarce

dollars

should

competing that

perspectives, in their

control,

even

times

evaluation

or sometimes necessarily

their

quest

is probably

View)

these

two

us what

these

and rigor

in vol-

in future

what

evaluation

sometimes

to go before

characterizing,

disciplines

constitutes

studies,

way

program

of fact,

involvement

fun and challenging

for many

satisfaction

in trying

and

may

be

even

in a state-of-the-art

reader

response.

editors

are

know

the Review

and broadly I admit

instantly,

upon,

editor

and

of potential

such as those

relied

than

Then

both.

who

which

are far su-

or even two or

ing with

and evaluating

public

be sauce

for the gander in

review

and

in These of

Well,

why

effects

for the goose programs)

not

various

experi-

in terms

of

(experiment-

should

our evaluation

Review

any

certainly

orientation

approaches

on theory

for

and

and

treated

certainly

and something

to do evaluation. there,

to the

-

indis-

contributing not

- in these otherwise provwell as informed, volumes:

in evaluation

people

here

not

Two

Annuals?

respected

are really

explicitly as informative,

devoted

to-

evaluating

and

is used

paper

to pull the field

annuals).

domain

or training

es-

strive their

(using

of articles

be an integrated

paper.

is sauce

methodology

a sprinkling

might

measure

What

something

319

boards,

better

Do

one

many

Bureaucrats?

domain

even though,

and the other

ment?

theory

truly

of an overall

gether

knowledge

USwho

and practicing How

editors.

systematically

to tie together

old-fash-

and in what

at all sure that

advisory

to the judgment

paring

some

is it that these people

the vast

their

analysis

of the future

words,

boards

and interests,

elements

in evaluof

What

of large

volumes

ocate

future

doing a needs

the readers

of evaluation?

I am not represent

is Missing

evaluation,

Annuals. for

Theoreticians?

advisory

What

some-

emerging

Review

are practitioners

editorial

pensable

sometimes

many

know?

in-

is

research,

we

disciplines,

procedure

In other

phases

by

loose

of

Who are the readers

responsibly

producing

else - you name it. But this isn’t

As a matter

at least modest

it

whose

for?

say by one or two people

of the

two

be improved

long

separate

sometimes

How

needs

Future

what

research.

on this and that

Reviewers

springboards

for

Methodologists?

What

and

quilt

of develop-

new fields

landscape

how about

administrators?

perior

state

To his let me add one of my own. Soph-

particular

the medium

for train-

studies.

respective

tell

tautness

something bad.

California:

the crazy

this chaotic

imaginative

are looking

reader

all of which

consumers

an

marketing

Annual

allocated

and a synthesis

evaluation

a long,

linkage

evaluation,

ation

has

the various

terdisciplinary

receive

as it may sound,

and do not

(if not

such as these

the various

be aided

economics,

omoric

three joint

so that

from

Annuals.

Agency

that

for deciding

programs,

Review

scholars?

realistic

be

comprising

Blueprint

proposes

in what

need to be used to

should

from

the relative

called

Hills,

and areas of specialization.

Sussna

and

and large,

Sage Publications,

(Psychologist’s

ever-changing

proportions?

re-

evalu-

the

strands Doubtlessly

Inchoate

ioned

economic,

a healthy

line,

and how they might

evaluation

F. Conner

was and will ever be thus with

annuals

in

editions. achieves

California:

Saar. Beverly

as a means of determining

and of

evaluation

way

of

seeking

accountability,

procedures

quality

and Sussna,

But

Hills,

Ross

civilization’s An

evalu-

inclusion

choices

available,

umes are about

is by

bottom

findings

psychology

View);

professions,

be funded.

ing and education, Conner

This hooked

of evaluation

substantive

legislators for

in

and

for

educational,

cost

it is essential

volumes,

into

the

of

not possibly

of

ment

of

a multitude

particular

benefit

how

and of

of work-

looking

Congressional

for

increasingly

among

(Economist’s

evaluation.

fledgling

spawning

which

systematic

determine

where

with Shalom

heterogeneous

programs,

components for

be

laws,

respect

talented

proposals,

policy.

seems sunset

and

translated

excessive) help

Guttentag

the

appearance

out furiously,

of employers

wondering

or

by Marcia

call

research,

the

of academic

prepared

should

health,

Beverly

the viability

to evaluation

evaluation

being

America

V. Glass.

the prolifer-

of evaluation

evaluation

policy-makers

by

of bureaucrats

for

statutes

by Gene

Sussna

(like this one) devoted

conferences,

guidelines

to doubt

of evaluation

energetic

specialists,

Edward

churned

evaluators,

and

ation

Z), edited

one considers

as evidenced

attracting

experienced

(Volume

enough

when

studies,

new journals of books

societies

edited

$29.95.

(Introduction);

be audacious

evaluation

papers,

l),

Perloff)

of evaluation

spanking

(Volume

Annual

736 pp.,

of the field of evaluation program

Annual

$29.95.

but

underlying

Sure,

nowhere

on prethe word

is there

psychological

any pro-

320

BOOK

cess of,

or the person’s

almost

the task

of evaluating,

judging,

is better

or what

be

because they

future

review

levels

sort

are,

to

they

models

do evaluation,

need

enough

builders,

of

these

may

Conner

and

Rr~lieul

Annuals.

different

but

your

of your

and

pubof spe-

now

volume

appear

on the

the cover), fledgling evaluation.

in the

the reader

make

The Economist’s This

review

ation

of

nia.

the

societies

is being

referred

revolt

Lest

(Edward

on

Western

and what payer’s

View

comes

think

two coasts,

I can report

one’s

deans

ation

techniques.

search”

More

Economics tions

under

heart

of

faculty

do we handle

this

“evaluation

re-

is undoubtedly

of activities

are or are

will be the substance

review. The

among

notion

competing

economics.

And

contribu-

of value

resource

allocations concerns

matters and

have been

illness.

quick

to apply

to social

progams.

logically

heeds

responds

with

that

at this that up

some

in these

editors,

person

it

V. Glass

those

consisted

much

smaller

profit

body

of

large

number officials.

high

priests.

nominate

Volume

I) and

tor then

whittled

1976

of government advisers number which

ional

but

some

boards.

persons and

justice,

health,

S~bstn~ati~c ences

and especially

collection.

unpublished,

in psychology

between

criminal

on in Volume

(Cronbach),

school

(IIouse),

and his legion of admirers/

integration,

etc. There

and small-scale

empirical

study

of alternative

therapies

for a small number

(Weiler,

or personality

volume

se?”

Thus

and the

district

of

“isn’t

questions it time

pieces

methods,

patrol

ex-

with grand ques-

were addressed

to get

in the

to evaluation

are about

evaluation

in

San Jose,

a preventive police (Kelling, ct al.), etc.

these

“think”

evaluation

vouchers

et al.), City

as the (94) of

disorders

of educational

2 can be and is less concerned

first

a well-struc-

of such topics

~lexican-‘\merican

it’s as though

among

neuroses

the effectiveness

in Kansas

Volume tions;

typically

are also

turcd

California

involving

anxiety

in

the con-

less ,grand studies,

with

of

j la Rawls

many

et al.),

1 big

analysis

justice

benefits

Coleman

on public

per

the relationships research,

and pub-

and

intcgation.

of the

show

are

data their

in

virtuosity

ods to evaluation.

which

But

here

statistics

not-for-

able?

Second,

to identi-

more

sense

they

re(for

in profesphoto-

policy bate

decision

01’ criminals

making? thesis.

(Ross:

for convicts

interactive

tics

process

Then

flight” there

Diamond

and recidivism 1)etwccn

statistics

2 continues

to his school

are studies

patient

of sentencing

work and

make

and public with the de-

as related

(Waldo

does

interchange-

evaluation

& Zeisel),

methto mind.

testing,

to Haycsian

Volume

“white

come

testing

between

people

statistical

is hypothesis

statistical

not a shift

the

on Coleman’s

tlcscgre,qation grams

might

hard-science

various

two questions

and

evaluation given

the

in applying

make

were

implemen-

which

to the pres-

appeared

dialog

periment

a

Evaluation,

issues in the social sci-

life (Zeckhauser),

of social program

outpatients

jus-

with

in articles by Freeman, Guttentag, I,ynn, and Rossi. Then follows a section on methodology

Each edi-

papers

criminal

policy

Early

If the core of classsical

that

and

of eduction,

methodological

of human

thedistribution

efficacy

The

of evaluation

About

in the areas

that

in I975

by far of

organized,

1 ~ Thinking

These

other

welfare,

Considerntions.

are addressed;

detractors

would

and employment.

issues

the value

job

of Evaluation.

on methodology,

and applications

a

(some

the largest

similarly

with a

along

asked

sections

tation,

provide

pieces

lic policy Berk and

But

Guttentag,

of papers

of which

were

and tidy

status.

appeared

for the second most

though

credentials

were

the list of nominated

Papers,

by

volumes

to applications

health,

Part

It seems

in the form

editorial

5 parts,

2 is somewhat

shorter

followed

which

the freedoms

advisory

of academic

and

ent collection. jounals,

editorial

a small

as exemplary

along

discipline

enjoy

and

is led to beI fear

will come

achieves

These

relatively

article.

wide-ranging

and Methods

are devoted

to education,

Volume

contribu-

valuable.

into

Theory

the

introduction

an editor The

of

with

written

each

from

intensive

doubly

1

a predominantly

conglomeration

and the late Marcia

mainly

methods tice.

a more

pace

editor’s

preceding

such

of success

kept

the editor’s

integration.

1 is divided parts

(Sloane,

which

studies

reader

of E‘0rmul.‘I‘0 the impressive

added

and

few

action

by the public,

The

or school

so that

boards

fy

rather

day comes, we can research now enjoys.

Gene

garded

for social evaluation

volumes.

as learn-

psycholo,q

and methodologies

is a many-splendored

with

great

:Cfntter.s

theories

the multi-faceted

evaluation

until that evaluation

their

for accountability

evaluation

point

economics

It is this taste

cries

are represented lieve

Both

as a cri-

psychology’s

ing

mental

but

is Part

tinuing

have made major

run the ,gamut from such evaluation-related to

Trievaluthe

uliu,

shortcut

and psychology

for choosing

the

by the

get to evaluate

There

sorts

to this new discipline.

terion is

what

but a decent

of the two volumes

i~~tcr

evaluation”?

to be said about

not evaluation,

how

labelled,

or “program

much

tuning

we never

importantly

discipline

of a tax-

even hcrc at the Golden

which

remaining

13 in Califor-

is monopolized

are fine

How come

administrators? burgeoning

shot

of Proposition

that

and peers

evalu-

commencement

to as the opening

that evaluation

angle

and

on

So this

of the wisdom

has not

are

The

names

Guttentag’s

trappings

the

to more

the collections

Volume

of Solzhenitsyn’s

at a Harvard

~ the approval

you

Sussna)

heels

only

shows

collecting

unpublished),

consideration.

but

and 725 pages.

paragraph

by

pages. (both

32 articles,

has a four-page

is entitled

service

page,

for the Edi-

657

co-editor

demonstrations

volumes

of interpretation real

and

and

regrettably

volume

are as diverse

33 members

articles,

title

already

What

and a too-brief

has been

inside

and more

Each

editor, 27

styles

matter.

has an editor

series

experts

you are

Board,

53 advisers,

tions.

I am sure you

reviews

1 has a single

second

more

so that printing

of the subject

Advisory

and

perspectives

and worthy, of their

walk

Volume

growth

professionals.

will Their

perusal

at all

generalizations,

Sussna

complementary,

when

-

evaluation

(and not reset)

torial in

for the guidance

of evaluation

Realists two

people

copied

as the treatment

well

a place

developed

platitudes,

the

completed,

in, what

to be written.

for aspiring

through

agree

deserve

to be

dreams.

will

will

like these,

and for the employers

But

This

yet

for preparing

in volumes

curriculum

cialists,

is bad.

have

certainly

training

certainly

academic

of saying

volumes.

Similarly, lished,

and what

of

this

involvement

preferring,

is good

papers

When

continuous

REVIEWS

release

pro-

PC Chiricos),

an

physician

for

View (Ross

The Psychologist’s The

discipline

of evaluation

lished

and

pace.

To help

of

the

writings

started now

literature order,

in

evaluate

ited by Marcia Like umes

the

spectives.

by Gene

Evaluation

ologists, types.

This

is by

multidisciplinary

these

very

vol-

of per-

nature

psychologists, political

and human

service

quality

ed-

Saar).

a variety

its

of

philosophers,

educators,

Annual

itself,

from

composed

economists,

statisticians,

Review

research

of topics

research

field,

was have

the help of Shalom

of evaluation

interdisciplinary

series

volumes

V. Glass and the second

(with

a wide variety

the variety

Two

Studies

estab-

at a fast

review

Publications.

Guttentag

field

cover

annual

in the Evaluation

the first edited

is now firmly

area is growing

and disseminate an

by Sage

appeared

series,

in the

evaluation,

in 1976

F. Conner)

research

an soci-

scientists,

providers

of all

of the evaluation

re-

search field is one of its strongest assets but, as all who are involved in interdisciplinary work know, this type of work also has liabilities. searchers’

Because

perspectives,

each volume

in the series

works

would

which

best

of the variety

the editor faced

appeal

in evaluation

a difficult

research.

From

the

editors

made

haps

one

editor

(i.e.,

chologist logical

and the other research

Because design, articles

most

psychologists

studies about

selection

using

design

of papers

pealing

There

novel

methodology remind research

ticles

in the section

not

designs

The

Glass

probably

too

expanding, The

book

the

first

were

at the

ty and

professional This helped

evaluation

volume Like

but

many

evaluation

-

devoted

evaluation the

was

discipline.

issue

to organize,

shows

work. areas

solely

and before

in evaluation

the

ar-

instead

research

a separate

of Evaluatinn

volume

The

since the book

its first

the discipline

Glass

research

Studies

Re-

gain visibiliarea itself

breadth

at

of the

field but not the depth. Guttentag

had come sional

the

cover

the first journal

published associations

first

institutionalize.

time,

The

before

to evalu-

of evaluation

design

to

when

of the

in evaluation

and becoming

research

formed.

time

more illness)

study.

This is understandable

appeared

view Annual that

attempts

organizing,

to evaluation

is more

on experimental

volume

was developed

and

there

de-

using

analysis

made

ap-

Glass has

trend

and methods

assumptions

the

experimental

the controlled

on theory

many.

of this,

is particularly

consumption that

than

accept

theoretical

of studies

Brenner’s

psychologists

various

and

rigorous,

reports

alcohol

concentrate

in experimental

Because

volume

more

(e.g.,

between

which

do

psy-

on psycho-

By his own admission,

however,

ation

analyze

per-

and quickly

designs

and statistics.

using

are,

are trained understand

in the Glass

on studies

signs.

relationship

choices, is a social

extensively

rigorous

to psychologists.

focused

good

the

of the

and methods.

they can most easily

evaluation

perspective

Guttentag)

has worked

for

and represent

the

fairly

re-

board

task in selecting

to all readers

psychologist, because

of evaluation

and advisory

in just

journals

volume one year.

and

societies;

shows By

how

1977,

far the

discipline

the field had profes-

consequently,

there

was no

322

BOOK

longer

a

should

exist

question

about

but

whether

instead

a score

evaluation

REVIEWS

research

of

Review articles.

the second articles

from

volume

the

is a series

opening

on the status

provide

evaluation

volumes

Annual

Apart

and

manners

and methods

for utilization.

would

be difficult

sociologist, volved

to research

would

human

of the evaluation to the depth

omist

of

~-- for

the

field,

service

articles

and some may beThis

or

type

of ar-

psychologist,

anyone

volume

else

testifies

on certain

of evaluation

in-

to the

and the Guttentag

of thought student

and dissemithese

to the

provider Glass

for the psychologist

or human

of organization

Granted,

invaluable

The

testifies

practitioner,

reviews

and write

service

in evaluation.

need

integrative

to integrate.

be

breadth the

in no

of presentation

be premature

however,

by

modes

nation

ticle,

Freeman research,

methods,

and implementation,

of integrative

of evaluation

comprehensive,

models

lieve it would

article

volume

topics.

Now,

as well

as the

as well as for the econ-

provider

.- is for integration

and

A. Hargreaves,

Mardi J. Horowitz,

and

synthesis.

Evaluation James

of Human

E. Sorensen. Bernard

Reviewer: This

handsome

rent

thinking

cated

volume

evaluation.

troduces

the reader

to the complex

chapters

section

on

assurance.

Some

years

opment munity perts

to talk

book

beside

sleep

than

have

been

This

includes

status

fourth

together

The second

two

inand

personnel;

people

undertaking

readers

will have

ity to their The ators

have

includes

work

in a rational

ones

preoccupied

the editors

of the field

on

attempt

of program

program tors,

health

written

myself

information center.

guidelines

with.

me in those

days,

happened

successful

aims

with

varying

at different

varying

levels

of sophistication.

degrees human

have

lost

undoubtedly

audiences

a useful

There ex-

sections program

by

the

are not

funded

sions

made

fear,

passion,

on

finding

best,

presentation.

Someday,

will be pardirectors

given the

service

program

I don’t

evaluation

and this volume

should

that

service

are not

expediency,

there

needs

in an adversarial

service

are to

programs

know

deci-

equity, what

the

world,

or

out.

of rationality

this book

in the human

evalua-

programs

are in our irrational

program

to rationality intersection

while,

self-pride.

of rationality

Human

are

of inertia,

and

- the very

resources

to needed

of human

basis

or blinding

even how to begin

point

and to funded

the

policy

services

how

they

increasingly

to program

about

of us can

ity at its very

assume

myself

evalu-

that

of so many

importance

of hu-

program

to assume

I find

irrationality

of us knows

limits

centralis pitched

in the field

In truth, than

Yet

central

Each

optimal

other

is to say, decisions

Each

for Thus,

of greatest

in the field of human

allocated.

that

others

studies.

that the material

evaluation

world.

of most

that

sections

rational.

choice

would system.

and

little

far less

and chapters

of complexity Some

blind.

say that if I had this

I would

service

for a com-

acknowledged

in developing

book

for

flying

few

and

in the devel-

system

I was and

I can comfortably

actually

important

engaged

is terribly

decisions

decisions

research

and hope

of program

comprehensive

and

information

still

level of difficulty.

business

services

analysis,

clinicians;

to find those

man

including

for management for

community

interests

information

section

others others

at an appropriate

sec-

needed.

I found

planners;

system

ago,

written ticularly

services

grouped

evaluation,

current

service

or program

be

more

William

$24.50.

the education of program evaluators, and possible future developments in the field.

mental few

generally evaluation.

The

the cur-

of the volume

of human

cost-effectiveness

of a management

were

section

In the final section,

the

evaluation and consider briefly

Attkisson,

ix + 492pp.,

and dedi-

of health

on management

program scaling,

to summarize

its covers

important

on the topic

assessment.

attainment

quality

within most

of program

third

on need

1978,

initial

chapters

chapters five

The

three

The

goal

of the

set of activities

systems.

by C. Clifford

Press,

to the concept

the heading includes

edited

Academic

includes

in the country

program

tion

Programs,

L. Bloom

of many

experts

under

Service

*vew York:

field.

rational-

that superb

re-

to be consideration context,

and politics.

be required

delivery

represents details

reading

that

is, to

In the meanfor everyone