Cumulative index volumes 2–12 (1981–1991)

The Journal of EVALUATION PRACTICE Cumulative Index Volumes 2-12 (1981-1991) [Note: Prior to 1986, Evaluation Practice was called Evaluation News. News was an informal publication distributed by respective editors until 1981 when Sage became the publisher. That year was identified as Volume 2 for this index. In 1986, with Volume 7, the name changed to Evaluation Practice. In 1990, with Volume 11, JAI Press, Inc., became publisher and the journal took on a whole new look-- in color, size, format, and content. Since 1989, Evaluation Practice has been a peer refereed journal.]

Austin, Velda, see Richards, John D., Sue A. Akins, James M. Georgoulakis, David R. Boiling, Cherry L. Gaffney, and Atanacid C. Guillen, "Evaluation of an Ambulatory Care Classification System," 11(3):201-205.

AUTHORS Akins, Sue A. see Richards, John D., James M. Georgoulakis, David R. Bolling, Velda Austin, Cherry L. Gaffney, and Atanacid C. Guillen, "Evaluation of an Ambulatory Care Classification System," 11(3):201-205. Akpom, Kathy, "Planning Program Evaluation to Meet Management Information Needs," 7(4):35-37. Altschuld, James W., Phyllis M. Thomas and Wendy H. McColskey,"An Evaluation Model for the Development of Technical Training Programs," 5(4):33-37. Ameen, Christine, "Use of the Joint Committee Standards: Benefits Gained and Lessons Learned," 11(1):33-38. Arnold, Mit and Nikki Craft, "A Survey of Program Evaluation in University Affiliated Programs," 9(2):31-35.

Bank, Adrianne, "Explanation of the Evaluation Design Project," 2(1):73-75. Bank, Adrianne and Richard C. Williams,"Evaluation Design Project," 3(1):75-77. Banta, Trudy W. and Homer S. Fisher, "An International Perspective on Assessing Baccalaureate Program Outcomes," 11(3):167175. Baron, Joan Boykoff, "The Standards: A State Level Perspective," 2(2):163-166. Basarab, David J., Sr., "Calculating the Return on Training Investment," 11 (3): 177-185. Becket, Heather and Karen Kirkhart, "The Standards: Implications for Professional Licensure and Accreditation," 2(2):153-156.

Evaluation Practice, Vol. 12, No. 3, 1991, pp. 275-290. ISSN: 0191-8036

Copyright © 1991 by JAI Press, Inc. All fights of reproduction in any form reserved.

275

276 Beer, Valorie and Anne Marie S. Jensen, "Hypertext: What It Is and How to Use It to Analyze Data," 12(3):193-203. Benedict, Ralph H.B. and Arthur MacNeill Horton, Jr., "Evaluation of Consumer Satisfaction with Information Derived from Neuropsychological Assessment," 12(1):3338. Benson, Jeri and Myron Dembo, "Formative Evaluation of Desegregation Assistance," 3(1):73-75. Beury, Harriett S., "PE Is Coming to VR!" 2(4):350-352. Bhola, H. S., "An Action Model for Evaluation Training," 4(2):53-55. Bickel, William E. and R. Tony Eichelberger,"A Conversation with Ed Meade," 9(1):39-49. Boiling, David R., s e e Richards, John D., Sue A. Akins, James M. Georgoulakis, Velda Austin, Cherry L. Gaffney, and Atanacid C. Guillen, "Evaluation of an Ambulatory Care Classification System," 11(3):201-205. Bonwich, Emily and John C. Reid, "Medical Rehabilitation: Issues in Assessment of Functional Change," 12(3):205-215. Boser, Judith A., "Formatting Questionnaires for Computer Data Entry," 6(2):18-21. Boruch, Robert, "What Have We Learned about Randomized Social Experiments Over the Last Decade?" 8(1):44--49. Boruch, Robert F. and Milbrey W. McLaughlin, "Debate Mandated Experimental Methods," 3(1):11-30. Bowen, Gary L., "An Evaluation of U.S. Air Force Pilot Support Centers," 4(4):56-57; "Community Needs Assessment: A Strategy and Case Example." 8(3):5-9. Bowering, David J., "Educational Impacts of Sponsored R&D," 3(1):69-70. Brackett, Douglas, s e e Scarbrough, William. Braskamp, Larry A., "Evaluation in Higher Education: Selling Life Insurance and Being an Evaluator," 2(1):67--69; "Discussion on Assessment in Higher Education," 10(4):5156. Braskamp, Larry A. and James D. Raths, "On Evaluating Professionals in Higher Education," 3(2):85-90. Brock, Timothy C., "Public Relations for Evaluation,"7(1):57-62. Bruning, Katherine K. and Barbara J. Garvin, "Validation of a Revised Curriculum: A Formative Evaluation," 5(4):21-25.

EVALUATION PRACTICE, 12(3), 1991 Bunda, Mary Anne, "Alternative Ethics Reflected in Education and Evaluation," 4(1 ):5758. Buttram, Joan L., "Focus Groups: A Starting Point for Needs Assessment," 11(3):207212. Cahn, Jerry, "Evaluation and Government Relations: Are We Doing Enough?" 3(1):78-84. Caliguri, Joseph P., "Teaching Students How to Evaluate and Improve Elementary and Secondary Teaching," 4(2):55-56; "The Evaluator's Journal: A Qualitative Supplement to Program Evaluation," 5(4):54-58. Camp, Martha G., s e e Skipper, James K., Jr. Campbell, Donald T., "Methods for the Experimenting Society" Reprint, 12(3):223-260 Cantwell, Zita M., "A Note on the Potential for Bias in the Structure and Wording of Questionnaire Items," 6(2):9-15. Capper, Joanne, "Marketing Evaluation Skills and Services," 4(2):57--60. Casper, Paul N. and Alan Roecks, "Looking at Levels of Use as a Program Evaluation Tool," 4(3):68-71. Champion, Hale, "Physician Heal Thyself: One Public Manager's View of Program Evaluation," 6(1):29-40. Chelimski, Eleanor, "What Have We Learned about the Politics of Program Evaluation?" 8(1):5-22. Chelimski, Eleanor, David Cordray, and Loisellin Datta, "Federal Evaluation: The Pendulum Has Swung Too Far," 10(2):25-39. Chircop, Saviour and Nick L. Smith, "The WeissPatton Debate: Illumination of the Fundamental Concerns," 10(1):5-13. Clark, Terry A., "Documentation as Evaluation: Capturing Context, Process, Obstacles, and Success," 9(1):21-31. Clifford, David, "Instruments for Measuring Outcomes in Mental Health Program Evaluation: Results of a Survey," 2(1):54-58. Cole, Roger L., s e e Jones, Ted W. Compton, J. Lin, s e e Greene, Jennifer C. Conboy, Joseph E., s e e Oliver, Denis R. Cook, Thomas D., s e e St. Pierre, Robert G., and Robert G. Straw, "Evaluating Nebraska's Nutrition Education and Training Program," 3(1): 67-69; "Opportunities for Evaluation in the Next Few Years," 5(2):20--46.

Cumulative

Index

Cordray, David, Chelimski, Eleanor and Loisellin Datta,"Federal Evaluation: The Pendulum Has Swung Too Far," 10(2):25-30. Covert, Robert W., "A Checklist for Developing Questionnaires," 5(3): 74-78; "Ethics in Evaluation: Beyond the Standards, 9(1):3237. Craft, Nikki, s e e Arnold, Mit. Cummings, Oliver W., "Success Factors for Evaluation in a Business Training Context," 7(4):5-13. Cummings, Oliver W. and Alan N. Nowakowski, "Course Evaluation Procedures in Professional Education," 5(4):28-32; "Microcumputer Training Impact Study," 5(4):43-47. Darcy, Laurie A., s e e Turpin, Robin S. Datta, Lois-ellin, Chelimski, Eleanor and David Cordray, "Federal Evaluation: The Pendulum Has Swung Too Far," 10(2):25-30. Dembo, Myron, s e e Benson, Jeri. Denton, Stanley E. and Paul G. LeMahieu, "Evaluation Research as an Integral Part of Pittsburgh's In Service Staff Development Center," 6(3):45-50. Dhanens, Valerie, "Evaluation of Instructor Performance," 5(4):37-40. Dibella, Anthony, "The Research Manager's Role in Encouraging Evaluation Use," 11(2):115-119. Dillon, James T., "Superanalysis," 3(4):35-43. Donahue, William J., s e e Oliver, Denis R. Douglas, Gordon, s e e Winberg, Alan. Drezek, Stan, "Designing Useful Evaluations," 3(4):63-64. Dunn, Patricia F., s e e Richards, John D., James A. Taylor, and Thomas J. Williams, "Summative Evaluation of the Academy of Health Sciences Training Products and Programs," 4(4):54-55. Eash, Maurice J. and Hersholt C. Waxman, "Our Class and Its Work Questionnaire," 4(2):6768. Eastmond, Nichoils J., Jr., William Saunders, and Duane Merrell, "Teaching Evaluation Through Paid Contractual Arrangements," 10(2):58-62. Edginton, Christopher R., s e e Neal, Larry L. Edwards, Patricia K., "An Evaluation of the American Red Cross Nutrition Course," 6(2):52-54.

277 Eicheiberger, T.E.,"Interview with Jeff Schiller: A 'Dinosaur' in Federal Government Evaluation," 7(3):25-34; with William E. Bickel, "A Conversation with Ed Meade," 9(1):3949. Fang, Wei Li, "Using Photographs in an Evaluation Report," 6(2):24--27. Fernandez-Ballesteros, R., M. Izal, I. Montorio, M. G. Llorente, J. M. Hernandez, and M. A. Guerrero, "Evaluation of Residential Programs for the Elderly in Spain and the United States," 12(2):159-164. Fiene, Richard, "National Consortium Monitoring System for Child-Care Activities," 3(1):72-3. Fisher, Homer S., s e e Banta, Trudy W. Fitz, Don, "Analyzing Patterns of Small Client Changes with a Microcomputer Spreadsheet," 9(1):50-58. Ford, Sue, "Getting Mileage Out of One Naturalistic Inquiry," 8(4):12-20. Foshay, Wellesley R., "Evaluation of Computer Software Products," 5(4):50-54. Fraser, Barry J., "Australian Curriculum Evaluation Projects," 3(1):71-72; "Individualized Classroom Environment Questionnaire," 3(2):72-73. Gaffney, Cherry L. s e e Richards, John D., Sue A. Akins, James M. Georgoulakis, David R. Boiling, Velda Austin, and Atanacid C. Guillen, "Evaluation of an Ambulatory Care Classification System," 11(3):201-205. Garrett, George W., "Evaluation of One Component of Competency-Based Teacher Education in Oklahoma," 4(4):52-54. Garvin, Barbara J., s e e Bruning, Katherine K. Georgoulakis, James M., s e e Richards, John D., Sue A. Akins, David R. Boiling, Velda Austin, Cherry L. Gaffney, and Atanacid C. Guillen, "Evaluation of an Ambulatory Care Classification System," 11(3):201-205. Gill, Stephen J. and Nancy R. Zimmerman, "Racial/Ethnic and Gender Bias in the Courts: A Stakeholder-Focused Evaluation,"ll(2): 103-108. Ginsburg, Alan L. and Vera C. Winkler, "Evaluation Improvement Strategies at the U.S. Office of Education," 10(2):40--47. Goldstein, Harris K., "Mental Health Evaluation in Rural Areas," 2(3):260-261.

278 Goldstein, Harris K. and Kriss Hensley, "Are Planner-Evaluator Jobs Changing?" 3(4):76-79. Green, Rex S., "Unraveling CECO Mysteries: More on Outcomes," 2(3):251-259; "Some Final Words on the Outcome Side of CECO," 3(2):74-79. Greene, Jennifer C., J. Lin Compton, Elizabeth Whitmore, and Harry Sappington, "Strategies for Qualitative Data Analysis," 8(4):511. Greenfield, Arnold L., "Issues in Designing Evaluations of Patients' Rights Protection Systems for Public Psychiatric Hospitals," 2(4):353-356; "Patients' Rights Violations: Can Interviews Overcome Them?" 3(2):8184. Gressard, Risa, s e e Scarbrough, William. Guba, Egon G., "What Have We Learned about Naturalistic Evaluation?" 8(1):23-43. Guerrero, M. A., s e e Fernandez-Ballesteros, R. Guillen, Atanacid C., s e e Richards, John D., Sue A. Akins, James M. Georgoulakis, David R. Boiling, Velda Austin, Cherry L. Gaffney, "Evaluation of an Ambulatory Care Classification System," 11(3):201-205. Harshbarger, Dwight, "Valued Added and the Evaluator," 5(1):20-33. Hauer, Diane M. and Elisa J. Slee, "A Review of Comprehensive Examinations in Selected Evaluation Training Programs," 10(4):2025. Hecht, Kathryn A., "The S t a n d a r d s : A Rural School Perspective," 2(2):169-171; "Going Independent: A Personal Viewpoint," 3(2):66-71; "Corporate Foundation Evaluation: The Banking Industry," 5(4):17-21. Hendrick, Terry E., "The Interaction of Politics and Evaluation," 9(3):5-14. Hendricks, Michael, "Should Evaluators Address the Morality of Public Programs?" 4(1):54-56; "Preparing and Using Briefing Charts," 5(3):78-82; "A Conversation with Michael Wargo," 7(4):23-34; "A Conversation with W. Haven North, Director, Center for Development Information and Evaluation, U.S. Agency for International Development," 8(1):55-63; "A Conversation with Dr. Gary T. Henry, Deputy Secretary of Education, Commonwealth of Virginia," 8(4):2130.

EVALUATION PRACTICE, 12(3), 1991 Hendricks, Michael and Meredith Papagiannis, "Do's and Dont's for Offering Effective Recommendations," 11(2):121-125. Hennessy, Michael and Michael J. Sullivan, "Good Organizational Reasons for Bad Evaluation Research," 10(4):41-50. Hensley, Kriss, s e e Goldstein, Harris K. Hernandez, J. M., s e e Fernandez-Ballesteros, R. Hilliard, Asa G., III, "Kemetic (Egyptian) Historical Revision: Implications for CrossCultural Evaluation and Research in Education," 10(2):7-23. Hoban, Dennis R., s e e Skipper, James K., Jr. Holzemer, William, "Evaluating Nursing Education," 2(3):261-263. Horton, Arthur MacNeill, Jr., s e e Benedict, Ralph H.B. Hotes, Robert W., "An Evaluation of a Helicopter Pilot Ground Training System," 4(2 ): 61-62; "Evaluating Microcomputer-Based Training," 5(4):47-50. House, Ernest R., "Factional Disputes in Evaluation," 5(3):19-21; "Evaluation in Australia," 5(4): 13-14; "Evaluating Professionals," 6(1):65-67; "Undisciplined Social Science," 6(2):28-31; " D e u s E x M a c h i n a , Personnel Evaluation Made Public," 6(3):21-24; "Being 'Charles Murrayed'," 6(4):21-23; "Internal Evaluation," 7(1):63-64; "Drawing Evaluative Conclusion," 7(3):35-39;"Evaluators, Libs, and Neocons," 8(1):64--67; "The Evaluation Audit," 8(2):52-56; "The IranContra Hearings and Evaluation," 8(4):3133; "Evaluating the FBI: A Response to Sonnichsen," 9(3):43-46. Huberty, Carl J., "Another Perspective on the Role of an Internal Evaluator," 9(4):25-32. Izal, R., s e e Fernandez-Ballesteros, R. Jensen, Anne Marie S., s e e Beer, Valorie. JerreU, Jeanette M. "Evaluation Experience in Business Settings," 5(4):15-17. Jerrell, Jeni, "A Conversation with John W. Farquhar," 8(3): 19-30. Johnson, Curtis T., s e e Richards, John D., Daniel J. Muraida, Thomas C. Whitesell, and Thomas J. Williams, "An Evaluation of Predictive Validity of the Armed Forces Vocational Aptitude Battery," 7(1):65-68.

Cumulative

Index

Johnson, Paul L., "A Conversation with Joseph S. Wholey about the Program for Excellence in Human Services," 11(1):53-61; "Ron Carlson and James Bell Discuss the Challenges Facing Health Evaluators in the 1990s," 11(2): 127-133; "A Conversation with Richard P. Kusserow, Inspector General, U. S. Department of Health and Human Services," 11(3):221-230; "Ray Rist Talks about the IIAS Working Group on Policy and Program Evaluation," 12(1):45-53. Jones, Ted W. and Roger L. Cole, "A Survey of Program Evaluators in Community Health Centers in Tennessee," 5(3):45-49. Jones, Tricia, s e e Piiotta, Joseph, John Murphy and Elizabeth Wilson, "Trends in Community Perception of Social Service Planning," 3(4):80-82. Keleman, Steven,"Thoughts on Contracting With Small School Districts," 2(1):62-64. Kirkhart, Karen E., "Program Evaluation Under the 1980 Mental Health System Act," 2(1):7984; with Heather Becker, "The S t a n d a r d s : Implications for Professional Licensure and Accreditation," 2(2): 153-156; "Moral Issues in the Conduct of Mental Health Evaluation," 4(1):50-53. Knott, Tara Davis, "Evaluation and Health Care Delivery: Where Do We Go From Here?" 2(4):357-359; "Evaluation in the Hospitality Industry," 5(4):26-27. Kronenfeld, Jennie J., "Whither Evaluation: The Role of Federal Sponsorship" 3(3):87-88; "Having Students Conduct Evaluations: Merging Field Experience and Academic Learning," 2(4):375-378. Lahey, Robert, s e e Winberg, Alan. Lapine, Louise, "Using the Nominal Group Technique in Formative Evalution," 8(3):15-18. Leinhardt, Gaea, s e e Seewald, Andrea Mar. Leister, Sandra C., s e e Ory, John C. LeMahieu, Paul G., s e e Denton, Stanley E. Light, Richard J., "Estimating the Outcome of ScreeningPrograms: A Role for Evaluation," 8(1):50-54. Lincoln, Yvonna S., "Program Review, Accreditation Processes, and Outcomes Assessment: Pressures on Institutions of Higher Education," 11(1):13-23; "The Arts and Sciences of ProgramEvaluation," 12(1):1-7.

279 Linn, Marcia C., "Standards for Evaluating Outof-School Learning," 2(2):171-176. Lipsey, Mark W., "Practice and Malpractice in Evaluation Research," 9(4):5-24. Lissitz, Robert W., "Effects of Using a Microcomputer System for Field Audits and Other Investigations of the Office of Inspector General," 6(2):55-58. Llorente, M.G., s e e Fernandez-Ballesteros, R. Lorber, Cathy, "Documenting the Catalytic Effect of Rehabilitation Programs for Deinstitutionalized Individuals," 2(4):364368. Lorber, Cathy and James S. Lundstrom, "Program Evaluation in Rehabilitation," 2(1):5861. Lundstrom, James S., s e e Lorber, Cathy, "Program Evaluation in Rehabilitation," 2(1):5861. Lyle, Kenneth, s e e Pokorny, Lois J. Lynch, Kathleen Bodisch, "Style Versus Substance in Evaluation Reports," 7(4):75-76. Lyons, Ray and Bill Rubin, "Standards in Mental Health Evaluation: Variance is the Spice of Life," 2(2):183-187. Mangano, Michael, "Using the Media to Disseminate Evaluation Results," 12(2):115-120; "ImprovingServices Through Effective Practice Reviews," 12(3):217-222. Marvin, Keith, "Development of Evaluation Research Society Standards for Program Evaluation," 2(2): 179-182. McClintock, Charles, "Evaluators as Applied Theorist," 11(1):1-12. McColskey, Wendy H., s e e Altschuld, James W. McConnell, William A., "Practicing What You Preach," 3(1):64-66. McKillip, Jack, "Applied Research Consultants (ARC): The Consulting Firm as a Model for Applied Research Training," 7(4):37-40. McMillan, Robert A., "Formative Evaluation of Textbooks," 2(4):343-349. McLaughin, Milbrey W. and Robert F Boruch, "Debate Mandated Experimental Methods," 3(1):11-30. McTaggart, Robin, "When Democratic Evaluation Doesn't Seem Democratic," 12(1):9-21. Merrell, Duane, s e e Eastmond, Nicholls J., Jr. Miller, Ebert L., "Adapting the Self-Anchoring Rating Technique to Mail Questionnaire Form," 2(4):368-371.

280 Mitchell, Jerry, "Policy Evaluation for Policy Communities: Confronting the Utilization Problem," 11(2):109-114. Montorio, I., see Fernandez-Ballesteros, R. Mood, Alexander M., "Further Comments on Implementation," 9(4):69-71. Moreil, Jonathan A., "Evaluation Status of a Loose Coalition," 11(3):213-219. Moxley, David P. and R.J. Visingardi, "Teaching Evaluation Through the Practicum Experience," 10(2):54-58. Mukherjee, Prachee and Nick L. Smith, "Content Analysis of the E v a l u a t i o n S t u d i e s R e v i e w A n n u a l , 1975-1986," 10(4):26-32. Muraida, Daniel J., s e e Richards, John D., James A. Taylor, and Thomas J. Williams, "Surveying Supervisors of Recent Graduates of the Academy of Health Science, U.S. Army," 4(2):65-66; see Richards, John D., Thomas C. Whitesell, Thomas J. Williams and Curtis T. Johnson, "An Evaluation of Predictive Validity of the Armed Forces Vocational Aptitude Battery," 7(1):65-68. Murphy, John, see Pilotta, Joseph, Tricia Jones and Elizabeth Wilson, "Trends in Community Perception of Social Service Planning," 3(4):80-82. Murray, Charles, "Response to Ernest House," 6(3):25-27. Muscatello, Daniel B., "Evaluation and the Management Process," 10(3): 12-17. Myers, Donald W., "Evaluating an Employee Assistance Program," 5(4):40--43. Nagel, Stuart S., "Some Trends in Policy Evaluation Research," 4(2):70-77; "P/G % Analysis: An Evaluation Aid," 6(2):21-24; Evaluative Decisions Under Conflicting Constraints," 9(2):36-39. Neal, Larry L. and Christopher R. Edginton, "A Case For Edge Coding: Beyond Process to Economics and Education," 2(4):372-374. Nevo, David, "The International Context for Research on Evaluation," 3(4):73-75. Newcomer, Kathryn E., "Asking Appropriate Questions Appropriately," 6(4):16-20; "A Hands-On Approach to Teaching Program Evaluation," 6(3):77-79. Nowakowski, Alan N., see Cummings, Oliver W.

EVALUATION PRACTICE, 12(3), 1991 O'Doherty, Hugh and the Faculty Consortium on Dispute Resolution Research, "Mediation Evaluation: Status Report and Challenges for the Future," 10(4):8-19. Oliver, Denis R., Joseph E. Conboy, and William J. Donahue, "A Form for Evaluating Survey Instruments," 6(2):15-18. Ory, John C. and Sandra C. Leister, "'Doing' Evaluation -- A Student's Perspective," 8(3):12-14. Osterlind, Steven, "The S t a n d a r d s : A n Urban School District Perspective," 2(2):166-168. O'Sullivan, Rita G., "Improving the Return Rate of Final Conference Evaluations with Mailed Questionnaires," 9(4):50-55. Owen, John M., "An Evaluation Approach to Training Using the Notion of Form: An Australian Example," 12(2):131-137. Papagiannis, Meredith, s e e Hendricks, Michael, "Do's and Dont's for Offering Effective Recommendations," 11(2):121-125. Patton, Michael Quinn, "The Evaluator's Responsibility for Utilization," 9(2):5-24; "The Challenge of Being a Profession," 11(1):4551. Payne, David A., "How I Learned to Love 'The S t a n d a r d s ' , " 9(4):37-44. Pechman, Ellen M., "Optimizing Evaluation Use," 3(4):64--67. Philip, James R., s e e Skipper, James K., Jr. Pilotta, Joseph, s e e Murphy, John. Pilotta, Joseph, John Murphy, Tricia Jones and Elizabeth Wilson, "Trends in Community Perception of Social Service Planning," 3(4):80--82. Pokorny, Lois J., Kenneth Lyle, Margaret Tyler, and James Topolski, "Introducing a Modified Nominal Group Technique for Issue Identification," 9(2):40--44. Pratto, David J., s e e Skipper, James K., Jr. Rallis, Sharon F., "Evaluating an Old Friend: One Evaluator's View of the Changing Role of Program Evaluator in Chapter One," 9(2):25-30. Raths, James and Larry A. Braskamp,"On Evaluating Professionals in Higher Education," 3(2):85-90; "The Power of Negative Thinking," 8(2):5-9. Rayner, Michael, "Evaluation in Canada," 7(1):45-56.

Cumulative

Index

Reichardt, Charles S., s e e Shadish, William R., Jr., "Journals that Publish Work of Interest to Evaluators," 9(3): 29-34. Reid, John C., s e e Bonwich, Emily. Reineke, Robert A. and Marjorie J. Willeke, "Program Evaluators Foray into Personnal Evaluation," 9( 4):45-49; "Who Should the Meta-Evaluator Bite?" 5(1):77-79; "Stakeholder Involvement in Evaluation: Suggestions for Practice," 12(1):39-44. Revill, Alan, s e e Winberg, Alan. Reineke, Robert A. and Wayne W. Welch, "Client-Centered Meta-Evaluation,"7(3):1624. Richards, John D., Sue A. Akins, James M. Georgoulakis, David R. Bolling, Velda Austin, Cherry L. Gaffney, and Atanacid C. Guillen, "Evaluation of an Ambulatory Care Classification Systems," 11(3):201-205. Richards, John D., Daniel J. Muraida, Thomas C. Whitesell, Thomas J. Williams and Curtis T. Johnson,"An Evaluation of Predictive Validity of the Armed Forces Vocational Aptitude Battery," 7(1):65-68. Richards, John D., James A. Taylor, Thomas J. Williams, and Patricia F. Dunn, "Summative Evaluation of the Academy of Health Sciences Training Products and Programs," 4(4):54-55. Richards, John D., James A. Taylor, Thomas J. Williams, and Daniel J. Muraida,"Surveying Supervisors of Recent Graduates of the Academy of Health Science, U.S. Army," 4(2):6566. Richman, Carol M. and Jean Gasen Romaniuk, "The Structured Group Interview as an Evaluation Technique," 4(4):58-60. Rippey, Robert M., "The Evaluation of Teaching in Medical Schools," 2 (4):321-322. Roberts-Gray, Cynthia and Yvette Stallworth, "Reporting to the Busy Decision Maker," 8(2):31-35. Roberts-Gray, Cynthia, Linda Fox Simmons, and Alexa Sparkman, "Evaluation of Nutrition Education and Training Program Workshops," 8 (3):10-11. Roecks, Alan L., "How Much Evaluator Time Is Spent Working with Program Staff?." 4(2):69. Roecks, Alan L. and Paul N. Casper, "Looking at Levels of Use as a Program Evaluation Tool," 4(3):68-71.

281 Rog, Debra J., "A Conversation with Charles A. Kiesler," 9(2):45-52 Romaniuk, Jean Gasen, s e e Richman, Carol M. Rossi, Peter H., "Pussycats, Weasels or Percherons? Current Prospects for Social Science Under the Reagan Regime," 4(1):12-27. Roth, Jane, "Needs and the Needs Assessment Process," (Reprint), 11(2):141-143. Rubin, Bill, s e e Lyons, Ray. Rutman, Leonard, "Evaluation at the Federal Level," 7(2):14-18; "Serving Management and Accountability: A Conflict for Program Evaluation," 11(1):39-43. Rymph, David B., "Evaluation in the U.S. Department of Housing and Urban Development, 1980-1988," 10(2):30-39. Sadler, Royce D., "Generalized Evaluation Design," 3(3):80-86. Sappington, Harry, s e e Greene, Jennifer C. Sartorius, Rolf H., "Learning and Teaching Others Practical Evaluation Skills: Learning Practical Evaluation 'On the Job,' 10(2):48--54; "The Logical Framework Approach to Project Design and Management: Enter the Mainstream," 12(2):139-147. Saunders, William, s e e Eastmond, Nicholls J., Jr. Scarbrough, William, Risa Gressard, James Tiller, and Douglas Brackett, "Information Processing and Data Reduction: Defining the Content Domain for the Uniform National Lieensure Exam in Landscape Architecture," 6(3):51-55. Schrock, Timothy J., "A Way to Empirically Analyze Kompetence: A Model for Faculty Evaluation," 4(2):82-85. Schwandt, Thomas A., "The Politics of Verifying Trustworthiness in Evaluation Auditing," 10(4):33-40. Scriven, Michael, "The 'Weight and Sum' Methodology," 2(1):85-90; "The Good News and the Bad News about Product Evaluation," 2(3): 278-282; "Serious Product Evaluation Some Field Notes," 3(1):89-94; "New Frontiers of Evaluation," 7(1):7-44; "Needs Assessment..." (Reprint), 11(2): 144; "Prose and Cons about Goal-Free Evaluation" (Reprint), 12(1):55-63. Scriven, Michael with help from Jane Roth, "Special Feature: Needs Assessment" (Reprint), 11(2):135-140.

282 Searle, Barbara, "The Standards: Applicability Outside the United States," 2(2):176-178. Sechrest, Lee, "The S t a n d a r d s : A General Review," 2(2):145-148. Seewald, Andrea Mar and Gaea Leinhardt, "General School Behavior," 6(3):72-73. Serow, Elizabeth G., "The Use of Role Play in Instrument Development," 9(4):33-36. Shadish, William R., Jr., "Evaluation During Fiscal Stringency," 3(3):89-91. Shadish, William R., Jr. and Charles S. Reichardt, "Journals that Publish Work of Interest to Evaluators," 9(3):29-34. Shermis, Mark D., "Issues in Survey Data Quality: Four Field Experiments, (Dissertation in Evaluation), 4(4):36-38; Bulletin Board 6(3):89-91. Shipman, Stephanie,"General Criteria for Evaluating Social Programs, " 10(1):20-26. Simmons, Linda Fox, see Roberts-Gray, Cynthia. Simson, Sharon, see Wilson, Laura B. Skipper, James K., Jr., David J. Pratto, James R. Philip, Martha G. Camp, and Dennis R. Hoban, "Benefits of Hindsight: Design Problems in Evaluating Innovation in Medical Education," 10(3):7-11. Slaughter, Helen B., "The Participation of Cultural Informants on Bilingual and CrossCultural Evalu ation Teams," 12(2): 149-157. Slee, Elisa J., see Hauer, Diane M. Smith, Nick L. and Darrel Caulley, "Constructing Reasonable Expectations in Evaluation," 2(3):265-267; "Alternatives in Teacher Evaluation," 3(2):90-93; "Evaluative Applications of Meta- and Mega-Analysis," 3(4):43-47; "Moral Problems in Evaluation Practice," 4(1):48-50; "Public Data Resources for Educational Policy Analysis," 4(3):65-68; "Cost Effectiveness Studies of Educational Programs: A Checklist," 4(4):43-49; "Evaluation Units in State Departments of Education: A Five-Year Update," 5 (3):37-44; and Turpin, Robin S. and Laurie A. Darcy, "Survey of Journals Publishing Evaluation Research," 8(2):10-19. Smith, Nick L. and Prachee Mukherjee, "Content Analysis of the E v a l u a t i o n S t u d i e s R e v i e w A n n u a l , 1975-1986," 10(4):26-32. Smith, Nick L. and Saviour Chircop,"The WeissPatton Debate: Illumination of the Fundamental Concerns," 10(1):5-13;

EVALUATION PRACTICE, 12(3), 1991 Sonnichsen, Richard C., "An Internal Evaluator Responds to Ernest House's Views on Internal Evaluation," 8(4):34-36. Sparkman, Alexa, s e e Roberts-Gray, Cynthia. Sporn, Douglas, "An Interview with Gerald L. Barkdoll," 10(1):27-32; "An Interview with Richard C. Sonnichsen," 10(2):63-67; "An Interview with Michael Hendricks," 10(3):18-24. St. Pierre, Robert G., Thomas D. Cook, and Robert B. Straw, "Evaluating Nebraska's Nutrition Education and Training Program," 3(1):67-69. Stahl, Wayne K., "Academic Program Review in a Community College," 4(2):62-64. Stake, Robert E., "Setting Standards for Educational Evaluators," 2(2): 148-152; "The Two Cultures and the Evaluation Evolution," 3(2):15-27; "How Sharp Should the Evaluator's Teeth Be?" 3(3):79-80; "Two Observations," 4(3):72-74; "Excerpts from: 'Program Evaluation, Particularly Responsive Evaluation'," (Reprint), 12(1):63-76. Stalford, Charles B., "Reflections on Writing a Clear Evaluation Summary," 6(4): 10-16. Stallworth, Yvette and Cynthia Roberts-Gray, "Reporting to the Busy Decision Maker," 8(2):31-35. Stanley, Julian C., "Education in the Fast Lane: Methodological Problems of Evaluating Its Effects," 4(1 ):28--46. Straw, Robert G., s e e St. Pierre, Robert G. Stufflebeam, Daniel L., "A Brief Introduction to the S t a n d a r d s , " 2(2);141-145; "A Review of Progress in Educational Evaluation," 3(2): 1527. Suchman, Edward A., "The Social Experiment and the Future of Evaluative Research" (Reprint), 11(3):251-259. Sullivan, Michael J., s e e Hennessy, Michael. Swaim, Richard, "Evaluating, the Arts, and Cultural Policy," 2(2):137-139. Taylor James A., s e e Richards, John D., Thomas J. Williams, and Daniel J. Muraida, "Surveying Supervisors of Recent Graduates of the Academy of Health Science, U.S. Army," 4(2):65-66; s e e Richards, John D., Thomas J. Williams, and Patricia F. Dunn, "Summative Evaluation of the Academy of Health Sciences Training Products and Programs," 4(4):54--55.

Cumulative

Index

Ternent, William A., "Applying Portfolio Evaluation Concepts to Educational Program Screening," 11(3):187-199. Thomas, Phyllis M., s e e Altschuld, James. Tiller, James, s e e Scarbrough, William. Topolski, James, s e e Pokorny, Lois J. Turpin, Robin S., Nick L. Smith, and Laurie A. Darcy,"Survey of Journals Publishing Evaluation Research," 8(2):10-19. Tyler, Margaret, s e e Pokorny, Lois J. Visingardi, R. J., s e e Moxley, David P. Vitek, Tom, "The Location of Subsidized Housing," 2(1):70-72. Wallace, Richard C., Jr., "Data-Driven Educational Leadership," 7(3):5-15. Wargo, Michael J., "The S t a n d a r d s : A Federal Level Perspective," 2(2):157-162. Waterman, Steve, "Comment on Needs Assessment Article in EN #2," (Reprint), 11(2): 140141. Waxman, Hersholt C., s e e Eash, Maurice J. Weiss, Carol H., "Evaluation for Decisions: Is Anybody There? Does Anybody Care?" 9(1):5-19; "If Program Decisions Hinged Only on Information: A Response to Patton," 9(3):15-28. Welch, Wayne W. and Robert A. Reineke, "Client-Centered Meta-Ev aluation," 7(3): 16-24. Welch, Wayne W. and Fred Sternhagen, "Unintended Effects of Program Evaluation," 12(2):121-129. Whitesell, Thomas C., s e e Richards, John D., Daniel J. Muraida, Thomas J. Williams and Curtis T. Johnson, "An Evaluation of Predictive Validity of the Armed Forces Vocational Aptitude Battery," 7(1):65-68. Whitmore, Elizabeth, s e e Greene, Jennifer C. Wilson, Elizabeth, s e e Pilotta, Joseph, John Murphy and Tricia Jones, "Trends in Community Perception of Social Service Planning," 3(4):80-82. Wholey, Joseph S., "Managing for High Performance: The Role of Evaluation," 6(1 ):40-50; "Using Evaluation to Improve Government Performance," 7(2):5-13. Willeke, Marjorie J. and Robert A. Reineke, "Program Evaluators Foray into Personnal Evaluation," 9(4):45-49.

283 Williams, David D., "Lessons Learned: Introducing Accreditation and Program Evaluation to a Teachers College in Indonesia," 12(1):23-31. Williams, Richard C. and Adrianne Bank,"Evaluation Design Project," 3(1):75-77. Williams, Thomas J., s e e Richards, John D., James A. Taylor, and Daniel J. Muraida, "Surveying Supervisors of Recent Graduates of the Academy of Health Science, U.S. Army," 4(2):65-66; s e e Richards, John D., James A. Taylor, and Patricia F. Dunn, "Summative Evaluation of the Academy of Health Sciences Training Products and Programs," 4(4):54--55; s e e Richards, John D., Daniel J. Muraida, Thomas C. Whitesell, and Curtis T. Johnson, "An Evaluation of Predictive Validity of the Armed Forces Vocational Aptitude Battery," 7(1):65-68. Wills, Kathleen, "A Conversation with Joy Frechtling, Director of Instructional Evaluation and Testing, Montgomery County, Maryland, Public Schools," 8(2):20-30. Wilson, Laura B. and Sharon Simson, "Research and Aging Practice Exchange Networks," 3(4):68-71. Winberg, Alan, Robert Lahey, Gordon Douglas, and Alan Revill, "Managing Program Revies Through Independent Teams: The Evaluation of an Appliance Labeling Program," 7(4):14-22. Winkler, Vera C., s e e Ginsburg, Alan L. Wisler, Carl., "A Conversation with Clifford W. Graves about the Evaluation of Environmental Protection Programs," 12(2):165-174. Wohlstetter, Priscilla, "The Politics of Legislative Evaluations: Fire-Alarm and Police Patrol as Oversight Procedures," 11(1):25-32. Woog, Pierre and Kendall Zeigler, "Evaluation as Bearing Witness," 4(2):78-81. Wortman, Paul M., "Evaluation at the Frontier: Some 'Timely' Comments for Future Use," 5(1):33--44. Wye, Chris, "Role of the Evaluation Function in Federal Government: Introduction," 10(2):24-25. Wynne, Jeffrey D., "San Diego's Untouchables: Redevelopment and the Public Inebriate," 2(3):263-264. Yeaton, William, "Comments on Thomas C. Chalmer's Address: Evaluating Clinical Trials," 5(1):44-46.

284

EVALUATION PRACTICE, 12(3), 1991

Zeigler, Kendall, s e e Woog, Pierre. Zimmer, Richard, "Anthropology and Evaluation," 2(2):135-136. Zimmerman, Nancy R., s e e Gill, Stephen J. Zupek, Williams S., "Making Computerized Program Evaluation Systems Work," 3(2):8081; "Computerized/Automated Evaluation Systems" 2(4):360-364. Zyskowski, Gloria, "Techniques to Consider in Conducting Museum Evaluations," 2(1):6466.

ARTICLE

TITLES

Academic Program Review in a Community College (Wayne K. Stahl), 4(2):62-64. An Action Model for Evaluation Training (H.S. Bhola), 4(2):53-55. Adapting the Self-Anchoring Rating Technique to Mail Questionnaire Form (Ebert L. Miller), 2(4):368-371. Alternative Ethics Reflected in Education and Evaluation (Mary Anne Bunda), 4(1):57-58. Alternatives in Teacher Evaluation (Nick L. Smith), 3(2):90-93. Analyzing Patterns of Small Client Changes with a Microcomputer Spreadsheet (Don Fitz), 9(1):50-58. Another Perspective on the Role of an Internal Evaluator (Carl J. Huberty), 9(4):25-32. Anthropology and Evaluation (Richard Zimmer), 2(2):135-136. Applied Research Consultants (ARC): The Consulting Firm as a Model for Applied Research Training (Jack McKillip), 7(4):37-40. Applying Portfolio Evaluation Concepts to Educational Program Screening (William A. Ternent), 11(3):187-199. Are Planner-Evaluator Jobs Changing? (Harris K. Goldstein and Kriss Hensley), 3(4):76-79. The Arts and Sciences of Program Evaluation (Yvonna Sessions Lincoln), 12(1):1-7. Asking Appropriate Questions Appropriately (Kathryn E. Newcomer), 6(4):16-20. Australian Curriculum Evaluation Projects (Barry J. Fraser), 3(1):71-72. Being "Charles Murrayed" (Ernest R. House), 6(4):21-23.

Benefits of Hindsight: Design Problems in Evaluating Innovation in Medical Education (James K. Skipper, Jr., David J. Pratto, James R. Philip, Martha G. Camp and Dennis R. Hobart), 10(3):7-11. A Brief Introduction to the Standards (Daniel L. Stufflebeam), 2(2):141-144. Calculating the Return on Training Investment (David J. Basarab St.), 11(3):177-185. A Case for Edge Coding: Beyond Process to Economics and Education (Larry L. Neal and Christopher R. Edginton) 2(4):372-374. The Challenge of Being a Profession (Michael Quinn Patton), 11(1):45-51. A Checklist for Developing Questionnaires (Robert W. Covert), 5(3):74-78. Client-Centered Meta-Evaluation (Robert A. Reineke and Wayne W. Welch), 7(3): 16-24. Comment on Needs Assessment Article in EN #2 Reprint (Steve Waterman), 11(2):140-141. Comments on Thomas C. Chalmer's Address: Evaluating Clinical Trials (William Yeaton), 5(1):44-46. Community Needs Assessment: A Strategy and Case Example (Gary L. Bowen), 8(3):5-9. Computerized/Automated Evaluation Systems (William S. Zupek), 2(4):360-364. Constructing Reasonable Expectations in Evaluation (Nick L. Smith), 2(3):265-267. Content Analysis of the Evaluation Studies Review Annual, 1975-1986, (Nick L. Smith and Prachee Mukherjee), 10(4):26-32. A Conversation with John W. Farquhar (Jeni Jerrell), 8(3): 19-30. A Conversation with Joy Frechtling (Kathleen Wills), 8(2):20-30. A Conversation with Clifford W. Graves about the Evaluation of Environmental Protection Programs (Carl Wisler), 12(2):165-174. A Conversation with Dr. Gary T. Henry (Michael Hendricks), 8(4):21-30. A Conversation with Charles A. Kiesler (Debra J. Rog), 9(2):45-52. A Conversation with Richard P. Kusserow (Paul L. Johnson), 11(3):221-230. A Conversation with Ed Meade (William E. Bickel and R. Tony Eichelberger), 9(1):3849. A Conversation with W. Haven North (Michael Hendricks), 8(1):55-63. A Conversation with Michael Wargo (Michael Hendricks), 7(4):23-34.

Cumulative Index

A Conversation with Joseph S. Wholey (Paul L. Johnson), 11(1):53-61. Corporate Foundation Evaluation: The Banking Industry (Kathryn A. Hecht), 5(4):17-21. Cost Effectiveness Studies of Educational Programs: A Checklist (Nick L. Smith), 4(4):4349. Course Evaluation Procedures in Professional Education (Oliver W. Cummings and Alan N. Nowakowski), 5(4):28--32. Data-Driven Educational Leadership (Richard C. Wallace, Jr.), 7(3):5-15. Debate Mandated Experimental Methods (Roberr F. Boruch and Milbrey W. McLaughlin), 3(1):11-30. Designing Useful Evaluations (Stan Drezek), 3(4):63-64. Deus Ex Machina: Personnel Evaluation Made Public (Ernest R. House), 6(3):21-24. Development of Evaluation Research Society Standards for Program Evaluation (Keith Marvin), 2(2):179-182. Discussion on Assessment in Higher Education (L.A. Braskamp), 10(4):51-56. Documentation as Evaluation: Capturing Context, Process, Obstacles, and Success (Terry A. Clark), 9(1):21-31. Documenting the Catalytic Effect of Rehabilitation Programs for Deinstitutionalized Individuals (Cathy Lorber), 2(4):364-368. "Doing" Evaluation -- A Student's Perspective (John C. Ory and Sandra C. Leister), 8(3): 1214. Do's and Dont's for Offering Effective Recommendations (Michael Hendricks and Meredith Papagiannis), 11(2):121-125. Drawing Evaluative Conclusions (Ernest R. House), 7(3):35-39. Education in the Fast Lane: Methodological Problems of Evaluating Its Effects (Julian C. Stanley), 4(1):28-46. Educational Impacts of Sponsored R&D (David J. Bowering), 3(1):69-70. Effects of Using a Microcomputer System for Field Audits and Other Investigations of the Offices of Inspector General (Robert W. Lissitz), 6 (2):55-58. Estimating the Outcome of Screening Programs: A Role for Evaluation (Richard J. Light), 8(1):50-54.

285 Ethics in Evaluation: Beyond the Standards (Robert W. Covert), 9(I):32-37. Evaluating an Employee Assistance Program (Donald W. Myers), 5(4):40-43. Evaluating an Old Friend: One Evaluator's View of the Changing Role of Program Evaluator in Chapter One (Sharon F. RaUis), 9(2):2530. Evaluating Microcomputer-Based Training (Robert W. Hotes), 5(4):47-50. Evaluating Nebraska's Nutrition Education and Training Program (Robert G. St. Pierre, Thomas D. Cook, and Robert B. Straw), 3(1):67-69. Evaluating Nursing Education (William Holzemer), 2(3):261-263. Evaluating Professionals (Ernest R. House), 6(1):65-67. Evaluating the FBI: A Response to Sonnichsen (Ernest R. House), 9(3):43--46. Evaluation as Bearing Witness (Pierre Woog and Kendall Zeigler), 4(2):78-81. The Evaluation Audit (Ernest R. House), 8(2):5256. Evaluation and Government Relations: Are We Doing Enough? (Jerry Cahn), 3(1):78--84. An Evaluation Approach to Training Using the Notion of Form: An Australian Example (John M. Owen), 12(2):131-137. Evaluation and Health Care Delivery: Where Do We Go From Here? (Tara Davis Knott), 2(4):357-359. Evaluation and the Management Process (Daniel B. Muscatello), 10(3):12-17. Evaluation at the Federal Level (Leonard Rutman), 7(2):14-18. Evaluation at the Frontier: Some 'Timely' Comments for Future Use (Paul M. Wortman), 5(1):33--44. Evaluation Design Project (Adrianne Bank and Richard C. Williams), 3(1):75-77. Evaluation During Fiscal Stringency (William R. Shadish, Jr.) 3(3):89-91. Evaluation Experience in Business Settings (Jeanette M. Jerrell), 5(4):15-17. Evaluation for Decisions: Is Anybody There? Does Anybody Care? (Carol H. Weiss), 9(1):5-19. Evaluation Improvement Strategies at the U.S. Office of Education (Alan L. Ginsburg and Vera C. Winkler), 10(2):40--47. Evaluation in Australia (Ernest R. House), 5(4):13-14.

286 Evaluation in Canada (Michael Rayner), 7(1):4556. Evaluation in Higher Education: Selling Life Insurance and Being an Evaluator (Larry A. Braskamp), 2(1):67--69. Evaluation in the Hospitality Industry (Tara Davis Knott), 5(4):26-27. Evaluation in the U.S. Department of Housing and Urban Development, 1980-1988, (David B. Rymph), 10(2):30-39. An Evaluation Model for the Development of Technical Training Programs (James W. Altschuld, Phyllis M. Thomas, and Wendy H. McColskey), 5(4):33-37. An Evaluation of a Helicopter Pilot Ground Training System (Robert W. Hotes), 4(2):6162. Evaluation of an Ambulatory Care Classification Systems (John D. Richards, Sue A. Akins, James M. Georgoulakis, David R. Bolling, Velda Austin, Cherry L. Gaffney, and Atanacid C. Guillen), 11(3):201-205. Evaluation of Computer Software Products (Wellesley R. Foshay), 5(4):50-54. Evaluation of Consumer Satisfaction with Information Derived from Neuropsychological Assessment (Ralph H.B. Benedict and Arthur MacNeill Horton, Jr.), 12(1):33-38. Evaluation of Instructor Performance (Valerie Dhanens), 5(4):37-40. Evaluation of Nutrition Education and Training Program Workshops (Cynthia Roberts-Gray, Linda Fox Simmons, and Alexa Sparkman), 8(3):10-11. Evaluation of One Component of CompetencyBased Teacher Education in Oklahoma (George W. Garrett), 4(4):52-54. Evaluation of Residential Programs for the Elderly (R. Fernandez-Ballesteros, M. Izal, I Montorio, M. G. Llorente, J. M. Hernandez, and M. A. Guerrero), 12(2):159-164. The Evaluation of Teaching in Medical Schools (Robert M. Rippey), 2(4):321-322. An Evaluation of the American Red Cross Nutrition Course (Patricia K. Edwards), 6(2):5254. An Evaluation of the Predictive Validity of the Armed Forces Vocational Aptitude Battery (John D. Richards, Daniel J. Muraida, Thomas C. Whitesell, Thomas J. Williams and Curtis T. Johnson), 7(1):65-68. An Evaluation of U.S. Air Force Pilot Support Centers (Gary L. Bowen), 4(4):56-57.

EVALUATION PRACTICE, 12(3), 1991 Evaluation Research as an Integral Part of Pittsburgh's In-Service Staff Development Center (Stanley E. Denton and Paul G. LeMahieu), 6(3):45-50. Evaluation: Status of a Loose Coalition (Jonathan A. Morell), 11(3):213-219. Evaluation, the Arts, and Cultural Policy (Richard Swaim), 2(2):137-139. Evaluation Units in State Departments of Education: A Five-Year Update (Nick L. Smith), 5(3):37-44. Evaluative Applications of Meta- and MegaAnalysis (Nick L. Smith), 3(4):43-47. Evaluative Decisions Under Conflicting Constraints (Stuart S. Nagel), 9(2):36-39. Evaluators as Applied Theorists (Charles McClintock), 11(1):1-12. The Evaluator's Journal: A Qualitative Supplement to Program Evaluation (Joseph Caliguri),

5(4):54-58. Evaluators, Libs, and Neocons (Ernest R. House), 8(1):64-67. The Evaluator's Responsibility for Utilization (Michael Quinn Patton), 9(2): 5-24. Explanation of the Evaluation Design Project (Adrianne Bank), 2(1):73-75. Factional Disputes in Evaluation: In House Reflections (Ernest R. House), 5(3):19-21. Federal Evaluation: The Pendulum Has Swung Too Far (Eleanor Chelimski, David Cordray and Lois-ellin Datta), 10(2):25-30. Focus Groups: A Starting Point for Needs Assessment (Joan L. Buttram), 11(3):207-212. A Form for Evaluating Survey Instruments (Denis R. Oliver, Joseph E. Conboy, and William J. Donahue), 6(2) :15-18. Formative Evaluation of Desegregation Assistance (Jeri Benson and Myron Dembo), 3(1):73-75. Formative Evaluation of Textbooks (Robert A. McMillan), 2(4):343-349. Formatting Questionnaires for Computer Data Entry (Judith A. Boser), 6(2):18-21. Further Comments on Implementation (Alexander M. Mood), 9(4):69-71. General Criteria for Evaluating Social Program (Stephanie Shipman), 10(1):20-26. General School Behavior (Andrea Mar Seewald and Gaea Leinhardt), 6(3):72-73. Generalized Evaluation Design (D. Royce Sadler), 3(3):80-86.

Cumulative Index Getting Mileage Out of One Naturalistic Inquiry (Sue Ford), 8(4):12-20. Going Independent: A Personal Viewpoint (Kathryn A. Hecht), 3(2):66-71. The Good News and the Bad News about Product Evaluation (Michael Scriven), 2(3):278-282. Good Organizational Reasons for Bad Evaluation Research (Michael Hennessy and Michael J. Sullivan), 10(4):41-50. A Hands-On Approach to Teaching Program Evaluation (Kathryn E. Newcomer), 6(3):7779. Having Students Conduct Evaluations: Merging Field Experience and Academic Learning (Jennie J. Kronenfeld), 2(4):375-378. How I Learned to Love "The Standards" (David A. Payne), 9(4):37-44. How Much Evaluator Time Is Spent Working With Program Staff? (Alan L. Roecks) 4(2):69. How Sharp Should the Evaluator's Teeth Be? (Robert E. Stake), 3(3):79-80. Hypertext: What It Is and How to Use It to Analyze Data (Valorie Beer and Anne Marie S. Jensen), 12(3):193-203. If Program Decisions Hinged Only on Information: A Response to Patton (Carol H. Weiss), 9(3):15-28. Improving the Return Rate of Final Conference Evaluations with Mailed Questionnaires (Rita G. O'Sullivan), 9(4):50-55. Improving Services Through Effective Practice Reviews (Michael Mangano), 12(3):217-222 Individualized Classroom Environment Questionnaire (Barry J. Fraser), 3(2):72-73. Information Processing and Data Reduction: Defining the Content Domain for the Uniform National Licensure Exam in Landscape Architecture (William Scarbrough, Risa Gressard, James Tiller, and Douglas Brackett), 6(3):51-55. Instruments for Measuring Outcomes in Mental Health Program Evaluation: Results of a Survey (David Clifford), 2(1): 54-58. The Interaction of Politics and Evaluation (Terry E. Hendrick), 9(3):5-14. Internal Evaluation (Ernest R. House), 7(1):6364. An Internal Evaluator Responds to Ernest House's Views on Internal Evaluation (Richard C. Sonnichsen), 8(4):34-36.

287 The International Context for Research on Evaluation (David Nevo), 3(4):73-75. An International Perspective on Assessing Baccalaureate Program Outcomes (Trudy W. Banta and Homer S. Fisher), 11(3): 167-175. An Interview with Gerald L. Barkdoll (Douglas Sporn), 10(1):27-32. An Interview with Jeff Schiller (Tony Eichelberger), 7(3):25-34. An Interview with Michael Hendricks (Douglas L. Sporn), 10(3):18-24. An Interview with Richard C. Sonnichsen (Douglas L. Sporn), 10(2):63-67. Introducing a Modified Nominal Group Technique for Issue Identification (Lois J. Pokorny, Kenneth Lyle, Margaret Tyler, and James Topolski), 9(2):40-44. The Iran-Contra Hearings and Evaluation (Ernest R. House), 8(4):31-33. Issues in Designing Evaluation of Patients' Rights Protection Systems for Public Psychiatric Hospitals (Arnold L. Greenfield), 2(4):353356. Journals that Publish Work of Interest to Evaluators (William R. Shadish, Jr. and Charles S. Reichardt), 9(3):29-34. Kemetic (Egyptian) Historical Revision: Implications for Cross-Cultural Evaluation and Research in Education (Asa G. Hilliard III), 10(2):7-23. Learning and Teaching Others Practical Evaluation Skills: Learning Practical Evaluation "On the Job" (Rolf H. Sartorius), 10(2):4854. Lessons Learned: Introducing Accreditation and Program Evaluations to a Teachers College in Indonesia (David D. Williams), 12(1):2331. The Location of Subsidized Housing (Tom Vitek), 2(1):70-72. The Logical Framework Approach to Project Design and Management: Enter the Mainstream (Roif H. Sartorius), 12(2):139-147. Looking at Levels of Use as Program Evaluation Tool (Alan L. Roecks and Paul N. Casper), 4(3):68-71. Making Computerized Program Evaluation Systems Work (William S. Zupek), 3(2):80--81.

288 Managing for High Performance: The Role of Evaluation (Joseph S. Wholey), 6(1):40-50. Managing Program Reviews Through Independent Teams: The Evaluation of an Appliance Labeling Program (Alan Winberg, Robert Lahey, Gordon Douglas and Alan Revill), 7(4):14-22. Marketing Evaluation Skills and Services (Joanne Capper), 4(2):57-60. Mediation Evaluation: Status Report and Challenges for the Future (Hugh O'Doherty and the Faculty Consortium on Dispute Resolution Research), 10(4):8--19. Medical Rehabilitation: Issues in Assessment of Functional Change (Emily Bonwich and John C. Reid), 12(3):205-215. Mental Health Evaluation in Rural Areas (Harris K. Goldstein), 2(3):260-261. Methods for the Experimenting Society-Reprint (Donald T. Campbell), 12(3):223-260. Microcomputer Training Impact Study (Oliver W. Cummings and Alan N. Nowakowski), 5(4):43-47. Moral Issues in the Conduct of Mental Health Evaluation (Karen E. Kirkhart), 4(1):50-53. Moral Problems in Evaluation Practice (Nick L. Smith), 4(1):48-50. National Consortium Monitoring System for Child Care Activities (Richard Fiene), 3(1):72-73. Needs Assessment...--Reprint (Michael Scriven), 11(2):144. Needs and the Needs Assessment Process-Reprint (Jane Roth), 11(2):141-143. New Frontiers of Evaluation (Michael Scriven), 7(1):7--44. A Note on the Potential for Bias in the Structure and Wording of Questionnaire Items (Zita M. Cantwell), 6(2):9-15. On Evaluating Professionals in Higher Education (Larry A. Braskamp and James D. Raths), 3(2):85-90. Opportunities for Evaluation in the Next Few Years (Thomas D. Cook), 5(2):20-46. Optimizing Evaluation Use (Ellen M. Pechman), 3(4):64-67. Our Class and Its Work Questionnaire (Maurice J. Eash and Hersholt C. Waxman), 4(2):6768.

EVALUATION PRACTICE, 12(3), 1991 The Participation of Cultural Informants in Bilingual and Cross-Cultural Evaluation Teams (Helen B. Slaughter), 12(2):149-157. Patients' Rights Violations: Can Interviews Overcome Them? (Arnold L. Greenfield), 3(2):8184. PE Is Coming to VR! (Harriett S. Beury), 2(4):350-352. P/G% Analysis: An Evaluation Aid (Stuart S. Nagel), 6(2):21-24. Physician Heal Thyself: One Public Manager's View of Program Evaluation (Hale Champion), 6(1):29-40. Planning Program Evaluation to Meet Management Information Needs (Kathy Akpom), 7(4):35-37. Policy Evaluation for Policy Communities: Confronting the Utilization Problem (Jerry Mitchell), 11(2):109-114. The Politics of Legislative Evaluations: FireAlarm and Police Patrol as Oversight Procedures (Priscilla Wohlstetter), 11(1):25-32. The Politics of Verifying Trustworthiness in Evaluation Auditing (Thomas A. Schwandt), 10(4):33-40. The Power of Negative Thinking (James Raths), 8(2):5-19. Practice and Malpractice in Evaluation Research (Mark W. Lipsey), 9(4):5-24. Practicing What You Preach (William A. McConnell), 3(1):64-66. Preparing and Using Briefing Charts (Michael Hendricks), 5(3):78-82. Program Evaluation in Rehabilitation (Cathy Lorber and James S. Lundstrom), 2(1):5861. Excerpts from: "Program Evaluation, Particularly Responsive Evaluations" - Reprint (Robert E. Stake), 12(1):63-76. Program Evaluation under the 1980 Mental Health System Act (Karen E. Kirkhart), 2(1):79-84. Program Evaluators Foray into Personnel Evaluation (Marjorie J. Willeke and Robert A. Reineke), 9(4):45-49. Program Review, Accreditation Processes, and Outcomes Assessment: Pressures on Institutions of Higher Education (Yvonna S. Lincoln), 11(1):13-23. Pros and Cons about Goal-Free Evaluation-Reprint (Michael Scriven), 12(1):55-63. Public Data Resources for Educational Policy Analysis (Nick L. Smith), 4(3):65-68.

Cumulative Index

Public Relations for Evaluation (Timothy C. Brock), 7(1):57-62. Pussycats, Weasels or Percherons? Current Prospects for Social Science Under the Reagan Regime (Peter H. Rossi), 4(1):12-27. Racial/Ethnic and Gender Bias in the Courts: A Stakeholder-Focused Evaluation (Stephen J. Gill and Nancy R. Zimmerman), 11(2):103108. Ray Rist Talks about the IIAS Working Group on Policy and Program Evaluation (Paul L. Johnson), 12(1):45-53. Reflections on Writing a Clear Evaluation Summary (Charles B. Stalford), 6(4):10-16. Reporting to the Busy Decision Maker (Yvette Stallworth and Cynthia Roberts-Gray), 8(2):31-35. Research and Aging Practice Exchange Networks (Laura B. Wilson and Sharon Simson), 3(4):68-71. The Research Manager's Role in Encouraging Evaluation Use (Anthony Dibella), 11(2): 115119. Response to Ernest House (Charles Murray), 6(3):25-27. A Review of Comprehensive Examinations in Selected Evaluation Training Programs (Diane M. Hauer and Elisa J. Slee), 10(4):2025. A Review of Progress in Educational Evaluation (Daniel L. Stufflebeam), 3(2): 15-27. Role of the Evaluation Function in Federal Government: Introduction (Chris Wye), 10(2):2425. Ron Carlson and James Bell Discuss the Challenges Facing Health Evaluators in the 1990s (Paul L. Johnson), 11(2):127-133. San Diego's Untouchables: Redevelopment and the Public Inebriate (Jeffrey D. Wynne), 2(3):263-264. Serious Product Evaluation - Some Field Notes (Michael S. Scriven), 3(1):89-94. Serving Management and Accountability: A Conflict for Program Evaluation? (Leonard Rutman), 11(1):39-43. Setting Standards for Educational Evaluators (Robert E. Stake), 2(4):148-152. Should Evaluators Address the Morality of Public Programs? (Michael Hendricks), 4(1):5456.

289 The Social Experiment and the Future of Evaluative R e s e a r c h - R e p r i n t (Edward A. Suchman), 11(3):251-259. Some Final Words on the Outcome Side of CECO (Rex S. Green), 3(2):74-79. Some Trends in Policy Evaluation Research (Stuart S. Nagel), 4(2):70-77. Special Feature: Needs Assessment--Reprint (Michael Striven and Jane Roth), 11(2): 135140. Stakeholder Involvement in Evaluation: Suggestions for Practice (Robert A. Reineke), 12(1):39-44. The Standards: A Federal Level Perspective (Michael J. Wargo), 2(2):157-162. TheStandards: A General Review (Lee Sechrest), 2(2):145-148. The Standards: Applicability Outside the United States (Barbara Searle), 2(2):176-178. The Standards: A Rural School Perspective (Kathryn A. Hecht), 2(2):169-171. Standards in Mental Health Evaluation: Variance is the Spice of Life (Ray Lyons and Bill Rubin), 2(2):183-187. The Standards: A State Level Perspective (Joan Boykoff Baron), 2(2):163-166. The Standards: An Urban School District Perspective (Steven J. Osterlind), 2(2): 166-168. Standards for Evaluating Out-of-School Learning (Marcia C. Linn), 2(2):171-176. The Standards: Implications for Professional Licensure and Accreditation (Heather Becker and Karen Kirkhart), 2(2):153-156. Strategies for Qualitative Data Analysis (Jennifer C. Greene, J. Lin Compton, Elizabeth Whitmore, and Harry Sappington), 8(4):511. The Structured Group Interview as an Evaluation Technique (Carol M. Richman and Jean Gasen Romaniuk), 4(4):58--60. Style Versus Substance in Evaluation Reports (Kathleen Bodisch Lynch), 7(4):75-76. Success Factors for Evaluation in a Business Training Context (Oliver W. Cummings), 7(4):5-13. Summative Evaluation of the Academy of Health Sciences Training Products and Programs (John D. Richards, James A. Taylor, Thomas J. Williams and Patricia F. Dunn), 4(4):5455. Superanalysis (James T. Dillon), 3(4):35-43.

290 Survey of Journals Publishing Evaluation Research (Robin S. Turpin, Nick L. Smith and Laurie A. Darcy), 8(2):10-19. A Survey of Program Evaluation in University Affiliated Programs (Mit Arnold and Nikki Craft), 9(2):31-35. A Survey of Program Evaluators in Community Mental Health Centers in Tennessee (Ted W. Jones and Roger L. Cole), 5(3):45--49. Surveying Supervisors of Recent Graduates of the Academy of Health Sciences, U.S. Army (John D. Richards, James A. Taylor, Thomas J. Williams and Daniel J. Muraida), 4(2):6566. Teaching Evaluation Through Paid Contractual Arrangements (J. Nicholls Eastmond, Jr., William Saunders and Duane Merrell), 10(2):58-62. Teaching Evaluation Through the Practicum Experience (David P. Moxley and R.J. Visingardi), 10(2):54-58. Teaching Students How to Evaluate and Improve Elementary and Secondary Teaching (Joseph P. Caliguri), 4(2):55-56. Techniques to Consider in Conducting Museum Evaluations (Gloria Zyskowski), 2(1):64--66. Thoughts on Contracting with Small School Districts (Steven E. Keleman) 2(1):62-64. Trends in Community Perception of Social Service Planning (Joseph Pilotta, John Murphy, Tricia Jones and Elizabeth Wilson), 3(4):8082. The Two Cultures and the Evaluation Evolution (Robert E. Stake), 3(2):10-14. Two Observations (Robert E. Stake), 4(3):7274. Undisciplined Social Science (Ernest R. House), 6(2):28-31. Unintended Effects of Program Evaluation (Wayne W. Welch and Fred Sternhagen), 12(2):121-129.

EVALUATION PRACTICE, 12(3), 1991 Unraveling CECO Mysteries: More on Outcomes (Rex S. Green), 2(3):251-259. The Use of Role Play in Instrument Development (Elizabeth G. Serow), 9(4):33-36. Use of the Joint Committee Standards: Benefits Gained and Lessons Learned (Christine A. Ameen), 11(1):33-38. Using Evaluation to Improve Government Performance (Joseph S. Wholey), 7(2):5-13. Using the Media to Disseminate Evaluation Results (Michael Mangano), 12(2): 115-120. Using the Nominal Group Technique in Formative Evaluation (Louise Lapine), 8(3): 15-18. Using Photographs in an Evaluation Report (Wei Li Fang), 6(2):24-27. Validation of a Revised Curriculum: A Formative Evaluation (Katherine K. Bruning and Barbara J. Garvin), 5(4):21-25. Value Added and the Evaluator (Dwight Harshbarger), 5(1):20-33. A Way to Empirically Analyze Kompetence: A Model for Faculty Evaluation (Timothy J. Schrock), 4(2):82--85. The "Weight and Sum" Methodology (Michael Scriven), 2(1):85-90. The Weiss-Patton Debate: Illumination of Fundamental Concerns (Nick L. Smith and Saviour Chircop), 10(1):5-13. What Have We Learned about Naturalistic Evaluation? (Egon G. Guba), 8(1):23--43. What Have We Learned about Randomized Social Experiments Over the Last Decade? (Robert Boruch), 8(1):44--49. What Have We Learned about the Politics of Program Evaluation? (Eleanor Chelimski), 8(1):5-22. When Democratic Evaluation Doesn't Seem So Democratic (Robin McTaggart), 12(1):9-21. Whither Evaluation: The Role of Federal Sponsorship (Jennie Kronenfeld), 3(3):87-88. Who Should the Meta-Evaluator Bite? (Robert A. Reineke), 5(1):77-79.