Evaluation of an Evaluation in a Manufacturing Organization: A Summative Metaevaluation

By Liliana Rodríguez-Campos, Connie Walker-Egea and Nakia James.

Published by The Organization Collection

Format Price
Article: Print $US10.00
Article: Electronic $US5.00

Metaevaluations, evaluation of evaluations, are in professional interests to ensure evaluation practices continue to improve. The purpose of this metaevaluation was to make a judgment based on defensible criteria, about sound and accountable contributions of an evaluation in a manufacturing private organization, and to increase efforts to systematize future evaluation endeavors. This metaevaluation focused on the following five questions (Rodríguez-Campos, 2004): (1) What is the nature of the evaluation? (2) To what extent is the evaluation technically sound? (3) To what extent is the evaluation useful? (4) To what extent did the evaluation employ ethical procedures? and (5) To what extent were the evaluation methods practical? The authors used Stufflebeam’s program evaluation checklists keyed to the Joint Committee’s Program Evaluation Standards (Stufflebeam & Shinkfield, 2007). Conclusions and implications are presented based on the analysis of this evaluation.

Keywords: Checklists, Evaluation, Metaevaluation

The International Journal of Knowledge, Culture and Change Management, Volume 7, Issue 10, pp.17-30. Article: Print (Spiral Bound). Article: Electronic (PDF File; 1.135MB).

Liliana Rodríguez-Campos

Faculty Member, Department of Educational Leadership, Research, and Technology, University of South Florida, Kalamazoo, FL, USA

Liliana Rodríguez-Campos earned her Ph.D. in Evaluation, Measurement, and Research Design. She received an Outstanding Dissertation Award, and a Provost’s Special Recognition for this Ph.D. Also, as part of her educational background, she earned her Bachelor's in Systems Engineering with Honorific Mention, and her Specialist and Master's degrees in Project Management in Engineering with Summa Cum Laude Honors. Furthermore, she received a President's Special Recognition for her second Master's degree in Educational Leadership with a concentration in Evaluation, Measurement, and Research Design. Rodríguez has been awarded with several honors and educational scholarships at the national and international levels. Her peers have recognized her professional qualifications through invitations to her to make presentations and serve in national and international leadership roles in evaluation. She has been a planning and control manager, and a consultant in the private sector, non-profit organizations as well as institutions of higher education. Rodríguez's work history includes evaluations/metaevaluations in multi-national corporations and capacity-building projects in Latin America, the Philippines, and the United States. Rodríguez has designed and delivered numerous workshops and courses at the university level in evaluation/metaevaluation, research, informatics, consulting, project planning, and control management. She has written a variety of publications in Spanish, English, and Chinese on leadership, organizational engineering, and evaluation approaches that bring stakeholder groups together For example, she is the author of the book Collaborative Evaluations: A Step-by-Step Model for the Evaluator. In addition, she has presented her work in national and international conferences in countries such as Australia, Canada, China, England, Greece, Holland, India, Italy, Jamaica, Malaysia, Singapore, South Africa, Spain, the United States, and Venezuela. Rodríguez is a member of several professional associations such as Project Management Institute, American Evaluation Association, Michigan Association for Evaluation, and American Educational Research Association, among others. During five years, she served as a co-chair of the Professional Development Committee and as a board member at the Michigan Association for Evaluation. Currently, she serves as the board of directors’ chair at the Evaluation Capacity Development Group and as the program chair of the Collaboration, Participatory, and Empowerment Evaluation Topical Interest Group at the American Evaluation Association. Rodríguez’s expertise with leadership, metaevaluation, multi-cultural and collaborative evaluation capacity building, project management, organizational engineering, and training are her strongest professional contributions.

Connie Walker-Egea

Director Health and Human Services Programs, Momentum Evaluations, L.L.P., Battle Creek, MI, USA

Connie Walker-Egea currently serves as the Director of Health and Human Services Programs for Momentum Evaluations. She is also completing a Ph.D. in Evaluation, Measurement and Research at Western Michigan University. She earned a Master degree in Education in Family Ecology and Nutrition with Summa Cum Laude honors at the University of Puerto Rico, Río Piedras Campus. Her educational background also includes a Bachelor degree in Nutrition and Dietetic, Cum Laude. Moreover, she has been awarded with the Clotilde Olivencia Scholarship given by the College of Nutritionists and Dietitians of Puerto Rico for her excellent academic performance during her master degree. Ms. Walker is a Licensed Dietitian and member of the College of Nutritionists and Dietitians of Puerto Rico, and a Registered Dietitian and member of the American Dietetic Association. In addition, she is a member of the American Evaluation Association. She has worked with the Head Start Program in Puerto Rico and in private and public hospitals as a dietitian. She also offers her services as a volunteer for Servicios Integrados en Educación e Investigación, a non-profit organization that provides services to children with autism and other related diseases. Ms. Walker has written different publications in Spanish for Equilibrium, the publication of the College of Nutritionists and Dietitians of Puerto Rico, the journal Analysis (in Spanish Análisis), and for the electronic newsletter of the Educational Research and Evaluation Program of the University of Puerto Rico (Ineva in Action). In addition, she is part of the editorial group in charge of publishing this newsletter. Furthermore, has also offered workshops and presented conferences about different topics for dietitians and dietetic students as well.

Nakia James

Director of Youth and Education Programs, Momentum Evaluations, L.L.P., Battle Creek, MI, USA

Mrs. Nakia James currently serves as the Managing Partner and Director of Youth and Education Programs for Momentum Evaluations L.L.P. Mrs. James has achieved a Master’s Degree in Educational Leadership, with a focus in Organizational Analysis from Western Michigan University. With this, she has chosen to concentrate her academic and professional pursuits in the practice of evaluation. Mrs. James has also attained a Bachelor’s Degree from Western Michigan University with a concentration in education. Upon completion, Nakia began her professional experience in the area of education. This experience was centered in the edification of students considered to be “at risk”, primarily in the areas of music education and reading literacy and competency. She was a positive influence to her students and continues to be an encouraging advocate to many of them. Subsequently, Mrs. James has thoroughly enjoyed her experience in education as a profession, and intends to continue serving others in the practice of evaluation. Recently, Nakia has received several honors, including induction to the National Scholars Honors Society. Through both her academic and professional pursuits, she has had the opportunity to meet and become acquainted with some of the area’s most influential and dynamic leaders. Accordingly, this has opened many doors leading to her current success and future professional opportunities. Nakia was selected to present at the American Evaluation Association 2007 Annual Conference, on a formative program evaluation. She also served as the chairperson for the Collaborative, Participatory, and Empowerment Topical Interest Group Multipaper session at the American Evaluation Association 2007 Annual Conference. Nakia was also a recent delegate and metaevaluation co-author at the 7th International Conference on Knowledge, Culture, and Change in Organizations held at the Singapore Management University. Subsequently, she co-authored a corresponding article which is being published in The International Journal of Knowledge, Culture, and Change Management. She is currently working on additional publications in both evaluation and education and continues to strive to enhance her professional knowledge and skills.


There are currently no reviews of this product.

Write a Review