Metaevaluation of an International Agricultural Technology Training Program
The evaluation of an evaluation, a metaevaluation, is conducted to assess the utility, feasibility, propriety, and accuracy standards addressed by the evaluation. The purpose of this metaevaluation was to obtain and apply descriptive and judgmental information of a program evaluation designed to provide training in agricultural technology. The following five questions guided this metaevaluation (Rodríguez-Campos, 2004): (1) What is the nature of the evaluation? (2) To what extent is the evaluation technically sound? (3) To what extent is the evaluation useful? (4) To what extent did the evaluation employ ethical procedures? and (5) To what extent were the evaluation methods practical? The Metaevaluation Checklist for Evaluating Evaluations against the Program Evaluation Standards (Stufflebeam, 1999) was used by the authors.
||Evaluation, Evaluation Standards, Metaevaluation, Metaevaluation Checklists
International Journal of Knowledge, Culture and Change Management, Volume 8, Issue 10, pp.105-114.
Article: Print (Spiral Bound).
Article: Electronic (PDF File; 877.581KB).
Faculty Member, Department of Educational Measurement and Research, University of South Florida, Tampa, FL, USA
Dr. Liliana Rodríguez-Campos earned her Ph.D. in Evaluation, Measurement, and Research Design. She received an Outstanding Dissertation Award, and a Provost’s Special Recognition for this Ph.D. Also, as part of her educational background, she earned her Bachelor’s in Systems Engineering with Honorific Mention, and her Specialist and Master’s degrees in Project Management in Engineering with Summa Cum Laude Honors. Furthermore, she received a President’s Special Recognition for her second Master’s degree in Educational Leadership with a concentration in Evaluation, Measurement, and Research Design.
Dr. Rodríguez has been awarded with several honors and educational scholarships at the national and international levels. For example, in 2007 she received the American Evaluation Association’s Marcia Guttentag Award for a promising evaluator within five years of completing her Doctoral degree and whose work is consistent with the Guiding Principles for Evaluators (http://youtube.com/watch?v=r9d-LVmrTJo). Also, in 2008 she was awarded a Faculty Fellowship from the American Association of Hispanics in Higher Education (AAHHE). Her peers have recognized her professional qualifications through invitations to her to make presentations and serve in national and international leadership roles in evaluation. She has been a planning and control manager, and a consultant in the private sector, non-profit organizations as well as institutions of higher education. Her work history includes evaluations/metaevaluations in multi-national corporations and capacity-building projects in Latin America, the Philippines, and the United States. Dr. Rodríguez has designed and delivered numerous workshops and courses at the university level in evaluation/metaevaluation, research, informatics, consulting, project planning, and control management. She has written a variety of publications in Spanish, English, and Chinese on leadership, organizational engineering, and evaluation approaches that bring stakeholder groups together. For example, she is the author of the book Collaborative Evaluations: A Step-by-Step Model for the Evaluator. In addition, she has presented her work in national and international conferences in countries such as Australia, Canada, China, England, Greece, Holland, India, Italy, Jamaica, Malaysia, Singapore, South Africa, Spain, the United States, and Venezuela.
Dr. Rodríguez is a faculty member in the Department of Educational Measurement and Research at the University of South Florida. She is a member of several professional associations such as Project Management Institute, American Evaluation Association, Michigan Association for Evaluation, and American Educational Research Association, among others. During five years, she served as a co-chair of the Professional Development Committee and as a board member at the Michigan Association for Evaluation. Currently, she serves as the board of directors’ chair at the Evaluation Capacity Development Group and as the program chair of the Collaboration, Participatory, and Empowerment Evaluation Topical Interest Group of the American Evaluation Association. Rodríguez’s expertise with leadership, metaevaluation, multi-cultural and collaborative evaluation capacity building, project management, organizational engineering, and training are her strongest professional contributions.
Program Director, MDC, Inc., North Carolina, Chapel Hill, USA
Rigoberto Rincones earned his Ph.D. in Evaluation, Measurement, and Research Design at Western Michigan University (WMU). He received an Outstanding Dissertation Award and a WMU Provost’s Special Recognition for his doctoral work. He earned his Bachelor’s Degree in Mechanical Engineering, and his Specialist and Master’s degrees in Project Management in Engineering with Summa Cum Laude Honors. He received a WMU President’s Special Recognition for his second Master’s degree in Educational Leadership with a concentration in Evaluation, Measurement, and Research Design. Dr. Rincones has been awarded with several honors and educational scholarships both in Latin America and the United States. He has been a training manager and a consultant in the private sector, non-profit organizations as well as in institutions of higher education. His work history includes formative evaluation of multi-national corporations and evaluation capacity-building in Latin America, the Philippines, and the United States. Dr. Rincones has designed and delivered numerous workshops and taught courses at the university level in evaluation, research, project management, and assessment. He has authored a variety of publications in Spanish and in English on leadership, organizational engineering, and evaluation approaches that bring stakeholder groups together. He has presented his work in national and international conferences in countries such as Australia, Canada, China, England, Greece, Holland, Italy, Malaysia, Singapore, South Africa, Spain, the United States, and Venezuela.
Dr. Rincones has served as Vice-President of the Michigan Association for Evaluation (MAE); Vice-Chair of the Michigan Association of Institutional Research (MI/AIR); Member of the Michigan Community College Data and Evaluation Committee (MCCDEC); Board Member at Large of the Institute of Higher Education C2IR LearnNet (University of Florida); and contributor to the Association for Institutional Research (AIR) Forum’s Track #6 (The Practice of Institutional Research: Theory, Techniques, Technologies, Tools, and Ethics). During his appointment as the Director of Institutional Research and Assessment at Lake Michigan College, Dr. Rincones led several college-wide initiatives. He also facilitated and supervised the production of all college quantitative and qualitative research data, projects, reports, and publications on measurements of student success and institutional effectiveness.
Currently Dr. Rincones works as Program Director at MDC, Inc. where he leads the data facilitation component for the Achieving the Dream: Community Colleges Count initiative and guides the work of a cadre of 33 data facilitators in 83 Institutions of Higher Education across 15 US States. Achieving the Dream is a student-centered, data-driven, outcome oriented, and multiyear national initiative to help more community college students succeed (earn degrees, earn certificates or transfer to other institutions to continue their studies). He also works in partnership with the Institute of Higher Education at the University of Florida to train data facilitators and serves as a data facilitator himself. He is responsible for drawing lessons learned from the data facilitators’ experiences and working with a national team of Achieving the Dream partners to develop strategies to spread Achieving the Dream policies and practices.
Department of Educational Measurement and Research, University of South Florida, Tampa, FL, USA
Connie Walker-Egea is completing a Ph.D. in Educational Measurement and Evaluation at the University of South Florida. She earned a Master’s degree in Education in Family Ecology and Nutrition with Summa Cum Laude honors at the University of Puerto Rico, Río Piedras Campus. She also earned a second Master’s degree in Evaluation, Measurement, and Research at Western Michigan University. Her educational background also includes a Bachelor degree in Nutrition and Dietetic, Cum Laude. Moreover, she has been awarded with the Clotilde Olivencia Scholarship given by the College of Nutritionists and Dietitians of Puerto Rico for her excellent academic performance during her master degree. In addition, she has received several honors, including the induction in the University of Puerto Rico National Home Economic Honor Society and the Western Michigan University’s Alpha Kappa Mu National Honor Society. She served as the Director of Health and Human Services Programs for Momentum Evaluations, L.L.P. Ms. Walker is a Licensed Dietitian and member of the College of Nutritionists and Dietitians of Puerto Rico, and a Registered Dietitian and member of the American Dietetic Association. In addition, she is a member of the American Evaluation Association, Ms. Walker has written different publications in Spanish and English for the International Journal of Knowledge, Culture, and Change Management, for Equilibrium, the publication of the College of Nutritionists and Dietitians of Puerto Rico, the journal Análisis (Spanish for Analysis), and for the electronic newsletter of the Educational Research and Evaluation Program of the University of Puerto Rico (INEVA en Acción). In addition, she is part of the editorial group in charge of publishing this newsletter. Furthermore, she has also offered workshops for dietitians and dietetics interns, and presented conferences about metaevaluation and program evaluation as part of the 7th International Conference on Knowledge, Culture, and Change in Organizations held at the Singapore Management University and the American Evaluation Association 2007 Annual Conference, respectively.
There are currently no reviews of this product.
Write a Review