Download Free Evaluation Culturessense Making In Complex Times Book in PDF and EPUB Free Download. You can read online Evaluation Culturessense Making In Complex Times and write the review.

Evaluation Cultures draws upon a sample of reflections, drawn from organizational practices, nationally centered political cultures, and ethnic cultures, as a framework for understanding how culture influences the work of evaluation. Two main conclusions seem to emerge: first, that there exists no single, uniform, and homogenous national evaluation culture; second, that the idea of a unified transnational culture of evaluation is an illusion.The evaluation community includes a diverse group of professionals; a diversity that is not just represented in national or ethnic culture but also in academic backgrounds, public and private sector allegiances, and personal character. The contributors to this book represent, in part, this diversity by reflecting a range of views.Evaluation Cultures draws upon the experience of senior evaluation practitioners, who share their reflections on their practice and experience, in order to put forth challenges to purely academic analysis. Evaluation Cultures presents a consistent, if not exhaustive, attempt to give analytical and empirical sense to all of the cultures of the evaluation community.
Enhancing Evaluation Use: Insights from Internal Evaluation Units offers invaluable insights from real evaluators who share strategies they have adopted through their own experiences in evaluation. Readers will learn about the challenges, solutions, and lessons drawn from the experience of evaluators working in a wide range of organizations. Referencing the latest literature, contributors discuss factors that help or undermine attempts to foster an evaluative thinking and learning culture within an organization. Applicable in a wide range of situations, their accounts demonstrate the initiative and innovative thinking they use to address challenges in various, sometimes complex, evaluation settings. Questions at the end of each chapter stimulate thought and discussions about the issues raised and allow readers to apply their findings to their own situations. "This book speaks to a cutting-edge topic, that is, the potential to generalize program evaluation expertise to larger organizational questions, and the cases from multiple international contexts represent a unique feature." —John Clayton Thomas, Georgia State University "The use of actual cases to highlight major concepts in evaluation in the public sector is a great feature." —Danica G. Hays, Old Dominion University "The text provides practical information from a variety of organizational contexts and the integration of international experiences provides for expanded discussion of evaluation theory and practice." —Kathleen Norris, Plymouth State University "The key strengths of this book lie in its national, supra-national and international organizational contexts, its consistency in insider perspectives, and the detailed examples provided." —Donna Haig Friedman, University of Massachusetts, Boston "The book of essays reviewed here was edited by two eminent evaluators. It fills an important gap in the literature: in pursuit of improved quality of evaluation products, evaluation thinkers have lavished attention on evaluation methods, ethics and use but they have sorely neglected evaluation governance issues and have largely failed to probe the workings of evaluation within organizations. Yet, most evaluations are commissioned by (or undertaken within) organizations. The choices organizations make in structuring evaluation functions and designing evaluation processes have a major bearing on the relevance, validity and usefulness of evaluations. Refreshingly, the book offers fresh mental models and practical lessons about evaluation systems and practices adopted in diverse organizational settings. All contributors to the book are seasoned practitioners. They hail from national, supranational and international organizations and many of them have trespassed across these thematic and organizational boundaries. They all are equipped to draw on a vast reservoir of hands---on experience as evaluation commissioners, managers, internal evaluators or external practitioners. Remarkably, they also display considerable familiarity with relevant themes treated by the organization management and evaluation literature. Given its pragmatic focus the book is bound to elicit broad based interest among evaluation practitioners. While it addresses familiar dilemmas and challenges (evaluation independence, evaluation utilization, organizational learning, nurturing of an evaluation culture, etc.) it does so from the distinctive perspective of "insiders" who have had to contend with a variety of organizational constraints and management pressures. Revealingly most contributors find good reasons to be optimistic about the possibility of positive change. The stage is set by John Mayne whose introductory and authoritative chapter identifies the critical importance of organizational factors in the utilization of evaluation results. This is followed by Bastiaan de Laat’s chapter which puts forward an ingenious analytical construct: the "tricky triangle" of relationships that links commissioners, evaluators and evaluands. Specifically De Laat unmasks and assesses the different and complex configurations that result from this triangular interplay. Penny Hawkins’ elegant contribution underlines the importance of evaluation independence. It highlights the considerable impact that the electoral cycle may have on evaluation approaches. It also reveals that indigenous cultures may present formidable obstacles to the very notion of external evaluative oversight. The next chapter penned by Marlene Laubli’s is equally perceptive in tracing the creative adaptation that the evaluation function underwent in response to changes in the organizational force field of the Swiss Federal Office of Public Health’s Evaluation Unit. In a similar vein Erica Wimbush provides a lucid exposition of the strategies used to bridge evaluative knowledge and management action in Scotland’s public health agency. Still within the health field, Nancy Porteous and Steve Montague show convincingly that transformative organizational change in Canada’s Public Health Agency was facilitated through judicious evaluation programming and what has come to be called "double loop learning". Finally, Bastiaan de Laat and Kevin Williams summarize important findings from of two empirical studies of evaluation use in the European Commission that go a long way in identifying good practices for evaluation commissioning in a supra--- national organizational context. The next two chapters of the book focus on two specialized agencies of the United Nations. They tread gently in what is admittedly a highly sensitive and contested terrain. Maria J. Santamaria Hergueta, Alan Schnur and Deepak Thapa discuss how the World Health Organization’s evaluation function evolved towards greater independence over several decades while Janet Neubecker, Matthew Ripley and Craig Russon focus on the innovative techniques used within the International Labour Organization to enhance utilization of self evaluation findings. The final chapter by Marlene Laubli Loud misses the opportunity to compensate for the "good news" bias that understandably characterizes the previous contributions. Surprisingly, it displays ambivalence towards evaluation independence which it equates with externality, a concept soundly rejected by de Laat. But setting this dimension aside, the chapter is interesting and valuable since it reflects the co---editor’ vast experience as an evaluator, evaluation trainer and evaluation manager in diverse national and international contexts. Thus the chapter provides a useful compilation of "take away" messages focused on good evaluation management practices. It is on solid grounds when it describes how to make effective use of advisory committees, motivate potential evaluation users, design good terms of reference, select the right evaluators, craft judicious evaluation policies and keep an eye out for political "windows of opportunity". Each chapter of the book concludes with a crisp exposition of overarching findings, discussion topics and references. Thus the volume should be of practical value to teachers, students, professional evaluators as well as evaluation commissioners and programme managers. All in all, this is a book that belongs on your shelf if you are intent on enhancing the role that evaluation plays in your organization." —Robert Picciotto, UKES Council Member
We are living in a cyber society. Mobile devices, social media, the Internet, crime cameras, and other diverse sources can be pulled together to form massive datasets, known as big data, which make it possible to learn things we could not begin to comprehend otherwise. While private companies are using this macroscopic tool, policy-makers and evaluators have been slower to adopt big data to make and evaluate public policy. Cyber Society, Big Data, and Evaluation shows ways big data is now being used in policy evaluation and discusses how it will transform the role of evaluators in the future. Arguing that big data will play a permanent and growing role in policy evaluation, especially since results may be delivered almost in real time, the contributors declare that the evaluation community must rise to the challenge or risk being marginalized. This volume suggests that evaluators must redefine their tools in relation to big data, obtain competencies necessary to work with it, and collaborate with professionals already experienced in using big data. By adding evaluators’ expertise, for example, in theory- driven evaluation, using repositories, making value judgements, and applying findings, policy-makers and evaluators can come to make better-informed decisions and policies.
Success in Evaluation takes a fundamentally different approach to the mainstream supply side discussion of evaluation quality, utilization, and learning. The contributors believe that a systematic focus on success will lead to increased awareness of evaluation and its findings, a more positive attitude, and a greater chance of actual evaluation use. This book offers many different lessons on how to improve evaluation design, research processes, and reporting. It is a realistic look at performance management, the evidence movement, and the demand barriers that so often block the role evaluators can play in organizational learning and decision-making. International case studies and lessons are included that both explain success-oriented methods and share insightful lessons from the real world. Together, they present a convincing case that evaluation for success allows for increased constructive interaction amongst both stakeholders and evaluators and, as a result, learning processes and outcomes will improve.
This book examines the progress of institutionalisation of evaluation in European countries from various perspectives. It describes both prior developments and current states of evaluation in 16 European countries and across the European Union (EU), focussing on three dimensions, namely the political, social and professional systems. These detailed country reports, which have been written by selected researchers and authors from each of the respective countries, lead to a concluding comparison and synthesis. This is the first of four volumes of the compendium The Institutionalisation of Evaluation to be followed by volumes on the Americas, Africa and Australasia. The overall aim is to provide an interdisciplinary audience with cross-country learning to enable them to better understand the institutionalisation of evaluation in different nations, world regions and different sectors.
This book examines the contributions of non-public organizations, such as foundations, philanthropies, charities, non-governmental organizations, private businesses, and entrepreneurs to public goods and services. Too often the impact of the contributions of such private actors are overlooked. However, they are playing an increasing role in meeting societal needs across the developing world.Doing Public Good? lays out key elements that need to be considered in evaluating the net results achieved by these private actors. It uses case studies and analysis to show how to answer such questions as: Is it working? How do they and the public know they are doing good? And how to improve? Such questions are particularly important since little is known about the net results of private avenues for delivering public value.The contributors conclude that "doing good" organizations need to be more transparent and accountable regarding their operations and achievements. The book suggests perspectives on how better monitoring and evaluation systems can improve their accountability.
Today, evaluation is part of governing systems and is supported by powerful institutions. It is taken for granted that evaluation leads to betterment. However, evaluation itself is seldom analyzed from a critical perspective. In this book, Jan-Eric Furubo and Nicoletta Stame have assembled an international line-up of distinguished experts and emerging scholars to fill this void. Examining evaluation from a critical – or evaluative – perspective, each contribution in this book offers a systematic and critical insight into the broader relationship between evaluation and society. Divided into three parts, the various chapters ask questions such as: What are the consequences of the institutionalization of evaluation? Has the professionalization of evaluators favored their action in the public interest? Is the money spent on evaluation worth it? Is the market of evaluation allowing real competition for the best services? The answers to these questions demonstrate that the constitutive effects of the social practice of evaluation can also be the suppression of other forms of knowledge and the favoring of certain notions about societal development and political and administrative processes.
In Changing Bureaucracies, international experts provide an unparalleled look at how public sector bureaucracies can better adapt to the reality of unprecedented levels of uncertainty and complexity, and how they can better respond to the emerging needs and demands of citizens and beneficiaries. In particular, they discuss in detail how evaluation can play an important role in aiding bureaucracies in adapting, while noting that the value of evaluation is not at all automatic. Written in a clear and accessible prose, the contributors identify stability as a strength of bureaucratic structures, although adaptability is required in order to remain relevant. They also emphasize the need for bureaucratic rules and practices to be open to examination, such as through evaluation, noting that these rules may take on a life of their own, increasing distrust and conflicting with a meaningful focus on how outcomes and impacts benefit citizens. The book concludes with guidance for both evaluators and for public sector leaders about steps that they can take to improve the responsiveness and relevance of public sector organizations. Pioneering the provision of reflections on how evaluation can play an important role in aiding bureaucracies in adapting, Changing Bureaucracies is an important acquisition for public sector leaders, evaluators, evaluation managers and commissioners and academics alike.
This book examines developments in governance reform in Britain, with a particular focus on the period since 2010. We argue that the experiences of the past decade mean that public value-based ideas are required to inform governance reform for the coming years. This needs to be prioritised due to the twin challenges of managing the aftermath of Brexit and navigating through the recovery phase of the COVID-19 pandemic. The volume outlines key themes, issues and debates relevant to contemporary public sector reform including: modes of state governance, evidence-based policy-making debates, the challenges and possibilities of public sector innovation, accountability issues, and the implications of Brexit. The overall conclusion of the book is that the coming decade presents an opportunity for more paradigmatic changes to UK governance but, for this to happen, political leaders need to prioritise a ‘reinventing government’ agenda underpinned by public value-based thinking and approaches. This book will be of particular interest to students of politics and public administration and relevant for those with general research interests in British governance and public policy.
In Experimental Practice Dimitris Papadopoulos explores the potential for building new forms of political and social movements through the reconfiguration of the material conditions of existence. Rather than targeting existing institutions in demands for social justice, Papadopoulos calls for the creation of alternative ontologies of everyday life that would transform the meanings of politics and justice. Inextricably linked to technoscience, these “alterontologies”—which Papadopoulos examines in a variety of contexts, from AIDS activism and the financialization of life to hacker communities and neuroscience—form the basis of ways of life that would embrace the more-than-social interdependence of the human and nonhuman worlds. Speaking to a matrix of concerns about politics and justice, social movements, matter and ontology, everyday practice, technoscience, the production of knowledge, and the human and nonhuman, Papadopoulos suggests that the development of alterontologies would create more efficacious political and social organizing.