Resources for Evaluating Effectiveness

Case Studies

Evaluating an Innovative IPM Practice to Control Ground Squirrels, City of Palo Alto

Additional case studies of evaluating the effectivenss of pesticide pollution prevention actions will be added. To suggest a case study, e-mail up3@waterboards.ca.gov

Print and Web Resources:
The following is a selected list of print and online resources the UP3 Project believes will be most helpful to municipal staff planning evaluation activities. The list is divided into sections:

General
Survey Research/Design Resources
Pesticide Reduction Specific Resources
Social Marketing

General:
Municipal Stormwater Program Effectiveness Assessment Guidance, California Stormwater Quality Association

The California Stormwater Quality Association has prepared a comprehensive guidance document for stormwater programs to use to assess effectiveness. It is available for purchase through the CASQA web site.

White Paper: An Introduction to Stormwater Program Effectiveness Assessment, California Stormwater Quality Association
Provides key concepts and a standard terminology related to a comprehensive framework for assessing the effectiveness of stormwater management programs.

Tools to Measure Source Control Program Effectiveness, Water Environment Research Foundation, prepared by Betsy Elzufon, Larry Walker Associates
Provides a summary of effectiveness measurement tools, considerations for when to select a particular tools, as well as case studies, findings, and recommendations.
Copies are available for free to WERF Subscribers (many Bay Area agencies are subscribers to WERF.) (Reference Project 98-WSM-2) Non-WERF subscribers can order a copy online through the Water Environment Federation (Order # D003002,ISBN # 1-893664-24-4)
See also the companion report Controlling Pollution at Its Source: Wastewater and Stormwater Demonstration Projects, also available through WERF.

Tools of Change web site. Provides tools for evaluating program activities (as opposed to environmental improvement. Click on "planning guide," then "measuring achievement"

The Outreach Evaluation Resource Center of the National Network of Libraries of Medicine's“provides assistance in developing well-planned evaluation to help target and measure outreach success." While this site has a public health focus, it has some useful resources that may apply to outreach with environmental goals. Also includes an outreach_eval Discussion List

American Evaluation Association web site An “international professional association of evaluators devoted to the application and exploration of program evaluation, personnel evaluation and many other forms of evaluation.”

Evaluation Resources, The University of Wisconsin Cooperative Extension
Main Evaluation Page
Quick Tips (includes specific info on planning your evaluation, collecting information, analyzing and interpreting information, communicating results, improving your evaluation quality, and “retrospective post-then-pre”.)
Links page

Assessing Effectiveness and Making Refinements, National Cancer Institute guidance (chapter 4) While this is a public health focused publication, the planning steps in this book are applicable at all types of communications programs. Chapter 4 focuses on assessing effectiveness.

W.K. Kellogg Foundation Evaluation Toolkit
Includes information on where to start, evaluation approaches, evaluation questions, the evaluation plan, budgeting for an evaluation, and hiring and managing an evaluator

Survey Research/Design Resources

What is a Survey booklet by Fritz Scheuren
Available free in .pdf or .html from the American Statistical Association web site. This booklet is written primarily for non-specialists.

Best Practices for Survey and Public Opinion Research available online in .pdf and .html from the American Association for Public Opinion Research.

A Brief History of the Survey Research Industry Offering Frequently Asked Questions About Research, available from the Council of American Survey Research Organizations web site: Note: this web site also includes listing of survey research firms.

Pesticide Reduction Specific Resources

Management Tools, Responsible Pest Management web site This Canadian web site, also provides tools and networks, case studies, and best practices and alternatives.

Social Marketing

Community Based Social Marketing web site. This site by McKenzie-Mohr and Associates includes an online guide on the use of community-based social marketing to design and evaluate programs to foster sustainable behavior; a searchable databases of articles, cases, graphics, and downloadable reports on fostering sustainable behavior; and a listserv. Note: this site requires registration

Social Marketing Institute web site
Nonprofit Marketing Summit Conference report, Social Marketing Institute
Links page, Social Marketing Institute web site

Additional links/resources can be added to this site. Please send recommendations to up3@waterboards.ca.gov .