Preface |
|
xiii | |
Acknowledgments |
|
xix | |
Section 1: The Context of Health Program Development and Evaluation |
|
1 | (112) |
|
Chapter 1 Health Program Development and Evaluation |
|
|
3 | (34) |
|
|
4 | (5) |
|
|
4 | (1) |
|
History of Health Program Planning |
|
|
5 | (1) |
|
History of Health Program Evaluation |
|
|
6 | (3) |
|
Evaluation as a Profession |
|
|
9 | (2) |
|
Planning and Evaluation Cycle |
|
|
11 | (5) |
|
Interdependent and Cyclic |
|
|
11 | (2) |
|
|
13 | (1) |
|
|
14 | (2) |
|
|
16 | (2) |
|
|
18 | (2) |
|
The Public Health Pyramid |
|
|
20 | (5) |
|
Use of the Pyramid in Program Planning and Evaluation |
|
|
22 | (1) |
|
The Pyramid as a Ecological Model |
|
|
23 | (2) |
|
|
25 | (4) |
|
|
25 | (2) |
|
Community in Planning and Evaluation |
|
|
27 | (2) |
|
Defining "Based," "Focused," and "Driven" |
|
|
29 | (1) |
|
Who Does Planning and Evaluations? |
|
|
29 | (2) |
|
|
31 | (1) |
|
|
31 | (3) |
|
|
34 | (3) |
|
Chapter 2 Relevance of Diversity and Disparities to Health Programs |
|
|
37 | (36) |
|
|
39 | (3) |
|
Diversity and Health Disparities |
|
|
40 | (2) |
|
Diversity and Health Programs |
|
|
42 | (12) |
|
|
42 | (5) |
|
|
47 | (4) |
|
Influences of Sociocultural Diversity on Interventions |
|
|
48 | (1) |
|
Influences of Biological Diversity on Interventions |
|
|
49 | (1) |
|
Approaches to Developing Programs |
|
|
50 | (1) |
|
Profession and Provider Diversity |
|
|
51 | (3) |
|
|
51 | (3) |
|
Diversity Within Health Care Organizations and Programs |
|
|
54 | (1) |
|
|
54 | (11) |
|
Cultural Competency Continuum |
|
|
55 | (4) |
|
Enhancing Cultural Competence |
|
|
59 | (3) |
|
Stakeholders and Coalitions |
|
|
62 | (3) |
|
|
65 | (2) |
|
|
67 | (6) |
|
Chapter 3 Planning for Health Programs and Services |
|
|
73 | (40) |
|
|
74 | (1) |
|
Historical Background on Planning in Public Health |
|
|
74 | (1) |
|
|
75 | (1) |
|
|
76 | (1) |
|
|
76 | (1) |
|
|
77 | (2) |
|
|
77 | (2) |
|
Planning Paradoxes, Assumptions, and Ethics |
|
|
79 | (12) |
|
|
79 | (2) |
|
|
81 | (3) |
|
Ambiguity, Conflict, Risk, and Control |
|
|
82 | (2) |
|
|
84 | (5) |
|
|
84 | (2) |
|
|
86 | (1) |
|
|
86 | (1) |
|
Communication Action Approach |
|
|
87 | (1) |
|
Comprehensive Rational Approach |
|
|
88 | (1) |
|
Strategic Planning Approach |
|
|
89 | (1) |
|
|
90 | (1) |
|
Planning Steps and Stages |
|
|
91 | (15) |
|
Formation Stage and Team Development |
|
|
91 | (3) |
|
|
93 | (1) |
|
|
94 | (6) |
|
|
94 | (1) |
|
Determine Willingness and Preferences |
|
|
95 | (1) |
|
Years and Quality of Life |
|
|
95 | (1) |
|
|
98 | (2) |
|
|
100 | (3) |
|
|
103 | (3) |
|
Implementation and Continuation Stage |
|
|
106 | (1) |
|
|
106 | (2) |
|
|
108 | (5) |
Section 2: Developing Health Programs |
|
113 | (98) |
|
Chapter 4 Community Health Assessment for Program Planning |
|
|
115 | (36) |
|
|
115 | (1) |
|
Perspectives on Assessment |
|
|
116 | (4) |
|
|
118 | (1) |
|
|
118 | (1) |
|
|
118 | (1) |
|
|
119 | (1) |
|
|
120 | (2) |
|
Organizational Assessment |
|
|
120 | (1) |
|
|
121 | (1) |
|
|
121 | (1) |
|
Community Health Assessment |
|
|
122 | (1) |
|
Steps in Conducting the Assessment |
|
|
122 | (23) |
|
Involve Community Members |
|
|
123 | (1) |
|
|
124 | (1) |
|
Define the Problem(s) to be Assessed |
|
|
125 | (5) |
|
|
126 | (1) |
|
Precursors of the Problem |
|
|
127 | (3) |
|
Population Characteristics |
|
|
130 | (1) |
|
|
130 | (1) |
|
|
130 | (3) |
|
Collect Data: Methodological Issues |
|
|
133 | (3) |
|
|
136 | (6) |
|
Descriptive and Inferential Statistics |
|
|
136 | (2) |
|
|
138 | (1) |
|
|
139 | (1) |
|
|
139 | (1) |
|
|
140 | (1) |
|
Geographic Information Systems: Mapping |
|
|
141 | (1) |
|
|
141 | (1) |
|
State the Need or Problem |
|
|
142 | (3) |
|
|
145 | (2) |
|
|
147 | (4) |
|
Chapter 5 Program Theory and Interventions Revealed |
|
|
151 | (28) |
|
|
152 | (3) |
|
|
152 | (2) |
|
|
154 | (1) |
|
|
155 | (8) |
|
Finding and Identifying Interventions |
|
|
155 | (1) |
|
|
156 | (1) |
|
Specifying Intervention Administration |
|
|
157 | (2) |
|
Interventions and Program Components |
|
|
159 | (1) |
|
Criteria for "Good" Interventions |
|
|
160 | (3) |
|
Impacts and Outcomes in Public Health |
|
|
163 | (9) |
|
Generating the Effect Theory |
|
|
164 | (4) |
|
|
164 | (1) |
|
|
165 | (1) |
|
|
166 | (1) |
|
|
167 | (1) |
|
Involving Key Stakeholders |
|
|
168 | (1) |
|
Drawing upon the Scientific Literature |
|
|
169 | (2) |
|
Diagramming the Causal Chain of Events |
|
|
171 | (1) |
|
Checking Against Assumptions |
|
|
172 | (1) |
|
Functions of Program Theory |
|
|
172 | (3) |
|
|
173 | (1) |
|
|
174 | (1) |
|
Forms a Basis for Communication |
|
|
175 | (1) |
|
Provides a Scientific Contribution |
|
|
175 | (1) |
|
|
175 | (2) |
|
|
177 | (2) |
|
Chapter 6 Program Objectives and Setting Targets |
|
|
179 | (32) |
|
Parameters of the Program |
|
|
179 | (5) |
|
Inclusion: Underinclusion and Overinclusion |
|
|
180 | (2) |
|
Scope: Full and Partial Coverage |
|
|
182 | (2) |
|
Program Goals and Objectives |
|
|
184 | (7) |
|
|
185 | (2) |
|
|
185 | (1) |
|
Effect Objectives: Impact and Outcome |
|
|
186 | (1) |
|
Objectives and Indicators |
|
|
187 | (2) |
|
Good Goals and Objectives |
|
|
189 | (2) |
|
Using Data to Set Target Values |
|
|
191 | (17) |
|
Decisional Framework for Setting Target Values |
|
|
192 | (6) |
|
Options for Calculating Target Values |
|
|
198 | (16) |
|
|
198 | (10) |
|
|
208 | (1) |
|
|
209 | (2) |
Section 3: Implementing Health Programs |
|
211 | (66) |
|
Chapter 7 Logistics of Program Implementation |
|
|
213 | (24) |
|
Inputs to the Organizational Plan |
|
|
214 | (7) |
|
|
215 | (1) |
|
Volunteers as Human Resources |
|
|
216 | (1) |
|
|
217 | (1) |
|
|
218 | (1) |
|
|
218 | (1) |
|
|
219 | (1) |
|
|
219 | (2) |
|
|
221 | (1) |
|
Outputs of the Organizational Plan |
|
|
221 | (8) |
|
|
221 | (1) |
|
|
222 | (1) |
|
|
222 | (1) |
|
|
222 | (1) |
|
|
223 | (6) |
|
|
224 | (1) |
|
|
225 | (3) |
|
|
228 | (1) |
|
|
229 | (1) |
|
Inputs to the Service Utilization Plan |
|
|
229 | (3) |
|
|
229 | (1) |
|
|
230 | (1) |
|
|
230 | (1) |
|
|
231 | (1) |
|
Outputs of the Service Utilization Plan |
|
|
232 | (1) |
|
|
233 | (1) |
|
|
234 | (3) |
|
Chapter 8 Process Evaluation: Measuring Inputs and Outputs |
|
|
237 | (40) |
|
|
238 | (3) |
|
Purposes of a Process Evaluation |
|
|
239 | (1) |
|
|
240 | (1) |
|
|
241 | (3) |
|
Monitoring Inputs to the Organizational Plan |
|
|
244 | (5) |
|
|
245 | (3) |
|
|
248 | (1) |
|
Quantifying Outputs of the Organizational Plan |
|
|
249 | (1) |
|
|
249 | (1) |
|
Monetary Resources: Budget Variance |
|
|
250 | (1) |
|
Monitoring Inputs to the Service Utilization Plan |
|
|
250 | (4) |
|
Participants and Recipients |
|
|
252 | (2) |
|
|
254 | (3) |
|
|
254 | (1) |
|
|
254 | (1) |
|
Unstandardized Intervention |
|
|
255 | (2) |
|
Quantifying Outputs of the Service Utilization Plan |
|
|
257 | (9) |
|
|
257 | (7) |
|
|
264 | (1) |
|
|
264 | (1) |
|
|
265 | (1) |
|
|
266 | (1) |
|
|
266 | (5) |
|
Process Objectives Revisited |
|
|
266 | (1) |
|
Process Evaluation Data as Information |
|
|
267 | (1) |
|
Action Focused on the Process Theory |
|
|
268 | (1) |
|
|
269 | (2) |
|
|
271 | (2) |
|
|
273 | (4) |
Section 4: Evaluating the Impact and Outcome of Health Programs |
|
277 | (134) |
|
Chapter 9 Planning the Methods for Evaluating Intervention Effects |
|
|
279 | (40) |
|
Developing the Evaluation Questions |
|
|
280 | (6) |
|
Characteristics of the Right Question |
|
|
281 | (1) |
|
Impact Documentation, Impact Assessment, or Impact Evaluation |
|
|
282 | (2) |
|
|
284 | (1) |
|
|
285 | (1) |
|
Intervention Effect Evaluation Variables from the Program Effect Theory |
|
|
286 | (5) |
|
Impact and Outcome as Dependent Variables |
|
|
286 | (3) |
|
Determinants as Independent Variables |
|
|
289 | (1) |
|
Contributing and Antecedent Factors as Variables |
|
|
290 | (1) |
|
Measurement Considerations |
|
|
291 | (5) |
|
|
291 | (1) |
|
Types of Variables (Levels of Measurement) |
|
|
292 | (1) |
|
|
293 | (2) |
|
|
295 | (1) |
|
|
296 | (2) |
|
|
296 | (1) |
|
|
297 | (1) |
|
|
298 | (1) |
|
|
298 | (12) |
|
Surveys and Questionnaires |
|
|
299 | (5) |
|
Considerations for Constructing Questionnaires |
|
|
299 | (3) |
|
|
302 | (1) |
|
|
302 | (1) |
|
|
304 | (1) |
|
|
304 | (5) |
|
|
309 | (1) |
|
Considerations During Planning |
|
|
310 | (3) |
|
|
310 | (1) |
|
|
311 | (1) |
|
|
311 | (1) |
|
|
312 | (1) |
|
|
313 | (2) |
|
|
315 | (4) |
|
Chapter 10 Choosing Designs for Impact Evaluation |
|
|
319 | (38) |
|
Choosing an Evaluation Design |
|
|
320 | (23) |
|
Considerations in Choosing a Design |
|
|
321 | (3) |
|
Intervention and Observational Designs |
|
|
324 | (2) |
|
Identifying Design Options |
|
|
326 | (1) |
|
Overview of the Decision Tree |
|
|
327 | (2) |
|
Designs for Impact Documentation |
|
|
329 | (3) |
|
One Group, Post-Test Only |
|
|
330 | (1) |
|
One Group, Pre-Test and Post-Test |
|
|
330 | (1) |
|
Comparison Groups, Post-Test Only |
|
|
331 | (1) |
|
Designs for Impact Assessment |
|
|
332 | (8) |
|
|
333 | (2) |
|
Multiple Groups, Time Series |
|
|
335 | (1) |
|
Two Groups, Retrospectively Constructed (Case Control) |
|
|
335 | (2) |
|
Two Groups, Prospective (Cohorts) |
|
|
337 | (2) |
|
|
339 | (1) |
|
Two Groups, Pre-Test and Post-Test |
|
|
340 | (1) |
|
Designs for Impact Evaluation Research |
|
|
340 | (3) |
|
|
341 | (1) |
|
Two Groups, Pre-Test and Post-Test with Random Assignment |
|
|
342 | (1) |
|
|
343 | (8) |
|
|
343 | (2) |
|
|
345 | (2) |
|
Sampling for Impact Assessment |
|
|
347 | (1) |
|
Sampling for Impact Evaluation |
|
|
347 | (2) |
|
|
349 | (2) |
|
|
351 | (2) |
|
|
353 | (1) |
|
|
354 | (3) |
|
Chapter 11 Analyzing and Interpreting Evaluation Data |
|
|
357 | (30) |
|
Data Entry and Management |
|
|
357 | (4) |
|
|
359 | (1) |
|
|
360 | (1) |
|
|
361 | (1) |
|
|
362 | (5) |
|
|
363 | (3) |
|
Clinical and Statistical Significance |
|
|
366 | (1) |
|
Across Levels of Analysis |
|
|
367 | (1) |
|
Statistical Answers to the Question |
|
|
368 | (11) |
|
|
371 | (2) |
|
|
373 | (1) |
|
|
374 | (2) |
|
|
376 | (3) |
|
|
379 | (3) |
|
Four Fallacies of Interpretation |
|
|
380 | (2) |
|
|
382 | (1) |
|
|
382 | (1) |
|
|
383 | (4) |
|
Chapter 12 Qualitative Methods for Planning and Evaluation |
|
|
387 | (24) |
|
Functions of Qualitative Methods |
|
|
387 | (1) |
|
|
388 | (10) |
|
|
388 | (4) |
|
|
392 | (2) |
|
In-Depth Individual Interview |
|
|
394 | (1) |
|
|
395 | (2) |
|
Survey with Open-Ended Questions |
|
|
397 | (1) |
|
|
397 | (1) |
|
|
398 | (2) |
|
Sampling for Qualitative Methods |
|
|
400 | (1) |
|
|
400 | (6) |
|
Overview of the Analysis Process |
|
|
401 | (3) |
|
|
404 | (1) |
|
|
404 | (1) |
|
|
405 | (1) |
|
|
406 | (1) |
|
|
407 | (1) |
|
|
408 | (3) |
Section 5: From Data to Decision |
|
411 | (56) |
|
Chapter 13 Cost Analyses: The Basics |
|
|
413 | (24) |
|
Types of Economic Analyses |
|
|
413 | (10) |
|
Cost-Effectiveness Analysis |
|
|
415 | (3) |
|
|
418 | (3) |
|
|
421 | (2) |
|
Basic Steps Involved in Conducting Economic Evaluations |
|
|
423 | (1) |
|
|
423 | (9) |
|
Stipulate Comparison Parameters |
|
|
423 | (1) |
|
|
424 | (1) |
|
Choose an Accounting Perspective |
|
|
424 | (2) |
|
Monetize and Compute Program Costs |
|
|
426 | (2) |
|
|
428 | (1) |
|
Identify and Measure Program Effects |
|
|
429 | (1) |
|
|
429 | (1) |
|
|
430 | (1) |
|
Conduct a Sensitivity Analysis |
|
|
430 | (1) |
|
|
431 | (1) |
|
Assessing Economic Evaluations |
|
|
432 | (1) |
|
|
433 | (1) |
|
|
434 | (3) |
|
Chapter 14 Continuing the Cycle |
|
|
437 | (30) |
|
|
437 | (4) |
|
Persuasion and Information |
|
|
437 | (2) |
|
Information and Sense Making |
|
|
439 | (2) |
|
|
441 | (8) |
|
|
443 | (1) |
|
|
444 | (4) |
|
|
448 | (1) |
|
|
449 | (5) |
|
Institutional Review Board Approval and Consents |
|
|
449 | (1) |
|
|
450 | (3) |
|
|
453 | (1) |
|
Contextual Considerations |
|
|
454 | (5) |
|
Organization-Evaluator Relationship |
|
|
454 | (3) |
|
|
457 | (2) |
|
|
459 | (1) |
|
|
460 | (2) |
|
|
462 | (1) |
|
|
463 | (4) |
Index |
|
467 | |