What is the primary problem associated with using local norms to evaluate a program?

What is the primary problem associated with using local norms to evaluate a program?

• A. Local standards of performance are stricter than national standards.
• B. Local norms require larger sample sizes.
• C. Local standards of performance may be confused with nationally acceptable standards.
• D. Local norms are not relevant to program evaluation.

Answer: (C)

Using local norms to judge a program can mislead you because those norms reflect performance within a specific local context, not nationwide expectations. The main problem is that local standards may be mistaken for nationally acceptable standards. If you compare outcomes to locally derived norms, you might conclude the program looks effective simply because it meets what this local group typically achieves, even if those levels are below national benchmarks. Conversely, a local norm that is unusually high could make the program seem ineffective when, by national standards, it would be adequate. In short, local norms can blur the distinction between what’s expected locally and what’s expected nationally, compromising the validity and generalizability of evaluation conclusions.

Using local norms to judge a program can mislead you because those norms reflect performance within a specific local context, not nationwide expectations. The main problem is that local standards may be mistaken for nationally acceptable standards. If you compare outcomes to locally derived norms, you might conclude the program looks effective simply because it meets what this local group typically achieves, even if those levels are below national benchmarks. Conversely, a local norm that is unusually high could make the program seem ineffective when, by national standards, it would be adequate. In short, local norms can blur the distinction between what’s expected locally and what’s expected nationally, compromising the validity and generalizability of evaluation conclusions.