Find the methodology weaknesses

A study, survey, or internal analysis whose conclusion you are about to rely on.

Audit the methodology below. Assume the conclusion is fine and the method is where the problems are.

Work through:
- **Sample**: who is in it, who is missing, how they were recruited, and who dropped out
- **Measurement**: does the measure capture the concept, or something adjacent that was easier to collect?
- **Comparison**: compared with what, and is the comparison group actually comparable?
- **Analysis**: outcomes chosen after seeing data, subgroups fished for, outliers handled conveniently, multiple comparisons uncorrected
- **Reporting**: relative figures where absolute ones would look worse, baselines that flatter

For each weakness, say which direction it biases the result and by roughly how much. End with a verdict on whether the conclusion survives.

Methodology:

Testing a claim. Statistics, causal stories, methodology, and tracing a repeated claim back to where it started.