Choose unit of randomization thoughtfully: individuals, squads, or time windows. Guard against contamination by clarifying channels and discouraging unofficial backdoors. When randomization is impossible, use matching on baseline performance, tenure, and manager to approximate balance while preserving operational realism.
Estimate detectable effect sizes by translating business outcomes into minimal practical benefits. Use historical variance, desired confidence, and cost of delay to pick sample sizes and stop rules. Pre-register analysis choices, then resist peeking; share your plan with stakeholders to build trust.
Obtain informed consent with plain language. Protect psychological safety by separating coaching transcripts from evaluation systems. Define escalation paths for sensitive disclosures. Offer opt-outs without penalty. Report aggregate results, anonymize examples, and invite employee councils to review both methodology and learnings before broad announcements.