Data collection began in 2013 and took place at multiple sites. Sessions at Jump were launched in January and February 2015. 31 emergency medicine residents participated locally. About 80 were involved nationally.
During the course of the study, Emergency Medicine residents from all training levels served individually as the lead physician in the high fidelity simulation scenarios. They were evaluated by Emergency Medicine faculty physicians using the NAS assessment tools.
The assessment tools were composed of "critical actions" that are specific to each scenario, yet map back to NAS milestone behaviors. Each critical action was scored as an observed/not observed item.
The faculty received standardized training on how to use the assessment tools. More than one rater per scenario allowed for calculations of inter-rater reliability.