Evaluation

EVALUATION PLANNING

Based on your needs, we design a comprehensive project plan that includes a scope of work, timeline, task responsibilities, deliverables, budget and communication strategies.

ASSESSMENT (to support Intervention Planning)

We learn the current circumstances in your community — and then use measurement and data to provide planning support by advising on best practices and making recommendations as you build the intervention and measurement strategy.

Needs Assessment/Landscape Analysis: We identify the current state of affairs through a literature review of published work, technical reports and informal documents, secondary data analysis and primary data analysis prior to determining an intervention and/or action steps.

MEASURES DEVELOPMENT & DATA COLLECTION

We determine the right measurement tools and collection methods that will most efficiently gather the desired data.

• Observational Tools: Observation is an objective way to collect data, especially with populations such as young children. We utilize validated tools when possible and, if necessary, will develop new tools that are piloted to ensure feasibility, validity and effectiveness.
• Key-Informant Interviews: Interviews are conducted to collect in-depth, rich information about an intervention. We develop the interview guide, administer pre- and/or post-intervention interviews, and then develop next steps based on findings.
• Surveys: We design and administer surveys using the most efficient process possible with electronic and/or hard-copy formats, and iPad technology when feasible.
• Focus Groups: We design focus group guides, facilitate both in-person and virtual sessions, and can also recruit participants.
• Cognitive Testing: We develop interview guides and conduct interviews to cognitively test surveys for understandability, readability and feasibility with a target population or geographic location prior to data collection.

DATA ANALYSIS

We pride ourselves on high-quality qualitative and quantitative data analysis and interpretation. Our research scientists are well-versed in analytical methods, and when appropriate we have a team of expert statisticians that we leverage from across the country. We can advise on all phases of data analysis, from development of the measurement to final reporting. In addition to analyzing primary data we collect ourselves, we are also skilled in conducting secondary data analysis from large nationally collected datasets.

DELIVERABLES

Data is best when it is shared. We will work with you to communicate findings to your audiences in the most appropriate and palatable form. Samples can be provided upon request.

• Full Technical Report: A complete report including a brief executive summary, background and rationale, methods, findings and conclusion – with an emphasis on recommendations and next steps.
• Brief Report: Used when a full technical report is not necessary. Applicable for quick-turnaround findings that will inform an intervention, quarterly reports, or in situations where an interim report is needed prior to a full report.
• Communication Pieces for Stakeholders: Visually appealing and graphically designed pieces that depict study findings in a “cut-to-the-chase” manner and can be easily shared. Can include one sheets, infographics, talking points or presentation slides.
• Manuscripts for Publication: Academic articles written for submission to peer-reviewed journals that contribute to the scientific literature base.
• Presentation of Findings: In-person or virtual presentation of the evaluation methods and findings.
• Mapping: Using ARC-GIS, data can be mapped as it relates to geographic locations.

SPECIALTY SKILLS

• Developing and/or modifying survey items and testing for validity and reliability
• Developing and modifying techniques specific to diet and physical activity assessment
• Evaluating technical assistance
• Conducting quantitative menu analysis
• Evaluating policy advocacy campaigns
• Measuring early care and education obesity prevention efforts, including Nutrition and Physical Activity Self-Assessment for Child Care (NAP SACC) and Environmental and Policy Assessment and Observation (EPAO) data analyses