Program Evaluation Manager

Harvard Medical School

Boston, MA

ID: 7194795 (Ref.No. hh-64391BR)
Posted: November 18, 2023

Job Description

Position Description
Harvard Catalyst | The Harvard Clinical and Translational Science Center is dedicated to improving human health through advancing clinical and translational research by providing tools, training, and technologies to clinical and translational investigators and their teams. Harvard Catalyst has multiple programs, each with their own goals and initiatives, as well as Catalyst-wide goals and cross-program initiatives. Harvard Catalyst is funded by the NIH, National Center for Advancing Clinical Sciences (NCATS) and is part of a national network of CTSAs.

The Program Evaluation Manager will provide guidance and support for the evaluation efforts within each of Harvard Catalyst’s programs as well as develop and lead the evaluation efforts for cross-program initiatives and the evaluation work that informs Catalyst-wide goals. The Program Evaluation Manager will facilitate the use and implementation of program evaluation data to assess the attainment of goals, ensure continuous quality improvement, and to guide program and organizational change.

Essential Responsibilities
1.) For evaluation of individual programs, provide guidance to program staff and varying levels of support (depending on program size and need) on all aspects of evaluation including:
  • helping program staff to clarify their goals and objectives, identify stakeholders, and plan needs assessments
  • providing guidance on conceptualizing methods and measurable indicators of success, assisting with instrument development (e.g., surveys, interviews) as needed
  • facilitating the development of work plans and evaluation plans
  • interpreting and visualizing evaluation data
  • creating presentations on program outcomes for Harvard Catalyst leadership
  • developing continuous improvement action plans and modifying objectives and evaluation plans accordingly
  • providing training to program staff, as needed, in evaluation principles and practices to help strengthen their efforts
2.) For cross-program initiatives and Catalyst-wide goals, the Program Evaluation Manager will work independently, with input from a team of program leaders, to develop evaluation questions and related methods, metrics and indicators that address cross-program goals. The Program Evaluation Manager will be responsible for establishing the evaluation priorities, managing implementation and, with a cross-program team, creating a continuous improvement action plan in response to the results.

3.) For all evaluation efforts, guide evaluation operations and systems towards achieving high-quality methods and reporting standards, ensuring adherence to best practices, and embedding equity into methods and measurement with inclusion of diverse audiences in discussions and decisions at different stages of the evaluation process

Additional Responsibilities
  • Work closely with a data coordinator, which requires identifying work requirements, setting priorities, and ensuring quality of deliverables
  • Work closely with Harvard Catalyst’s Communications Team to repackage data into reports on outcomes and impact for multiple stakeholders and assists Harvard Catalyst leadership with preparation of annual reports to NIH
  • Play an active role in any CTSA network-wide evaluation effort, either regionally or nationally
  • Coordinate evaluation efforts across Harvard Catalyst to identify shared goals and metrics, establish common variables, and maintain consistency in quality
  • Ensure that program reports and presentations contain sufficient and appropriate information to assess program status, identify needs and improvements, and allow for decision-making and priority setting by leadership
Basic Qualifications
  • Bachelor’s degree or equivalent work experience required
  • Minimum of 5 years’ relevant work experience
Additional Qualifications and Skills
  • Expertise in evaluation research methodologies, quantitative and qualitative data collection and analyses, survey and interview design, metrics and dashboard development, and presentation of findings to diverse audiences
  • Master’s degree preferred in Evaluation, Psychology, Public Health, Public Policy, Public Administration, Education, or a closely related field with coursework and relevant training in evaluation
  • Familiarity with Excel, Salesforce, Qualtrics, statistical/data analysis software, data visualization applications, and policies related to data privacy, confidentiality, and responsible data use; experience with bibliometric analyses using digital analytical tools is a plus
  • The successful candidate will be self-driven, team oriented, and able to work both independently and in collaboration with partners and colleagues in a mostly virtual context.
The Program Evaluation Manager should be able to:
  • Skillfully collaborate with program and Harvard Catalyst leaders around decision-making, identifying priorities, improving programs, demonstrating impact, and building a culture of continuous learning and improvement
  • Facilitate and support change, including identifying opportunities for improved processes, overcoming barriers, and initiating new efforts
  • Anticipate, analyze, and solve problems, involving others as appropriate, and address conflict positively
  • Communicate clearly, listen attentively, be receptive to feedback, and provide feedback effectively
Additional Information
This is a term appointment, with an end date of 6/30/2026, with the possibility of renewal contingent on funding.

The health of our workforce is a priority for Harvard University. With that in mind, we strongly encourage all employees to be up-to-date on CDC-recommended vaccines.

Please note that we are currently conducting a majority of interviews and onboarding remotely and virtually. We appreciate your understanding.

The Harvard Medical School is not able to provide visa sponsorship for this position.

Not ready to apply? Join our talent community to keep in touch and learn about future opportunities! ( ?formID=16341e35-cbc6-4904-88a3-09b35763307e)

Commitment to Equity, Diversity, Inclusion, and Belonging
We are committed to cultivating an inclusive workplace culture of faculty, staff, and students with diverse backgrounds, styles, abilities, and motivations. We appreciate and leverage the capabilities, insights, and ideas of all individuals. Harvard Medical School Mission and Community Values
EEO Statement
We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veteran status, gender identity, sexual orientation, pregnancy and pregnancy-related conditions, or any other characteristic protected by law.

Harvard Medical School strives to cultivate an environment that promotes inclusiveness and collaboration among students, faculty and staff and to create new avenues for discussion that will advance our shared mission to improve the health of people throughout the world.