Director, PIENSE Test Development
The College Board Puerto Rico and the Latin America Office (PRLAO) seeks a Test Development Director for the PIENSE program. This position provides leadership, plans, coordinates, and reviews the work of Content Specialists, committee of examiners, item writers, editors, and proof readers. In addition, s/he develops a fiscal plan and budget for PIENSE including new forms and pre-tests according to the item bank assessment and in coordination with the Executive Director of Test Development and the Senior Director of Research and Measurement. The Test Development Director of PIENSE provides content expertise in one or more of the following subject matters: Cognitive Ability, Spanish, Mathematics, or English. S/he oversees the process of test and pre-tests development in coordination with Content Specialists of specific subject-matters. The Test Development Director of PIENSE provides training to teachers and school staff in Puerto Rico and the Latin America region about the interpretation of results of PIENSE.
This position is based in our Puerto Rico office.
What you will do:
- Provide leadership, plan, coordinate, and review the work of the committee of examiners, item writers, editors, proofreaders and consultants for PIENSE program and any other assigned program (s).
- Develop the fiscal year plan and budget for PIENSE and any other assigned program (s).
- Deliver on time assessments as assigned to Publishing as agreed with the Executive Director of Test Development, leveraging the content specialist as needed.
- Strengthen the item bank including the development of new items with the support of the content specialists and committees for the primary and any other secondary program assigned by the - Executive Director of Test Development.
- Provide training to teachers and academic managers for the interpretation of test results, as well as strategies for the incorporation of results into the teaching and learning processes.
- Develop training materials, study guides, and practice tests for students, teachers, and users of PRLAO’s tests.
- Perform or coordinate with the content managers the test assembly of new operational forms for the assigned program (s).
- Plan accurately with Item bank management the new item development needs for the assigned program (s).
- Work with the Measurement team to ensure compliance of test parameters for new forms.
- Follow standards agreed with the Quality Assurance team.
- Deliver “first draft” test (s) to publishing team with the established quality controls
- Construct forms including new forms requiring new items and assembly-only.
- Collaborate with other units in congresses, and other external events.
- Educate administration and other teams on potential changes in the existing products or new products.
- Reach agreement with Assessment Operations regarding the necessary training requirements for teachers, examiners and students for the successful completion of the program.
- Reach agreement with Assessment Operations regarding the completion of the necessary support materials, such as guides.
- Develop - specific sections of the assigned programs or program’s components.
- Develop new specialized items with the support of the committees for one (or various) programs.
- Revise item pool before and after submission to examiner committee.
- Coordinate and conduct workshops for item writers.
- Perform the test assembly of new specialized operational forms as per program directors requests
- Ensure compliance of new test forms with all specifications, parameters and other descriptive, format, sensitivity, quality or schematic criteria and standards.
- Follow standards agreed with QC team.
- Provide support to Executive Director of Test Development regarding the necessary training requirements for teachers, examiners and students for subjects related to PRLA programs.
- Perform any other duties or tasks as assigned or required.
To perform Test Development responsibilities, there is a continuous work with internal and external constituents for the tasks related to the creation of new test forms, as follows
- Assessment of the item bank and recommendations for pre-tests and operational form parts
- Meetings with directors, managers, and content specialists to establish annual test calendar
- Make recommendations to update the test calendars according to institutions’ needs after assessing test forms’ status in the working folders
- Work with the Research and Measurement team and follow recommendations for the psychometric parameters of new test forms (blueprints, master data,
- Train item writers and assess their work
- Plan committee of examiners’ meetings
- Recommend the external editors and work with their recommendations
- Recommend proof readers and work with their recommendations
- Work with the Publications’ team and the final proof for printing
Ph.D. degree preferred, or college degree and related equivalent field experience.
Five to seven years of experience performing similar duties and college degree/equivalent. Supervisory/management experience and training required.
Related Skills & Other Requirements:
- Graduate level knowledge of test development process
- Knowledge of test item construction, format, and style
- Knowledge of test assembly
- Superior language skills in Spanish and good communications skills in English
- Computer literacy
- Ability to work independently with little supervision and as a member of a team
- Ability to perform detailed review of written and graphic materials
- Ability to organize and plan work effectively
- Ability to handle multiple projects simultaneously
This position will be subject to a background check.
We offer our employees an outstanding benefits package which includes 4 weeks of paid time off, a generous retirement savings plan, tuition reimbursement and ongoing professional development and training.
The College Board’s mission is to connect students to college success and opportunity. We are a not-for-profit membership organization committed to excellence and equity in education. Among our best-known products are the SAT®, PSAT/NMSQT®, and Advanced Placement Program®. The College Board is committed to diversity in the workplace and is an Equal Opportunity Employer. The College Board participates in E-Verify, a service of DHS and SSA, where required. Please understand that only qualified applicants will be contacted.