Psychometric Intern- Summer 2019
Named by Fast Company as one of the most innovative education companies, the College Board is a mission-focused organization, and powerful force in the lives of American students. To fulfill our purpose of clearing a path for students to own their future, we offer access, opportunity, and excellence to millions of students each year. Over the past five years, the College Board has been undergoing a transformation. We’ve redesigned the SAT, PSAT/NMSQT, and many AP courses and exams, and we’ve introduced the PSAT 10, PSAT 8/9, and Official SAT Practice on Khan Academy, all with great success.
The Psychometrics Department is looking for 2 PhD summer interns for 2019 and each intern will work with two mentors on a specific project in the area of psychometrics.
The internship spans 8 weeks, starting on June 3rd and ending on July 26th, with an expected weekly full-time workload (40 hours per week). This eight-week internship is designed to provide interns with opportunity to work closely with psychometricians and gain hands-on working experience with College Board data and projects. Interns are expected to perform a literature review, conduct analysis, write a research report, and present the research to College Board staff at the conclusion of the project.
To be eligible:
- Interns must be full time doctoral students at an accredited 4‐year university
- A strong preference will be made toward advanced students in the process of completing their dissertations
- Graduate students in psychometrics, measurement, quantitative & mathematical psychology, educational psychology, industrial‐organizational psychology, statistics or related fields are invited to submit applications
- Experience with statistical software (SAS, SPSS, and/or R) is required and working knowledge of Classical Test Theory, and Item Response Theory are desired
- Interns are expected to perform a literature review, conduct analysis, write a research report, and present the research to College Board staff at the conclusion of the project
- Students must be eligible to be legally employed in the United States (international F1 visa students please read details below)
- Internship timing: Eight weeks (June 3–July 26th 2019) require prior clearance from the College Board before the internship begins.
- Positions: 2
- Hours per week: 40 hours per week
- Location: Newtown, PA office (Yardley, PA)
- This is a paid internship
- Housing stipend can be offered when deemed necessary
- Application deadline by February 1st, 2019. Applicants will be informed about acceptances by March 8, 2019
- Please indicate in your Cover Letter which project you would like to be considered for.
Interns will work with two College Board mentors on a specific project in the area of psychometrics. Possible topics include:
Project 1: Investigation of Methods to Evaluate Item Fit Plot
In an operational testing environment, it is imperative that psychometric work be completed in a timely manner. One task that can be time consuming is the human review and evaluation of item characteristic curve plots for fit. The purpose of the proposed study is to evaluate variants of a method to evaluate item fit plots, with the goal of alleviating the need for human review. The study will utilize operational data and requires some advanced programming in R and familiarity with FlexMIRT. Familiarity with aberrancy detection methods is a plus.
Project 2: Nonequivalent Groups Equating Using International Group
Equating is typically conducted based on the domestic group. Under special circumstances it may be necessary to equate forms using the international group. This project will investigate the feasibility and impact of using international population and international sub-populations for SAT equating under common-item non-equivalent group (CINEG) equating design. The international sub-populations to be investigated include international test takers whose first language is English and international test takers whose best language is English.
Specifically, this project will:
- Look at the difference in response patterns in general between international and domestic test takers in terms of overall performance, underlying latent variables as revealed by factor analysis, IRT item parameter estimates. DIF analyses will also be conducted to gauge the magnitude of differential item functioning across domestic and international examinee groups.
- Evaluate the difference in anchor-to-total relationship for domestic and international test takers under different anchor lengths and different anchor compositions, including mini-anchor, midi-anchor, and anchor with less balanced content or item difficulty.
- Compare conversion tables developed based on domestic and international test takers under different anchor lengths and anchor compositions.
- Provide general guidelines on using international test takers for testing equating that is traditionally based on the domestic population.
International students who are studying at an accredited university under F1 visas are eligible to apply for the summer internship under Curricular Practical Training (CPT) stipulations. Please note that only two internship positions can be offered. International students should not apply for CPT unless accepted as a summer intern.
Upon acceptance to the summer internship, we urge students to contact their respective international advisers at their host university as soon as possible to apply for a practical training certificate, which permits F1 visa holders to receive compensation from the College Board for the work they will be completing over the summer. The process to clear a student for CPT may take six weeks or longer. Therefore we urge students to initiate the process as soon as possible. Additionally, all international students must have a social security number in order to receive compensation.