ACTFL Center for Assessment, Research & Development (CARD)
Job Description: Principal Assessment Specialist
- This is a full-time exempt position.
- The Principal Assessment Specialist reports to the Associate Director for Assessment, Research and Development and works both independently and collaboratively with members of CARD.
Position Description: This position is an integral part of the ACTFL team. The Principal Assessment Specialist uses innovative methods and approaches to develop world language proficiency and performance assessments and manages ACTFL’s gold standard test development program. This position actively and energetically contributes to the formation of the intellectual vision and scope of ACTFL’s assessment program.
- Project Management
- Create detailed plans of work and timelines for new and existing assessment programs
- Manage the development of test content and ancillary materials
- Oversee the production of test material including video, sound, pictures, text and materials to be delivered on-line
- Coordinate test development process including needs analyses, specification development, item writing, reviews, pilot testing, bias and sensitivity review and field testing
- Identify and recruit necessary expertise for assessment programs and manage relevant work processes (e.g. item writers, item reviewers, fairness/sensitivity reviewers, graphic artists, psychometricians, videographers, voice and video talent etc.)
- Develop and conduct iterative quality assurance measures
- Work with senior management and other stakeholders to respond to requests for new assessment programs
- Validity and Reliability Assurance
- Coordinate needs analyses, content reviews and fairness/bias/sensitivity reviews
- Work with CARD team to gather data, publish and disseminate validity arguments for ACTFL tests
- Oversee pilot testing, field testing and usability testing
- Work in coordination with psychometric expertise to analyze test data to ensure the reliability and validity of ACTFL tests.
- Monitor factors such as item performance, test length, score spread, etc. to facilitate an iterative review process and ensure validity and reliability
- Capacity Building within ACTFL
- Help create any necessary infrastructure and capacities within ACTFL to assist in maintenance and expansion of large-scale standardized testing programs
- Train ACTFL staff and consultants in relevant components of new test development
- Document and improve test frameworks, test and item specifications
- Report to the field about innovations within ACTFL’s assessments
- Help build awareness and encourage use of new ACTFL assessments within the foreign language teaching community
- Demonstrate to members of the profession how ACTFL’s assessment innovations can serve as a model for elements of classroom instruction
- Serve as assessment liaison between ACTFL and LTI.
- M.A. or equivalent degree in testing and assessment, language education, applied linguistics, world language or related field
- Ability to identify problems, conceptualize solutions, prioritize tasks and meet deadlines
- Excellent writing, editing and proofreading skills; ability to write effective copy, instructional text, audio scripts/video scripts
- Excellent communication and interpersonal skills, a people-friendly attitude and an upbeat, positive demeanor
- Strong organization, planning and time management skills
- Ability to work collaboratively, cooperatively and collegially in a results-oriented environment
Experience: This position is appropriate for individuals with 5-10 years of relevant professional experience.
- Managing large scale projects required; PMP licensure desired
- Organizing development process from the needs analysis to field testing
- Working with web-based testing formats
- Applying the Standards for Educational and Psychological Testing to the test development process
- Supervising teams of consultant-based and telework employees
- This position begins July 1, 2017.
- This position is located in Alexandria, VA.
- This position requires the ability to travel. Travelling may occur up to 25% of the time.
- Applications will be reviewed beginning June 2 until the position is filled.